Publications

List of Publications

Business Informatics Group, TU Wien

Reset Filters

How are LLMs Used for Conceptual Modeling? An Exploratory Study on Interaction Behavior and User Perception

Syed Juned AliIris Reinhartz-BergerDominik Bork

View .bib

Handle: 20.500.12708/205508; DOI: 10.1007/978-3-031-75872-0_14; Year: 2024; Issued On: 2024-01-01; Type: Publication; Subtype: Inproceedings; Peer Reviewed:

Keywords: Domain Modeling, Large Language Model, Process Mining, UML
Astract: Large Language Models (LLMs) have opened new opportunities in modeling in general, and conceptual modeling in particular. With their advanced reasoning capabilities, accessible through natural language interfaces, LLMs enable humans to deepen their understanding of different application domains and enhance their modeling skills. However, the open-ended nature of these interfaces results in diverse interaction behaviors, which may also affect the perceived usefulness of LLM-assisted conceptual modeling. Existing works focus on various quality metrics of LLM outcomes, yet limited attention is given to how users interact with LLMs for such modeling tasks. To address this gap, we present the design and findings of an empirical study conducted with information systems students. After labeling the interactions according to their intentions (e.g., Create Model, Discuss, or Present), and representing them as an event log, we applied process mining techniques to discover process models. These models vividly capture the interaction behaviors and reveal recurrent patterns. We explored the differences in interacting with two LLMs (GPT 4.0 and Code Llama) for two modeling tasks (use case and domain modeling) across three application domains. Additionally, we analyzed user perceptions regarding the usefulness and ease of use of LLM-assisted conceptual modeling.

Ali, S. J., Reinhartz-Berger, I., & Bork, D. (2024). How are LLMs Used for Conceptual Modeling? An Exploratory Study on Interaction Behavior and User Perception. In Conceptual Modeling (pp. 257–275). https://doi.org/10.1007/978-3-031-75872-0_14

Establishing Traceability Between Natural Language Requirements and Software Artifacts by Combining RAG and LLMs

Syed Juned AliVarun NaganathanDominik Bork

View .bib

Handle: 20.500.12708/205507; DOI: 10.1007/978-3-031-75872-0_16; Year: 2024; Issued On: 2024-01-01; Type: Publication; Subtype: Inproceedings; Peer Reviewed:

Keywords:

Ali, S. J., Naganathan, V., & Bork, D. (2024). Establishing Traceability Between Natural Language Requirements and Software Artifacts by Combining RAG and LLMs. In Conceptual Modeling (pp. 295–314). https://doi.org/10.1007/978-3-031-75872-0_16

Metamodels: Built-In BIM Compliance Checking

Galina PaskalevaThomas BednarChristian Huemer

View PDF View .bib

Handle: 20.500.12708/205727; DOI: 10.34726/7559; Year: 2024; Issued On: 2024-01-01; Type: Publication; Subtype: Inproceedings;

Keywords: BIM, simulation, data model, metamodel, compliance checking
Astract: Making sure that Building Information Modelling (BIM) models comply with building codes and contractual requirements is typically a time-consuming and overhead-heavy task. For this reason, there is a push for its automation. However, there are significant challenges to overcome. For example, most technical guidelines and contractual requirements are formulated in a natural language and would need to be translated into a formal representation for digital processing. Furthermore, there is no formal mechanism that enables the declaration, enforcement, and verification of compliance to those in a BIM model. In this work, we present a fundamental approach that makes the last three possible at any level of granularity, i.e., throughout the building’s entire life cycle.

Paskaleva, G., Bednar, T., & Huemer, C. (2024). Metamodels: Built-In BIM Compliance Checking. In T. Bednar & S. Sint (Eds.), BauSIM 2024 Companion Proceedings : 10te Konferenz von IBPSA-DACH, TU Wien, Österreich (pp. 13–14). https://doi.org/10.34726/7559

Towards a reference ontology for a data valuation business capability

Markus HafnerMiguel Mira da SilvaHenderik Proper

View .bib

Handle: 20.500.12708/208545; DOI: 10.1080/17517575.2024.2358920; Year: 2024; Issued On: 2024-01-01; Type: Publication; Subtype: Article; Peer Reviewed:

Keywords: business capability, conceptual model, data valuation, Data value, reference ontology
Astract: Despite its recognition as primary asset, enterprises struggle to determine data value due to fragmented and impractical approaches. This paper develops a reference ontology for Data Valuation Business Capabilities (DVBC) leveraging the systematic approach for building ontologies, ArchiMate and integrating scientific insights with ex-ante expert interview validation. Comprising twelve groupings and 66 components, anchored in established ontologies and assessed against (non)-functional requirements, the ontology shapes the fragmented data valuation landscape into a structuring frame for enterprises. While advancing value modelling in information systems research, the ontology faces limitations like detailed process modelling deficiency, ex-post validation potential, and modelling language boundaries.

Hafner, M., Mira da Silva, M., & Proper, H. A. (2024). Towards a reference ontology for a data valuation business capability. Enterprise Information Systems, 18(7), 1–24. https://doi.org/10.1080/17517575.2024.2358920

On Views, Diagrams, Programs, Animations, and Other Models

Henderik ProperGiancarlo Guizzardi

View .bib

Handle: 20.500.12708/208700; Year: 2024; Issued On: 2024-01-01; Type: Publication; Subtype: Book Contribution;

Keywords: domain models
Astract: Humanity has long since used models in different shapes and forms to understand, redesign, communicate about, and shape, the world around us; including many different social, economic, biological, chemical, physical, and digital aspects. This has resulted in a wide range of modeling practices. When the models as used in such modeling practices have a key role to play in the activities in which these modeling practices are ‘embedded’, the need emerges to consider the effectiveness and efficiency of such processes, and speak about modeling capabilities. In the latter situation, it becomes relevant to develop a thorough understanding of the artifacts involved in the modeling practices/capabilities. One field in which models play (an increasingly) important role is the field of system development (including software engineering, information systems engineering, and enterprise design management). In this context, we come across notions, such as views, diagrams, programs, animations, specifications, etc. The aim of this paper is to take a fundamental look at these notions. In doing so, we will argue that these notions should actually be seen as specific kinds of models, albeit for fundamentally different purposes.

Proper, H. A., & Guizzardi, G. (2024). On Views, Diagrams, Programs, Animations, and Other Models. In S. Strecker & J. Jung (Eds.), Informing Possible Future Worlds. Essays in Honour of Ulrich Frank (pp. 123–138). Logos.

Adding Dynamic Simulation to Business Process Modeling via System Dynamics

Henderik ProperQ. ZhuJ. P. P. RavesteijnW. Gielingh

View .bib

Handle: 20.500.12708/208702; DOI: 10.1007/978-3-031-50974-2_42; Year: 2024; Issued On: 2024-01-01; Type: Publication; Subtype: Inproceedings; Peer Reviewed:

Keywords: BPMN, Facade Maintenance, System Dynamics
Astract: Business process modeling and system dynamics are different approaches that are used in the design and management of organizations. Both approaches are concerned with the processes in, and around, organizations with the aim to identify, design and understand their behavior as well as potential improvements. At the same time, these approaches differ considerably in their methodological focus. While business process modeling specifically takes the (control flow of) business processes as its primary focus, system dynamics takes the analysis of complex and multi-faceted systems as its core focus. More explicitly combining both approaches has the potential to better model and analyze (by way of simulation) complex business processes, while specifically also including more relevant facets from the environment of these business processes. Furthermore, the inherent ability for simulation of system dynamics models, can be used to simulate the behavior of processes over time, while also putting business processes in a broader multi-faceted context. In this paper, we report on initial results on making such a more explicit combination of business process modeling and system dynamics. In doing so, we also provide a step-by-step guide on how to use BPMN based models and system dynamics models together to model and analyze complex business processes, while illustrating this in terms of a case study on the maintenance of building facades.

Proper, H. A., Zhu, Q., Ravesteijn, J. P. P., & Gielingh, W. (2024). Adding Dynamic Simulation to Business Process Modeling via System Dynamics. In Business Process Management Workshops (pp. 565–576). https://doi.org/10.1007/978-3-031-50974-2_42

Stakeholder-specific Jargon-based Representation of Multimodal Data within Business Process

Aleksandar GavricDominik BorkHenderik Proper

View .bib

Handle: 20.500.12708/208681; Year: 2024; Issued On: 2024-01-01; Type: Publication; Subtype: Inproceedings; Peer Reviewed:

Keywords: Process Models, Transformer models, Multimodal Evidence, Process Representation
Astract: Stakeholders can struggle to understand and engage with process models due to a mismatch between the technical language used and their own domain-specific jargon and personal communication styles. The paper explores the application of transformer-based architectures to enhance the representation of process models and additional multimodal process data by tailoring them to the language of stakeholders. We present an approach that personalizes process model representations through two types of paraphrasers: one that aligns with domain-specific jargon and another that adapts to individual stakeholder styles. We developed a golden dataset from process model-stakeholder interaction simulation and a silver dataset using large language models to train and validate our approach. Initial findings suggest that these methods could enhance stakeholder engagement and contribute to better teaching of process mining and procedural thinking.

Gavric, A., Bork, D., & Proper, H. (2024). Stakeholder-specific Jargon-based Representation of Multimodal Data within Business Process. In S. Hacks & B. Roelens (Eds.), Companion Proceedings of the 17th IFIP WG 8.1 Working Conference on the Practice of Enterprise Modeling Forum, M4S, FACETE, AEM, Tools and Demos. http://hdl.handle.net/20.500.12708/208681

Towards a textbook on ontology-guided conceptual modeling

Henderik ProperBas van Gils

View .bib

Handle: 20.500.12708/208704; Year: 2024; Issued On: 2024-01-01; Type: Publication; Subtype: Inproceedings; Peer Reviewed:

Keywords: Textbook, Conceptual Modeling, Ontology-Guided Modeling

Proper, H., & van Gils, B. (2024). Towards a textbook on ontology-guided conceptual modeling. In H. Weigand, T. Prince Sales, & P. Johanesson (Eds.), Proceedings of 17th International Workshop on Value Modelling and Business Ontologies. http://hdl.handle.net/20.500.12708/208704

Message from the Modellierung'24 Industry-Forum Chairs

Peter LoosHenderik Proper

View .bib

Handle: 20.500.12708/208684; DOI: 10.18420/MODELLIERUNG2024-WS-023; Year: 2024; Issued On: 2024-01-01; Type: Publication; Subtype: Inproceedings;

Keywords:

Loos, P., & Proper, H. (2024). Message from the Modellierung’24 Industry-Forum Chairs. In Modellierung 2024 - Workshopband. Modellierung 2024, Potsdam, Germany. https://doi.org/10.18420/MODELLIERUNG2024-WS-023

A double means-end relationship for data

Bas van GilsHenderik Proper

View .bib

Handle: 20.500.12708/209785; DOI: 10.1109/CBI62504.2024.00031; Year: 2024; Issued On: 2024-01-01; Type: Publication; Subtype: Inproceedings; Peer Reviewed:

Keywords: data strategy, data management, semiotic triangle
Astract: It appears that, in an increasingly digital world, data is becoming more and more important for organizations. In several real-world cases in the Netherlands, we have seen that organizations struggle with issues such as: a) What data do we have? b) Which data do we need for value creation? c) Which strategic choices do we make around using data? d) Which strategic choices do we make around managing data as an asset? And e) Which skills do our people need in light of the previous items? The context for these organizations is different, but the challenges are the same. Our position is that the use of models can help to get to grips with the complexity of the aforementioned challenges. In this paper we explore a) the relationship between data and models, and b) a framework that connects data management as a means to care for data as an asset, and data as a means to achieve strategic objectives of the organization. In developing the latter, we follow a design science approach; we explore cases to understand challenges and requirements for such a framework as well as show how the framework helped to solve the challenges in these organizations.

van Gils, B., & Proper, H. A. (2024). A double means-end relationship for data. In 2024 26th International Conference on Business Informatics (CBI) (pp. 198–207). IEEE. https://doi.org/10.1109/CBI62504.2024.00031