Evaluation of Modeling Methods

For correct utilization of a modeling language and comprehension of a conceptual model, the graphical representation, i.e., the notation, is of paramount importance. A graphical notation, especially for domain-specific languages, should be aligned to the knowledge, beliefs, and expectations of the intended model users. More concretely, the notation of a modeling language should support computational offloading for the human user by increasing perceptual processing (i.e., seeing) and reducing cognitive processing (i.e., thinking and understanding). Consequently, method engineers should design intuitively understandable notations. However, there is a lack of support in evaluating the intuitiveness of a notation.


The major task of this project is to define a concept for a web-based evaluation of a conceptual modelling language notation. The concept shall be prototypically implemented used SOTA web standards and frameworks. The idea is to integrate the web environment with metamodeling platforms such that metamodels and notations can be easily imported and a set of empirical evaluation experiments can be generated. These experiments include Likert style questions, comparison of different alternative notations, open questions, association tests, and the drawing of new notations using a WYSIWYG web drawing editor.

Further Reading (Excerpt)

  • Bork, D., Schrüffer, C., & Karagiannis, D. (2019). Intuitive understanding of domain-specific modeling languages: proposition and application of an evaluation technique. In International Conference on Conceptual Modeling (pp. 311-319). Springer, Cham.
  • Roelens, B., & Bork, D. (2020). An Evaluation of the Intuitiveness of the PGA Modeling Language Notation. In Enterprise, Business-Process and Information Systems Modeling (pp. 395-410). Springer, Cham.
  • Further unpublished material will be provided
Dominik Bork
Dominik Bork
Assistant Prof. Dipl.-Wirtsch.Inf.Univ. Dr.rer.pol.