Understanding the Occurrence of Errors in Process Models Based on Metrics

Business process models play an important role for the management, design, and improvement of process organizations and process-aware information systems. Despite the extensive application of process modeling in practice, there are hardly empirical results available on quality aspects of process models. This paper aims to advance the understanding of this matter by analyzing the connection between formal errors (such as deadlocks) and a set of metrics that capture various structural and behavioral aspects of a process model. In particular, we discuss the theoretical connection between errors and metrics, and provide a comprehensive validation based on an extensive sample of EPC process models from practice. Furthermore, we investigate the capability of the metrics to predict errors in a second independent sample of models. The high explanatory power of the metrics has considerable consequences for the design of future modeling guidelines and modeling tools.

[1]  Arne Sølvberg,et al.  Understanding quality in conceptual modeling , 1994, IEEE Software.

[2]  A. Selçuk Güceglioglu,et al.  Using Software Quality Characteristics to Measure Business Process Quality , 2005, Business Process Management.

[3]  Heinrich Seidlmeier.  Prozessmodellierung mit ARIS , 2002 .

[4]  Lee Gang Soo,et al.  An empirical study on the complexity metrics of Petri nets , 1992 .

[5]  Daniel L. Moody,et al.  Theoretical and practical issues in evaluating the quality of conceptual models: current state and future directions , 2005, Data Knowl. Eng..

[6]  Mario Piattini,et al.  A family of experiments to validate metrics for software process models , 2005, J. Syst. Softw..

[7]  J. Staud.  Geschäftsprozessanalyse: Ereignisgesteuerte Prozessketten und objektorientierte Geschäftsprozessmodellierung für Betriebswirtschaftliche Standardsoftware , 2007 .

[8]  Sandro Morasca,et al.  Measuring attributes of concurrent software specifications in Petri nets , 1999, Proceedings Sixth International Software Metrics Symposium (Cat. No.PR00403).

[9]  Guttorm Sindre,et al.  Evaluating the Quality of Process Models: Empirical Testing of a Quality Framework , 2002, ER.

[10]  Jan Mendling,et al.  Faulty EPCs in the SAP Reference Model , 2006, Business Process Management.

[11]  Mayank Gupta,et al.  Structural metrics for goal based business process design and evaluation , 2005, Bus. Process. Manag. J..

[12]  Volker Gruhn,et al.  Complexity Metrics for business Process Models , 2006, BIS.

[13]  Volker Gruhn,et al.  Adopting the Cognitive Complexity Measure for Business Process Models , 2006, 2006 5th IEEE International Conference on Cognitive Informatics.

[14]  Marta Indulska,et al.  A Study of the Evolution of the Representational Capabilities of Process Modeling Grammars , 2006, CAiSE.

[15]  Marta Indulska,et al.  How do practitioners use conceptual modeling in practice? , 2006, Data Knowl. Eng..

[16]  Thomas Teufel,et al.  SAP R/3 Process Oriented Implementation: Iterative Process Prototyping , 1998 .

[17]  Peter Loos,et al.  Comparing the Control-Flow of EPC and Petri Net from the End-User Perspective , 2005, Business Process Management.

[18]  Boudewijn F. van Dongen,et al.  The ProM Framework: A New Era in Process Mining Tool Support , 2005, ICATPN.

[19]  Jorge S. Cardoso,et al.  Process control-flow complexity metric: An empirical validation , 2006, 2006 IEEE International Conference on Services Computing (SCC'06).

[20]  Jan Mendling,et al.  Detection and prediction of errors in EPCs of the SAP reference model , 2008, Data Knowl. Eng..

[21]  Ritu Agarwal,et al.  Object-oriented modeling with UML: a study of developers' perceptions , 2003, CACM.

[22]  Mark E. Nissen,et al.  Redesigning Reengineering Through Measurement-Driven Inference , 1998, MIS Q..

[23]  David DeMatteo,et al.  Essentials of research design and methodology , 2005 .

[24]  Wolfgang Reisig,et al.  Lectures on Petri Nets I: Basic Models , 1996, Lecture Notes in Computer Science.

[25]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[26]  E. Ziegel.  Introduction to the Theory and Practice of Econometrics , 1989 .

[27]  M. Braga,et al.  Exploratory Data Analysis , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[28]  August-Wilhelm Scheer,et al.  Wirtschaftsinformatik : Referenzmodelle für industrielle Geschäftsprozesse , 1995 .

[29]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[30]  Jan Mendling,et al.  Detection and prediction of errors in EPC business process models , 2007 .

[31]  Stefano Spaccapietra,et al.  Conceptual Modeling — ER 2002 , 2002, Lecture Notes in Computer Science.

[32]  Markus Nüttgens,et al.  Syntax und Semantik Ereignisgesteuerter Prozessketten (EPK) , 2002, Promise.

[33]  Jan Mendling,et al.  EPC markup language (EPML): an XML-based interchange format for event-driven process chains (EPC) , 2006, Inf. Syst. E Bus. Manag..

[34]  J. Krogstie,et al.  Formalization and verification of EPCs with OR-joins based on state and context , 2007 .

[35]  John Krogstie,et al.  Process models representing knowledge for action: a revised quality framework , 2006, Eur. J. Inf. Syst..

[36]  Mario Piattini,et al.  Towards a Suite of Metrics for Business Process Models in BPMN , 2006, ICEIS.

[37]  Stijn Hoppenbrouwers,et al.  A Fundamental View on the Process of Conceptual Modeling , 2005, ER.

[38]  Hajo A. Reijers,et al.  Cohesion and Coupling Metrics for Workflow Process Design , 2004, Business Process Management.

[39]  Jörg Becker,et al.  Guidelines of Business Process Modeling , 2000, Business Process Management.

[40]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[41]  Jan Mendling,et al.  Error Metrics for Business Process Models , 2007, CAiSE Forum.