Quality Assessment of Business Process Models Based on Thresholds

Process improvement is recognized as the main benefit of process modelling initiatives. Quality considerations are important when conducting a process modelling project. While the early stage of business process design might not be the most expensive ones, they tend to have the highest impact on the benefits and costs of the implemented business processes. In this context, quality assurance of the models has become a significant objective. In particular, understandability and modifiability are quality attributes of special interest in order to facilitate the evolution of business models in a highly dynamic environment. These attributes can only be assessed a posteriori, so it is of central importance for quality management to identify significant predictors for them. A variety of structural metrics have recently been proposed, which are tailored to approximate these usage characteristics. The aim of this paper is to verify how understandable and modifiable BPMN models relate to these metrics by means of correlation and regression analyses. Based on the results we determine threshold values to distinguish different levels of process model quality. As such threshold values are missing in prior research, we expect to see strong implications of our approach on the design of modelling guidelines.

[1]  Hajo A. Reijers,et al.  Evaluating workflow process designs using cohesion and coupling metrics , 2008, Comput. Ind..

[2]  Jan Mendling,et al.  Structuredness and its significance for correctness of process models , 2010, Inf. Syst. E Bus. Manag..

[3]  Volker Gruhn,et al.  Complexity Metrics for business Process Models , 2006, BIS.

[4]  Mario Piattini,et al.  Measurement in business processes: a systematic review , 2010, Bus. Process. Manag. J..

[5]  Brian Henderson-Sellers,et al.  Object-Oriented Metrics , 1995, TOOLS.

[6]  Abdul Azim Abdul Ghani,et al.  An Ensemble of Complexity Metrics for BPEL Web Processes , 2008, 2008 Ninth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing.

[7]  Mario Piattini,et al.  Evaluation measures for business process models , 2006, SAC.

[8]  Jan Mendling,et al.  What Makes Process Models Understandable? , 2007, BPM.

[9]  Michael Rosemann,et al.  Potential pitfalls of process modeling: part A , 2006, Bus. Process. Manag. J..

[10]  Jan Mendling,et al.  On a Quest for Good Process Models: The Cross-Connectivity Metric , 2008, CAiSE.

[11]  Danilo Caivano,et al.  Prediction Models for BPMN Usability and Maintainability , 2009, 2009 IEEE Conference on Commerce and Enterprise Computing.

[12]  Douglas G Altman,et al.  Dichotomizing continuous predictors in multiple regression: a bad idea , 2006, Statistics in medicine.

[13]  Jan Mendling,et al.  Metrics for Process Models: Empirical Foundations of Verification, Error Prediction, and Guidelines for Correctness , 2008, Lecture Notes in Business Information Processing.

[14]  Jan Mendling,et al.  Seven process modeling guidelines (7PMG) , 2010, Inf. Softw. Technol..

[15]  Daniel L. Moody,et al.  Theoretical and practical issues in evaluating the quality of conceptual models: current state and future directions , 2005, Data Knowl. Eng..

[16]  Akhil Kumar,et al.  New Quality Metrics for Evaluating Process Models , 2008, Business Process Management Workshops.

[17]  Peri Loucopoulos,et al.  Conceptual Modeling, Databases, and Case: An Integrated View of Information Systems Development , 1992 .

[18]  Marta Indulska,et al.  Business Process Modeling: Perceived Benefits , 2009, ER.

[19]  Volker Gruhn,et al.  Adopting the Cognitive Complexity Measure for Business Process Models , 2006, 2006 5th IEEE International Conference on Cognitive Informatics.

[20]  Mario Piattini Velthuis,et al.  Measurement in business processes: a systematic review , 2010 .

[21]  R. Doerge,et al.  Empirical threshold values for quantitative trait mapping. , 1994, Genetics.

[22]  Jörg Becker,et al.  Guidelines of Business Process Modeling , 2000, Business Process Management.

[23]  Marian Petre,et al.  Usability Analysis of Visual Programming Environments: A 'Cognitive Dimensions' Framework , 1996, J. Vis. Lang. Comput..

[24]  Wil M. P. van der Aalst,et al.  Complexity metrics for Workflow nets , 2009, Inf. Softw. Technol..

[25]  Tommie J. Lucius.  Department of Defense Quality Management Systems and ISO 9000:2000 , 2002 .

[26]  Jorge S. Cardoso,et al.  Process control-flow complexity metric: An empirical validation , 2006, 2006 IEEE International Conference on Services Computing (SCC'06).

[27]  R. Bender,et al.  Quantitative risk assessment in epidemiological studies investigating threshold effects , 1999 .

[28]  David J. Gilmore,et al.  Comprehension and Recall of Miniature Programs , 1984, Int. J. Man Mach. Stud..

[29]  Wei Li,et al.  Finding software metrics threshold values using ROC curves , 2010 .

[30]  Marvin V. Zelkowitz,et al.  Experimental Models for Validating Technology , 1998, Computer.

[31]  Dewayne E. Perry,et al.  Studies in process simplification , 1997, Softw. Process. Improv. Pract..

[32]  Dewayne E. Perry,et al.  A study in process simplification , 1996, Proceedings of Software Process 1996.

[33]  Patrick McDermott,et al.  Workflow Modeling: Tools for Process Improvement and Application Development , 2001 .

[34]  Jorge S. Cardoso,et al.  Business Process Quality Metrics: Log-Based Complexity of Workflow Patterns , 2007, OTM Conferences.

[35]  Mario Piattini,et al.  Analysis and Validation of Control-Flow Complexity Measures with BPMN Process Models , 2009, BMMDS/EMMSAD.

[36]  Jorge Cardoso,et al.  How to Measure the Control-flow Complexity of Web Processes and Workflows , 2005 .

[37]  Wil M. P. van der Aalst,et al.  Conformance checking of processes based on monitoring real behavior , 2008, Inf. Syst..

[38]  Peter Rittgen,et al.  Negotiating Models , 2007, CAiSE.

[39]  Barbara A. Kitchenham,et al.  A Simulation Study of the Model Evaluation Criterion MMRE , 2003, IEEE Trans. Software Eng..

[40]  Jae-Yoon Jung.  Measuring Entropy in Business Process Models , 2008, 2008 3rd International Conference on Innovative Computing Information and Control.

[41]  Zahir Tari,et al.  On the Move to Meaningful Internet Systems 2007: CoopIS, DOA, ODBASE, GADA, and IS, OTM Confederated International Conferences CoopIS, DOA, ODBASE, GADA, and IS 2007, Vilamoura, Portugal, November 25-30, 2007, Proceedings, Part II , 2007, OTM Conferences.