Quality of Business Process Models

Processes modeling is done for a number of reasons in relation to enterprise modeling, business process modeling and information systems development, and is a widely used technique. In particular after the introduction of BPR and workflow in the nineties, much work has looked on quality of business process models. In this paper we present a specialization of a general framework for assessing quality of models to support the evaluation the quality of business process models. The specialization takes earlier work on quality of models, process quality and quality of business process models into account. Comparing the approaches we find on the one hand that the properties of business process model quality is subsumed by the generic framework on a high level, and that there are aspects in this framework that are not covered by the existing work on business process model quality. On the other hand, the comparison has resulted in an extension of the generic framework for these kinds of models, and in this way improved the practical applicability of the framework when applied to discussing the quality of business process models.

[1]  Jan Mendling,et al.  The Impact of Activity Labeling Styles on Process Model Quality , 2008, SIGSAND-EUROPE.

[2]  Félix García,et al.  Improving Quality of Business Process Models , 2011, ENASE.

[3]  Jan Recker,et al.  Ontology- Versus Pattern-Based Evaluation of Process Modeling Languages: A Comparison , 2007, Commun. Assoc. Inf. Syst..

[4]  Mario Piattini,et al.  Analysis and Validation of Control-Flow Complexity Measures with BPMN Process Models , 2009, BMMDS/EMMSAD.

[5]  R. Carnap,et al.  INTERNATIONAL ENCYCLOPEDIA OF UNIFIED SCIENCE. , 1939, Science.

[6]  John Krogstie,et al.  Active knowledge modeling of enterprises , 2008 .

[7]  Daniel L. Moody,et al.  The method evaluation model: a theoretical model for validating information systems design methods , 2003, ECIS.

[8]  Neil A. M. Maiden,et al.  Collaborative modelling of reflection to inform the development and evaluation of work-based learning technologies , 2012, i-KNOW '12.

[9]  Volker Gruhn,et al.  Good and Bad Excuses for Unstructured Business Process Models , 2007, EuroPLoP.

[10]  John Krogstie,et al.  Semantic Annotation Framework to Manage Semantic Heterogeneity of Process Models , 2006, CAiSE.

[11]  Selmin Nurcan,et al.  Enterprise, Business-Process and Information Systems Modeling - 12th International Conference, BPMDS 2011, and 16th International Conference, EMMSAD 2011, held at CAiSE 2011, London, UK, June 20-21, 2011. Proceedings , 2011, BMMDS/EMMSAD.

[12]  Jan Mendling,et al.  A Discourse on Complexity of Process Models , 2006, Business Process Management Workshops.

[13]  John Krogstie,et al.  Integrated Goal, Data and Process Modeling: From TEMPORA to Model-Generated Work-Places , 2008 .

[14]  Jan Mendling,et al.  The Impact of Structuredness on Error Probability of Process Models , 2008, UNISCON.

[15]  Ralf Laue,et al.  Cognitive Complexity in Business Process Modeling , 2011, CAiSE.

[16]  C. Morris.  Foundations of the theory of signs , 1938 .

[17]  P. Berger,et al.  The Social Construction of Reality , 1966 .

[18]  Remco M. Dijkman,et al.  Similarity of business process models: Metrics and evaluation , 2011, Inf. Syst..

[19]  Daniel L. Moody,et al.  Metrics for Evaluating the Quality of Entity Relationship Models , 1998, ER.

[20]  Hajo A. Reijers,et al.  Best practices in business process redesign: an overview and qualitative evaluation of successful redesign heuristics , 2005 .

[21]  Zahir Tari,et al.  On the Move to Meaningful Internet Systems 2007: CoopIS, DOA, ODBASE, GADA, and IS, OTM Confederated International Conferences CoopIS, DOA, ODBASE, GADA, and IS 2007, Vilamoura, Portugal, November 25-30, 2007, Proceedings, Part II , 2007, OTM Conferences.

[22]  Wil M. P. van der Aalst,et al.  Workflow Patterns , 2004, Distributed and Parallel Databases.

[23]  Daniel L. Moody,et al.  Theoretical and practical issues in evaluating the quality of conceptual models: current state and future directions , 2005, Data Knowl. Eng..

[24]  N. Kano,et al.  Attractive Quality and Must-Be Quality , 1984 .

[25]  Ron Weber,et al.  On the ontological expressiveness of information systems analysis and design grammars , 1993, Inf. Syst. J..

[26]  John Krogstie.  Model-Based Development and Evolution of Information Systems: A Quality Approach , 2012 .

[27]  Danilo Caivano,et al.  Prediction Models for BPMN Usability and Maintainability , 2009, 2009 IEEE Conference on Commerce and Enterprise Computing.

[28]  Ekkart Kindler,et al.  On the semantics of EPCs: Resolving the vicious circle , 2006, Data Knowl. Eng..

[29]  Remco M. Dijkman,et al.  Human and automatic modularizations of process models to enhance their comprehension , 2011, Inf. Syst..

[30]  Jan Mendling,et al.  Structuredness and its significance for correctness of process models , 2010, Inf. Syst. E Bus. Manag..

[31]  Félix García,et al.  Towards thresholds of control flow complexity measures for BPMN models , 2011, SAC.

[32]  Harald Wesenberg.  Enterprise Modeling in an Agile World , 2011, PoEM.

[33]  Claude E. Shannon,et al.  A mathematical theory of communication , 1948, MOCO.

[34]  Arne Sølvberg,et al.  Understanding quality in conceptual modeling , 1994, IEEE Software.

[35]  John Krogstie,et al.  A Structured Evaluation to Assess the Reusability of Models of User Profiles , 2010, BMMDS/EMMSAD.

[36]  Alan M. Davis,et al.  Identifying and measuring quality in a software requirements specification , 1993, [1993] Proceedings First International Software Metrics Symposium.

[37]  Ulrich Frank,et al.  Evaluation of Reference Models , 2006 .

[38]  Jan Mendling,et al.  On a Quest for Good Process Models: The Cross-Connectivity Metric , 2008, CAiSE.

[39]  Jan Mendling,et al.  On the Usage of Labels and Icons in Business Process Modeling , 2010, Int. J. Inf. Syst. Model. Des..

[40]  Jan Mendling,et al.  Seven process modeling guidelines (7PMG) , 2010, Inf. Softw. Technol..

[41]  Rob Davis,et al.  Business Process Modelling with ARIS: A Practical Guide , 2001 .

[42]  Daniel L. Moody,et al.  The “Physics” of Notations: Toward a Scientific Basis for Constructing Visual Notations in Software Engineering , 2009, IEEE Transactions on Software Engineering.

[43]  Remco M. Dijkman,et al.  Semantics and analysis of business process models in BPMN , 2008, Inf. Softw. Technol..

[44]  Jan Mendling,et al.  Error Metrics for Business Process Models , 2007, CAiSE Forum.

[45]  Graeme G. Shanks,et al.  A semiotic information quality framework: development and comparative analysis , 2005, J. Inf. Technol..

[46]  Graeme G. Shanks,et al.  What Makes a Good Data Model? Evaluating the Quality of Entity Relationship Models , 1994, ER.

[47]  Frank Leymann,et al.  Faster and More Focused Control-Flow Analysis for Business Process Models Through SESE Decomposition , 2007, ICSOC.

[48]  Carlo Batini,et al.  Methodologies for data quality assessment and improvement , 2009, CSUR.

[49]  Ross Brown.  Conceptual modelling in 3D Virtual Worlds for Process Communication , 2010, APCCM.

[50]  Lance Fortnow,et al.  ViewpointTime for computer science to grow up , 2009, Commun. ACM.

[51]  Hajo A. Reijers,et al.  How Good Is an AS-IS Model Really? , 2012, Business Process Management Workshops.

[52]  Carlo Batini,et al.  Data Quality: Concepts, Methodologies and Techniques , 2006, Data-Centric Systems and Applications.

[53]  Peter Rittgen,et al.  Business Process Model Similarity as a Proxy for Group Consensus , 2011, PoEM.

[54]  Jörg Becker,et al.  Guidelines of Business Process Modeling , 2000, Business Process Management.

[55]  Mark Strembeck,et al.  Influence Factors of Understanding Business Process Models , 2008, BIS.

[56]  Jan Mendling,et al.  Syntax highlighting in business process models , 2011, Decis. Support Syst..

[57]  Jeff Tian.  What Is Software Quality , 2005 .

[58]  Wil M. P. van der Aalst,et al.  Complexity metrics for Workflow nets , 2009, Inf. Softw. Technol..

[59]  Jon Atle Gulla,et al.  A general explanation component for conceptual modeling in CASE environments , 1996, TOIS.

[60]  John Krogstie,et al.  Integrated Quality of Models and Quality of Maps , 2009, BMMDS/EMMSAD.

[61]  Ron Weber,et al.  Research Commentary: Information Systems and Conceptual Modeling - A Research Agenda , 2002, Inf. Syst. Res..

[62]  Manfred Reichert,et al.  Refactoring large process model repositories , 2011, Comput. Ind..

[63]  Filippo Ricca,et al.  “Precise is better than light” a document analysis study about quality of business process models , 2011, Workshop on Empirical Requirements Engineering (EmpiRE 2011).

[64]  John Krogstie,et al.  A Semiotic Approach to Data Quality , 2013, BMMDS/EMMSAD.

[65]  Volker Gruhn,et al.  Detecting Common Errors in Event-Driven Process Chains by Label Analysis , 2011, Enterp. Model. Inf. Syst. Archit. Int. J. Concept. Model..

[66]  Jan Mendling,et al.  A Study Into the Factors That Influence the Understandability of Business Process Models , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[67]  Klaus Pohl.  The Three Dimensions of Requirements Engineering , 2013, Seminal Contributions to Information Systems Engineering.

[68]  Jörg Becker,et al.  Grundsätze ordnungsmässiger Modellierung , 1995 .

[69]  John Krogstie,et al.  Quality of Conceptual Data Models , 2013 .

[70]  Jan Mendling,et al.  On the Translation between BPMN and BPEL , 2006, EMMSAD.

[71]  John Krogstie,et al.  A Semiotic Approach to Quality in Requirements Specifications , 2001, Organizational Semiotics.

[72]  John Krogstie,et al.  Perspectives to Process Modeling - A Historical Overview , 2012, BMMDS/EMMSAD.

[73]  John Krogstie,et al.  Validating Conceptual Models by Transformational Prototyping , 1993, CAiSE.

[74]  Dennis Tsichritzis,et al.  The ANSI/X3/SPARC DBMS Framework Report of the Study Group on Dabatase Management Systems , 1978, Inf. Syst..

[75]  Guttorm Sindre,et al.  Evaluating the Quality of Process Models: Empirical Testing of a Quality Framework , 2002, ER.

[76]  Peter J. Denning.  Editorial: what is software quality? , 1992, CACM.

[77]  Jan Mendling,et al.  What Makes Process Models Understandable? , 2007, BPM.

[78]  Jan Mendling,et al.  Tying Process Model Quality to the Modeling Process: The Impact of Structuring, Movement, and Speed , 2012, BPM.

[79]  Volker Gruhn,et al.  Approaches for Business Process Model Complexity Metrics , 2007 .

[80]  Jan Mendling,et al.  Quality Assessment of Business Process Models Based on Thresholds , 2010, OTM Conferences.

[81]  Jan Mendling,et al.  Generating Natural Language Texts from Business Process Models , 2012, CAiSE.

[82]  Jan Mendling,et al.  Understanding the Occurrence of Errors in Process Models Based on Metrics , 2007, OTM Conferences.

[83]  Mario Piattini,et al.  An Exploratory Experiment to Validate Measures for Business Process Models , 2007, RCIS.

[84]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[85]  Mario Piattini,et al.  A conceptual modeling quality framework , 2011, Software Quality Journal.

[86]  Jan Mendling,et al.  Quality indicators for business process models from a gateway complexity perspective , 2012, Inf. Softw. Technol..

[87]  Eckhard D. Falkenberg,et al.  FRISCO: A framework of information system concepts : The FRISCO report (WEB edition) , 1998 .

[88]  Sandra Seiz,et al.  On a Study of Layout Aesthetics for Business Process Models Using BPMN , 2010, BPMN.

[89]  Jan Mendling,et al.  Thresholds for error probability measures of business process models , 2012, J. Syst. Softw..

[90]  Raymond E. Levitt,et al.  The virtual design team , 1998, CACM.

[91]  Jan Mendling,et al.  Understanding Business Process Models: The Costs and Benefits of Structuredness , 2012, CAiSE.

[92]  Michael Rosemann,et al.  A process modelling success model: insights from a case study , 2003, ECIS.

[93]  Jan Mendling,et al.  The Impact of Secondary Notation on Process Model Understanding , 2009, PoEM.

[94]  Jan Mendling,et al.  Activity labeling in process modeling: Empirical insights and recommendations , 2010, Inf. Syst..

[95]  Remco M. Dijkman,et al.  On the usefulness of subprocesses in business process models , 2010 .

[96]  Jan Mendling,et al.  Detection and prediction of errors in EPCs of the SAP reference model , 2008, Data Knowl. Eng..

[97]  Graeme Shanks,et al.  A Semiotic Information Quality Framework , 2004 .

[98]  Michael Rosemann,et al.  Process Management: A Guide for the Design of Business Processes , 2011 .

[99]  Jan Mendling,et al.  Modularity in Process Models: Review and Effects , 2008, BPM.

[100]  John Krogstie,et al.  Evaluating UML using a generic quality framework , 2003 .

[101]  Chris Gane,et al.  Structured Systems Analysis: Tools and Techniques , 1977 .

[102]  Jacques Bertin,et al.  Semiology of Graphics - Diagrams, Networks, Maps , 2010 .

[103]  Jan Mendling,et al.  Towards Systematic Usage of Labels and Icons in Business Process Models , 2008, EMMSAD.