Identifying Quality Issues in BPMN Models: an Exploratory Study

Even though considerable progress regarding the technical perspective on modeling and supporting business processes has been achieved, it appears that the human perspective is still often left aside. In particular, we do not have an in-depth understanding of how process models are inspected by humans, what strategies are taken, and what cognitive processes are involved. This paper takes a first step towards such an understanding and reports an exploratory study investigating how humans identify quality issues in BPMN process models. Providing preliminary answers to initial research questions, we also indicate other research questions that can be investigated using this approach. Our qualitative analysis shows that humans adapt different strategies on how to identify quality issues. Finally, we observed for different quality dimensions quality issues that were spotted by a large number of subjects (e.g., deadlocks), but also quality issues that did not seem to bother the participants of this study (e.g., line crossings).

[1]  Helen C. Purchase,et al.  Which Aesthetic has the Greatest Effect on Human Understanding? , 1997, GD.

[2]  Jan Mendling,et al.  Managing Process Model Complexity via Concrete Syntax Modifications , 2011, IEEE Transactions on Industrial Informatics.

[3]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[4]  D. Herrmann,et al.  Problem perception and knowledge structure in expert and novice mathematical problem solvers. , 1982 .

[5]  Marlon Dumas,et al.  Fast detection of exact clones in business process model repositories , 2013, Inf. Syst..

[6]  Manfred Reichert,et al.  Investigating expressiveness and understandability of hierarchy in declarative business process models , 2015, Software & Systems Modeling.

[7]  Venkataraman Ramesh,et al.  Understanding Conceptual Schemas: Exploring the Role of Application and IS Domain Knowledge , 2006, Inf. Syst. Res..

[8]  I. Vernersson.  Open University Press , 2000 .

[9]  Yair Wand,et al.  Towards Understanding the Process of Process Modeling: Theoretical and Empirical Considerations , 2011, Business Process Management Workshops.

[10]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[11]  Abhishek Ranjan,et al.  An Empirical Study of Error Patterns in Industrial Business Process Models , 2014, IEEE Transactions on Services Computing.

[12]  Stefan Kühne,et al.  Business process modeling with continuous validation , 2010 .

[13]  Ralf Laue,et al.  A comparative survey of business process similarity measures , 2012, Comput. Ind..

[14]  Barbara Weber,et al.  Expressiveness and Understandability Considerations of Hierarchy in Declarative Business Process Models , 2015, BMMDS/EMMSAD.

[15]  M. Bassey.  Case study research in educational settings , 1999 .

[16]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[17]  Peter Rittgen.  Quality and perceived usefulness of process models , 2010, SAC '10.

[18]  Mark Strembeck,et al.  On the importance of flow direction in business process models , 2014, 2014 9th International Conference on Software Engineering and Applications (ICSOFT-EA).

[19]  Remco M. Dijkman,et al.  The ICoP Framework: Identification of Correspondences between Process Models , 2010, CAiSE.

[20]  John Krogstie.  Model-Based Development and Evolution of Information Systems: A Quality Approach , 2012 .

[21]  Mathias Weske,et al.  Efficient Consistency Measurement Based on Behavioral Profiles of Process Models , 2011, IEEE Transactions on Software Engineering.

[22]  Jan Mendling,et al.  Metrics for Process Models: Empirical Foundations of Verification, Error Prediction, and Guidelines for Correctness , 2008, Lecture Notes in Business Information Processing.

[23]  Jan Mendling.  Validation of Metrics as Error Predictors , 2008 .

[24]  Pnina Soffer,et al.  Complementing Business Process Verification by Validity Analysis: A Theoretical and Empirical Evaluation , 2011, J. Database Manag..

[25]  Jan Mendling,et al.  Seven process modeling guidelines (7PMG) , 2010, Inf. Softw. Technol..

[26]  Manfred Reichert,et al.  Refactoring large process model repositories , 2011, Comput. Ind..

[27]  Barbara Weber,et al.  Empirical Evaluation of Test Driven Modeling , 2013, Int. J. Inf. Syst. Model. Des..

[28]  Wineke A. M. van Lent,et al.  Similarity of business process models : metrics and evaluation , 2009 .

[29]  Jan Recker,et al.  Opportunities and constraints: the current struggle with BPMN , 2010, Bus. Process. Manag. J..

[30]  Jan Mendling,et al.  Assessing the Impact of Hierarchy on Model Understandability - A Cognitive Perspective , 2011, MoDELS.

[31]  Jan Mendling,et al.  A Study Into the Factors That Influence the Understandability of Business Process Models , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[32]  Juliet M. Corbin,et al.  Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory , 2008 .

[33]  Jörg Becker,et al.  Guidelines of Business Process Modeling , 2000, Business Process Management.

[34]  Michael Bassey,et al.  Case Study Research in Educational Settings. Doing Qualitative Research in Educational Settings. , 1999 .

[35]  Moe Thandar Wynn,et al.  Business process verification - finally a reality! , 2009, Bus. Process. Manag. J..

[36]  Mathias Weske,et al.  From fine-grained to abstract process models: A semantic approach , 2012, Inf. Syst..

[37]  Jan Mendling,et al.  The Impact of Secondary Notation on Process Model Understanding , 2009, PoEM.

[38]  Jan Mendling,et al.  Activity labeling in process modeling: Empirical insights and recommendations , 2010, Inf. Syst..

[39]  Wil M. P. van der Aalst,et al.  Transactions on Petri Nets and Other Models of Concurrency II, Special Issue on Concurrency in Process-Aware Information Systems , 2009, Trans. Petri Nets and Other Models of Concurrency.

[40]  J. Gosby.  MEDIA REVIEWS: Basics of Qualitative Research - Techniques and Procedures for Developing Grounded Theory 2nd Edition by A. Strauss and J. Corbin. Sage Publications, , 2000 .

[41]  Jakob Nielsen,et al.  Estimating the number of subjects needed for a thinking aloud test , 1994, Int. J. Hum. Comput. Stud..

[42]  August-Wilhelm Scheer,et al.  ARIS - Business Process Modeling , 1998 .

[43]  Jan Mendling,et al.  Empirical Studies in Process Model Verification , 2009, Trans. Petri Nets Other Model. Concurr..

[44]  N. Hoffart.  Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory , 2000 .