An Experiment on Process Model Understandability Using Textual Work Instructions and BPMN Models

It is widely accepted that presenting data in the form of pictures or models can enhance comprehension, decision making and communication of the underlying information. However, there are few systematic studies that examine whether graphical models are more effective than other representation (such as textual descriptions). Process models provide an abstract graphical view of organizational procedures by reducing the complex reality of the work performed by a company to its most important activities. Such models are useful to train new employees, to document and allow improving organizational procedures and policies. This paper describes an experiment to address if there are significant differences in terms of process understand ability depending on whether textual work instructions or process models are used to represent a business process. We compared a control group of subjects that received textual work instructions to a second group, which received process models, in terms of their ability to understand the process. We found empirical support that using textual work instructions or process models do not influence process understand ability for non-expert users but do influence for experienced users.

[1]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[2]  Mark Strembeck,et al.  Factors of process model comprehension - Findings from a series of experiments , 2012, Decis. Support Syst..

[3]  Wolff-Michael Roth,et al.  When Are Graphs Worth Ten Thousand Words? An Expert-Expert Study , 2003 .

[4]  Jan Recker,et al.  Scientific Research in Information Systems - A Beginner's Guide , 2012, Progress in IS.

[5]  Ralf Laue,et al.  Cognitive Complexity in Business Process Modeling , 2011, CAiSE.

[6]  Mark von Rosing,et al.  Business Process Model and Notation - BPMN , 2015, The Complete Business Process Handbook, Vol. I.

[7]  Melanie Tory,et al.  Human factors in visualization research , 2004, IEEE Transactions on Visualization and Computer Graphics.

[8]  Bill Curtis,et al.  Experimental evaluation of software documentation formats , 1989, J. Syst. Softw..

[9]  Mn DipN Cert Ed Rgn Scm and Janice Rattray PhD Essential elements of questionnaire design and development , 2007 .

[10]  Michael Busch,et al.  Using Likert Scales in L2 Research A Researcher Comments , 1993 .

[11]  F. Paas,et al.  Cognitive Load Theory and Instructional Design: Recent Developments , 2003 .

[12]  T.T.G.P. van der Molen Maintaining consistency between business process diagrams and textual documentation using the EPSILON model management platform , 2011 .

[13]  William J. Kettinger,et al.  Business Process Change: A Study of Methodologies, Techniques, and Tools , 1997, MIS Q..

[14]  Jörg Becker,et al.  Guidelines of Business Process Modeling , 2000, Business Process Management.

[15]  Stergios B. Fotopoulos,et al.  Introduction to Modern Nonparametric Statistics , 2004, Technometrics.

[16]  Mario Piattini,et al.  Analysis and Validation of Control-Flow Complexity Measures with BPMN Process Models , 2009, BMMDS/EMMSAD.

[17]  Eng Wah Lee,et al.  Business process management (BPM) standards: a survey , 2009, Bus. Process. Manag. J..

[18]  Jan Mendling,et al.  Activity labeling in process modeling: Empirical insights and recommendations , 2010, Inf. Syst..

[19]  Raj M Ratwani,et al.  Thinking graphically: Connecting vision and cognition during graph comprehension. , 2008, Journal of experimental psychology. Applied.

[20]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[21]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[22]  John Quackenbush,et al.  Genesis: cluster analysis of microarray data , 2002, Bioinform..

[23]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[24]  Jan Mendling,et al.  Generating Natural Language Texts from Business Process Models , 2012, CAiSE.

[25]  Volker Gruhn,et al.  What business process modelers can learn from programmers , 2007, Sci. Comput. Program..

[26]  George Karypis,et al.  A Comparison of Document Clustering Techniques , 2000 .

[27]  Stefan Zugal,et al.  Investigating Differences between Graphical and Textual Declarative Process Models , 2014, CAiSE Workshops.

[28]  Barbara Weber,et al.  Assessing Process Models with Cognitive Psychology , 2011, EMISA.

[29]  Jan Mendling,et al.  What Makes Process Models Understandable? , 2007, BPM.

[30]  Keng Siau,et al.  Informational and Computational Equivalence in Comparing Information Modeling Methods , 2004, J. Database Manag..

[31]  B. Wansink,et al.  Asking Questions: The Definitive Guide to Questionnaire Design -- For Market Research, Political Polls, and Social and Health Questionnaires , 2004 .

[32]  Craig Larman,et al.  Applying UML and Patterns: An Introduction to Object-Oriented Analysis and Design and Iterative Development (3rd Edition) , 1997 .

[33]  Craig Larman,et al.  "Applying UML and Patterns: An Introduction to Object-Oriented Analysis and Design and Iterative Development”, Third Edition, Pearson Education, 2005. , 2015 .

[34]  Jan Mendling,et al.  Making sense of business process descriptions: An experimental comparison of graphical and textual notations , 2012, J. Syst. Softw..

[35]  William Winn,et al.  Chapter 1 Contributions of Perceptual and Cognitive Processes to the Comprehension of Graphics , 1994 .

[36]  Jan Mendling,et al.  Empirical Studies in Process Model Verification , 2009, Trans. Petri Nets Other Model. Concurr..

[37]  M A Sinclair,et al.  Questionnaire design. , 1975, Applied ergonomics.

[38]  Ben Shneiderman,et al.  Experimental investigations of the utility of detailed flowcharts in programming , 1977, CACM.

[39]  Jan Mendling,et al.  Supporting Process Model Validation through Natural Language Generation , 2014, IEEE Transactions on Software Engineering.

[40]  Jan Mendling,et al.  Seven process modeling guidelines (7PMG) , 2010, Inf. Softw. Technol..

[41]  Harold D. Delaney,et al.  The Kruskal-Wallis Test and Stochastic Homogeneity , 1998 .

[42]  John F. Sowa,et al.  Knowledge representation: logical, philosophical, and computational foundations , 2000 .