Conformance Testing: Measuring the Fit and Appropriateness of Event Logs and Process Models

Most information systems log events (e.g., transaction logs, audit trails) to audit and monitor the processes they support. At the same time, many of these processes have been explicitly modeled. For example, SAP R/3 logs events in transaction logs and there are EPCs (Event-driven Process Chains) describing the so-called reference models. These reference models describe how the system should be used. The coexistence of event logs and process models raises an interesting question: “Does the event log conform to the process model and vice versa?”. This paper demonstrates that there is not a simple answer to this question. To tackle the problem, we distinguish two dimensions of conformance: fitness (the event log may be the result of the process modeled) and appropriateness (the model is a likely candidate from a structural and behavioral point of view). Different metrics have been defined and a Conformance Checker has been implemented within the ProM Framework.

[1]  Wil M. P. van der Aalst,et al.  Rediscovering workflow models from event-based data using little thumb , 2003, Integr. Comput. Aided Eng..

[2]  Wil M. P. van der Aalst,et al.  Genetic Process Mining: A Basic Approach and Its Challenges , 2005, Business Process Management Workshops.

[3]  van der Wmp Wil Aalst,et al.  Conformance testing : measuring the alignment between event logs and process models , 2005 .

[4]  August-Wilhelm Scheer,et al.  ARIS - Business Process Modeling , 1998 .

[5]  T. Davenport,et al.  Improving Knowledge Work Processes , 1996 .

[6]  Fabio Casati,et al.  Business Process Intelligence , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[7]  Wil M. P. van der Aalst,et al.  Workflow mining: discovering process models from event logs , 2004, IEEE Transactions on Knowledge and Data Engineering.

[8]  Oliver Thomas,et al.  Fuzzy-Ereignisgesteuerte Prozessketten - Geschäftsprozessmodellierung unter Berücksichtigung unscharfer Daten , 2002, EPK.

[9]  C. Petri.  Kommunikation mit Automaten , 1962 .

[10]  Stefanie Rinderle-Ma,et al.  First International Workshop on Business Process Intelligence (bpi'05) Publication and Coordination Chair Bpi'05 Business Process Intelligence Third International Conference on Business Process Management Organization Executive Committee Program Committee Conformance Testing: Measuring the Fit and A , 2022 .

[11]  Fabio Casati,et al.  Improving Business Process Quality through Exception Understanding, Prediction, and Prevention , 2001, VLDB.

[12]  Myra Spiliopoulou,et al.  A Framework for the Evaluation of Session Reconstruction Heuristics in Web-Usage Analysis , 2003, INFORMS J. Comput..

[13]  Wolfgang Reisig,et al.  Lectures on Concurrency and Petri Nets , 2003, Lecture Notes in Computer Science.

[14]  Paulo F. Pires,et al.  Monitoring e-business Web services usage through a log based architecture , 2004 .

[15]  Boudewijn F. van Dongen,et al.  Workflow mining: A survey of issues and approaches , 2003, Data Knowl. Eng..

[16]  Wil M. P. van der Aalst,et al.  Business alignment: using process mining as a tool for Delta analysis and conformance testing , 2005, Requirements Engineering.

[17]  van der Wmp Wil Aalst,et al.  Using genetic algorithms to mine process models : representation, operators and results , 2004 .

[18]  Wil M. P. van der Aalst,et al.  Mining Social Networks: Uncovering Interaction Patterns in Business Processes , 2004, Business Process Management.

[19]  Kees M. van Hee,et al.  Workflow Management: Models, Methods, and Systems , 2002, Cooperative information systems.

[20]  Wil M. P. van der Aalst,et al.  Verification Of Workflow Task Structures: A Petri-net-baset Approach , 2000, Inf. Syst..

[21]  Jonathan E. Cook,et al.  Measuring behavioral correspondence to a timed concurrent model , 2001, Proceedings IEEE International Conference on Software Maintenance. ICSM 2001.

[22]  James A. Hall,et al.  The Sarbanes-Oxley Act: Implications for large-scale IT outsourcing , 2007, Commun. ACM.

[23]  Rudolf Kruse.  Fuzzy-Systeme – Positive Aspekte der Unvollkommenheit , 1996, Informatik-Spektrum.

[24]  Michael Rosemann,et al.  Workflow-based process monitoring and controlling-technical and organizational issues , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.

[25]  Peter P. Chen.  The entity-relationship model: toward a unified view of data , 1975, VLDB '75.

[26]  Alexander L. Wolf,et al.  Discovering models of software processes from event-based data , 1998, TSEM.

[27]  A. Scheer.  Business Process Engineering: Reference Models for Industrial Enterprises , 1994 .

[28]  Schahram Dustdar,et al.  Towards Web Services Interaction Mining Architecture for e-commerce applications analysis , 2005 .

[29]  Wil M. P. van der Aalst,et al.  Process mining: a research agenda , 2004, Comput. Ind..

[30]  Joachim Herbst,et al.  A Machine Learning Approach to Workflow Management , 2000, ECML.

[31]  Thomas Teufel,et al.  Sap R/3 Process Oriented Implementation , 1998 .

[32]  Richard Bellman,et al.  Decision-making in fuzzy environment , 2012 .

[33]  Oliver Thomas,et al.  Gestaltung und Steuerung wissensintensiver Geschäftsprozesse durch die Nutzung unscharfen Wissens , 2003, Wissensmanagement.

[34]  Dimitrios Gunopulos,et al.  Mining Process Models from Workflow Logs , 1998, EDBT.

[35]  Wil M. P. van der Aalst,et al.  Process Mining and Security: Detecting Anomalous Process Executions and Checking Process Conformance , 2005, WISP@ICATPN.

[36]  Alexander L. Wolf,et al.  Software process validation: quantitatively measuring the correspondence of a process to a model , 1999, TSEM.

[37]  Luigi Pontieri,et al.  Mining Expressive Process Models by Clustering Workflow Traces , 2004, PAKDD.

[38]  Heinrich Rommelfanger,et al.  Fuzzy-Logik basierte Verarbeitung von Expertenregeln , 1993 .

[39]  August-Wilhelm Scheer.  ARIS-Toolset: Von Forschungs-Prototypen zum Produkt , 1996, Informatik-Spektrum.

[40]  Philip S. Yu,et al.  SpeedTracer: A Web Usage Mining and Analysis Tool , 1998, IBM Syst. J..

[41]  W. Starbuck.  Learning by Knowledge-Intensive Firms , 1992 .