Conformance checking: a state-of-the-art literature review

Conformance checking is a set of process mining functions that compare process instances with a given process model. It identifies deviations between the process instances' actual behaviour ("as-is") and its modelled behaviour ("to-be"). Especially in the context of analyzing compliance in organizations, it is currently gaining momentum - e.g. for auditors. Researchers have proposed a variety of conformance checking techniques that are geared towards certain process model notations or specific applications such as process model evaluation. This article reviews a set of conformance checking techniques described in 37 scholarly publications. It classifies the techniques along the dimensions "modelling language", "algorithm type", "quality metric", and "perspective" using a concept matrix so that the techniques can be better accessed by practitioners and researchers. The matrix highlights the dimensions where extant research concentrates and where blind spots exist. For instance, process miners use declarative process modelling languages often, but applications in conformance checking are rare. Likewise, process mining can investigate process roles or process metrics such as duration, but conformance checking techniques narrow on analyzing control-flow. Future research may construct techniques that support these neglected approaches to conformance checking.

[1]  Boudewijn F. van Dongen,et al.  Alignment Based Precision Checking , 2012, Business Process Management Workshops.

[2]  Irene Barba,et al.  Conformance checking and diagnosis for declarative business process models in data-aware scenarios , 2014, Expert Syst. Appl..

[3]  Josep Carmona,et al.  Conformance Checking - Relating Processes and Models , 2018 .

[4]  Massimiliano de Leoni,et al.  Aligning Real Process Executions and Prescriptive Process Models through Automated Planning , 2017, Expert Syst. Appl..

[5]  Boudewijn F. van Dongen,et al.  Maximizing Synchronization for Aligning Observed and Modelled Behaviour , 2018, BPM.

[6]  Wil M. P. van der Aalst,et al.  Decomposed Process Mining: The ILP Case , 2014, Business Process Management Workshops.

[7]  Dirk Fahland,et al.  Conformance Checking Based on Partially Ordered Event Data , 2014, Business Process Management Workshops.

[8]  van der Wmp Wil Aalst,et al.  Memory-efficient alignment of observed and modeled behavior , 2013 .

[9]  Boudewijn F. van Dongen,et al.  Conformance Checking Using Cost-Based Fitness Analysis , 2011, 2011 IEEE 15th International Enterprise Distributed Object Computing Conference.

[10]  Marwane El Kharbili,et al.  Business Process Compliance Checking: Current State and Future Challenges , 2008, MobIS.

[11]  Bart Baesens,et al.  Determining Process Model Precision and Generalization with Weighted Artificial Negative Events , 2014, IEEE Transactions on Knowledge and Data Engineering.

[12]  Boudewijn F. van Dongen,et al.  Measuring precision of modeled behavior , 2015, Inf. Syst. E Bus. Manag..

[13]  Sander J. J. Leemans,et al.  Scalable process discovery and conformance checking , 2016, Software & Systems Modeling.

[14]  Wil M. P. van der Aalst,et al.  Process Mining - Discovery, Conformance and Enhancement of Business Processes , 2011 .

[15]  Wil M. P. van der Aalst,et al.  Aligning Event Logs and Process Models for Multi-perspective Conformance Checking: An Approach Based on Integer Linear Programming , 2013, BPM.

[16]  Alessandro Sperduti,et al.  Conformance checking based on multi-perspective declarative process models , 2015, Expert Syst. Appl..

[17]  Chitu Okoli,et al.  A Guide to Conducting a Systematic Literature Review of Information Systems Research , 2010 .

[18]  Jorge Munoz-Gama,et al.  Process mining in healthcare: A literature review , 2016, J. Biomed. Informatics.

[19]  Marta Indulska,et al.  Business Process Modeling- A Comparative Analysis , 2009, J. Assoc. Inf. Syst..

[20]  Wil M. P. van der Aalst,et al.  Conformance checking of service behavior , 2008, TOIT.

[21]  Niels Peek,et al.  Process Mining in Primary Care: A Literature Review , 2018, MIE.

[22]  Wil M. P. van der Aalst,et al.  Trace Alignment in Process Mining: Opportunities for Process Diagnostics , 2010, BPM.

[23]  Marlon Dumas,et al.  Complete and Interpretable Conformance Checking of Business Processes , 2018, IEEE Transactions on Software Engineering.

[24]  Richard T. Watson,et al.  Analyzing the Past to Prepare for the Future: Writing a Literature Review , 2002, MIS Q..

[25]  Stefan Jablonski,et al.  Comparing Declarative Process Modelling Languages from the Organisational Perspective , 2015, Business Process Management Workshops.

[26]  Wil M. P. van der Aalst,et al.  Conformance Checking in the Large: Partitioning and Topology , 2013, BPM.

[27]  Wil M. P. van der Aalst,et al.  Aligning Event Logs and Declarative Process Models for Conformance Checking , 2012, BPM.

[28]  Wil M. P. van der Aalst,et al.  Service Mining: Using Process Mining to Discover, Check, and Improve Service Behavior , 2013, IEEE Transactions on Services Computing.

[29]  Wil M. P. van der Aalst,et al.  An alignment-based framework to check the conformance of declarative process models and to preprocess event-log data , 2015, Inf. Syst..

[30]  Wil M. P. van der Aalst,et al.  Process diagnostics using trace alignment: Opportunities, issues, and challenges , 2012, Inf. Syst..

[31]  Josep Carmona,et al.  A Framework for Online Conformance Checking , 2017, Business Process Management Workshops.

[32]  Wil M. P. van der Aalst,et al.  Decomposing Petri nets for process mining: A generic approach , 2013, Distributed and Parallel Databases.

[33]  Wil M. P. van der Aalst,et al.  Recomposing conformance: Closing the circle on decomposed alignment-based conformance checking in process mining , 2018, Inf. Sci..

[34]  Wil M. P. van der Aalst,et al.  Conformance checking of processes based on monitoring real behavior , 2008, Inf. Syst..

[35]  Boudewijn F. van Dongen Efficiently Computing Alignments - Using the Extended Marking Equation , 2018, BPM.

[36]  Andreas Solti,et al.  Automatic Root Cause Identification Using Most Probable Alignments , 2017, Business Process Management Workshops.

[37]  Irina A. Lomazova,et al.  Process mining using BPMN: relating event logs and process models , 2016, MODELS 2016.

[38]  Alistair A. Young,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2017, MICCAI 2017.

[39]  Luigi Pontieri,et al.  Discovering expressive process models by clustering log traces , 2006, IEEE Transactions on Knowledge and Data Engineering.

[40]  Hajo A. Reijers,et al.  Balanced multi-perspective checking of process conformance , 2016, Computing.

[41]  Dirk Fahland,et al.  Linking data and process perspectives for conformance analysis , 2018, Comput. Secur..

[42]  Manfred Reichert,et al.  Understanding Declare models: strategies, pitfalls, empirical results , 2016, Software & Systems Modeling.

[43]  Boudewijn F. van Dongen,et al.  Data- and Resource-Aware Conformance Checking of Business Processes , 2012, BIS.

[44]  Pengcheng Zhang,et al.  Efficient Alignment Between Event Logs and Process Models , 2017, IEEE Transactions on Services Computing.

[45]  Dirk Fahland,et al.  Model repair - aligning process models to reality , 2015, Inf. Syst..

[46]  Mathias Weske,et al.  Embedding Conformance Checking in a Process Intelligence System in Hospital Environments , 2012, ProHealth/KR4HC.

[47]  Josep Carmona,et al.  Online Conformance Checking Using Behavioural Patterns , 2018, BPM.

[48]  Wil M. P. van der Aalst,et al.  Single-Entry Single-Exit decomposed conformance checking , 2014, Inf. Syst..

[49]  Wil M. P. van der Aalst,et al.  Process Discovery and Conformance Checking Using Passages , 2014, Fundam. Informaticae.

[50]  Owen Johnson,et al.  Process mining in oncology: A literature review , 2016, 2016 6th International Conference on Information Communication and Management (ICICM).

[51]  A Anne Rozinat,et al.  Process mining : conformance and extension , 2010 .

[52]  Wil M. P. van der Aalst,et al.  Process mining using BPMN: relating event logs and process models , 2015, Software & Systems Modeling.

[53]  Wil M.P. van der Aalst Process Mining: Overview and Opportunities , 2012, TMIS.