Recommendations for enhancing the usability and understandability of process mining in healthcare

Healthcare organizations are confronted with challenges including the contention between tightening budgets and increased care needs. In the light of these challenges, they are becoming increasingly aware of the need to improve their processes to ensure quality of care for patients. To identify process improvement opportunities, a thorough process analysis is required, which can be based on real-life process execution data captured by health information systems. Process mining is a research field that focuses on the development of techniques to extract process-related insights from process execution data, providing valuable and previously unknown information to instigate evidence-based process improvement in healthcare. However, despite the potential of process mining, its uptake in healthcare organizations outside case studies in a research context is rather limited. This observation was the starting point for an international brainstorm seminar. Based on the seminar's outcomes and with the ambition to stimulate a more widespread use of process mining in healthcare, this paper formulates recommendations to enhance the usability and understandability of process mining in healthcare. These recommendations are mainly targeted towards process mining researchers and the community to consider when developing a new research agenda for process mining in healthcare. Moreover, a limited number of recommendations are directed towards healthcare organizations and health information systems vendors, when shaping an environment to enable the continuous use of process mining.

[1]  Niels Martin,et al.  Data-Driven Process Simulation , 2019, Encyclopedia of Big Data Technologies.

[2]  Jihoon Kim,et al.  A multi-layered framework for disseminating knowledge for computer-based decision support , 2011, J. Am. Medical Informatics Assoc..

[3]  LeighAnne Olsen,et al.  The Learning Healthcare System , 2007 .

[4]  Mykola Pechenizkiy,et al.  Dealing With Concept Drifts in Process Mining , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Moe Thandar Wynn,et al.  Process Mining for Clinical Processes , 2015, ACM Trans. Manag. Inf. Syst..

[6]  Huilong Duan,et al.  On local anomaly detection and analysis for clinical pathways , 2015, Artif. Intell. Medicine.

[7]  Dursun Delen,et al.  Using predictive analytics to identify drug-resistant epilepsy patients , 2020, Health Informatics J..

[8]  Omolola Ogunyemi,et al.  GLIF3: the evolution of a guideline representation format , 2000, AMIA.

[9]  Jorge Munoz-Gama,et al.  Toward Value-Based Healthcare through Interactive Process Mining in Emergency Rooms: The Stroke Case , 2019, International journal of environmental research and public health.

[10]  Wil M. P. van der Aalst,et al.  Process Mining , 2016, Springer Berlin Heidelberg.

[11]  Ricardo Seguel,et al.  Process Mining Manifesto , 2011, Business Process Management Workshops.

[12]  Moe Thandar Wynn,et al.  Detection and Interactive Repair of Event Ordering Imperfection in Process Logs , 2018, CAiSE.

[13]  Natalia Iglesias,et al.  Comprehensive analysis of rule formalisms to represent clinical guidelines: Selection criteria and case study on antibiotic clinical guidelines , 2020, Artif. Intell. Medicine.

[14]  Michelle R. Hribar,et al.  Using electronic health record audit logs to study clinical activity: a systematic review of aims, measures, and methods , 2019, J. Am. Medical Informatics Assoc..

[15]  Claudio Di Ciccio,et al.  Knowledge-Intensive Processes: Characteristics, Requirements and Analysis of Contemporary Approaches , 2015, Journal on Data Semantics.

[16]  Hajo A. Reijers,et al.  Data-driven process discovery , 2017 .

[17]  Erik Perjons,et al.  An Introduction to Design Science , 2014, Springer International Publishing.

[18]  Daniel Forsberg,et al.  Analyzing PACS Usage Patterns by Means of Process Mining: Steps Toward a More Detailed Workflow Analysis in Radiology , 2015, Journal of Digital Imaging.

[19]  Daniel J. Vreeman,et al.  Logical Observation Identifiers Names and Codes (LOINC®) users' guide , 2010 .

[20]  Mojtaba Alizadeh,et al.  The application of internet of things in healthcare: a systematic literature review and classification , 2018, Universal Access in the Information Society.

[21]  Pamela Mazzocato,et al.  Lean thinking in healthcare: a realist review of the literature , 2010, Quality and Safety in Health Care.

[22]  David C. Hogg,et al.  The assessment of data quality issues for process mining in healthcare using Medical Information Mart for Intensive Care III, a freely available e-health record database , 2018, Health Informatics J..

[23]  John R. Venable,et al.  Identifying and Addressing Stakeholder Interests in Design Science Research: An Analysis Using Critical Systems Heuristics , 2009, CreativeSME.

[24]  Wil M. P. van der Aalst,et al.  DECLARE: Full Support for Loosely-Structured Processes , 2007, 11th IEEE International Enterprise Distributed Object Computing Conference (EDOC 2007).

[25]  Diogo R. Ferreira,et al.  Business process analysis in healthcare environments: A methodology based on process mining , 2012, Inf. Syst..

[26]  Niels Martin,et al.  Using Indoor Location System Data to Enhance the Quality of Healthcare Event Logs: Opportunities and Challenges , 2018, Business Process Management Workshops.

[27]  Marlon Dumas,et al.  Detecting Sudden and Gradual Drifts in Business Processes from Execution Traces , 2017, IEEE Transactions on Knowledge and Data Engineering.

[28]  V. Hasselblad,et al.  Effect of Clinical Decision-Support Systems , 2012, Annals of Internal Medicine.

[29]  Moe Thandar Wynn,et al.  ProcessProfiler3D: A visualisation framework for log-based process performance comparison , 2017, Decis. Support Syst..

[30]  Antonio D'Andreamatteo,et al.  Lean in healthcare: A comprehensive review. , 2015, Health policy.

[31]  Raghava Rao Mukkamala,et al.  Nested Dynamic Condition Response Graphs , 2011, FSEN.

[32]  S. Kaasa,et al.  Computer-Based Clinical Decision Support Systems and Patient-Reported Outcomes: A Systematic Review , 2015, The Patient - Patient-Centered Outcomes Research.

[33]  Ayca Tarhan,et al.  Systematic Mapping of Process Mining Studies in Healthcare , 2018, IEEE Access.

[34]  Shari J. Welch,et al.  Emergency department performance measures updates: proceedings of the 2014 emergency department benchmarking alliance consensus summit. , 2015, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[35]  Mor Peleg,et al.  Healthcare Process Support: Achievements, Challenges, Current Research , 2012 .

[36]  Marco Montali,et al.  Declarative Process Modeling in BPMN , 2015, CAiSE.

[37]  John Fox,et al.  Application of Information Technology: The Syntax and Semantics of the PROforma Guideline Modeling Language , 2003, J. Am. Medical Informatics Assoc..

[38]  Massimo Mecella,et al.  Automated Discovery of Process Models from Event Logs: Review and Benchmark , 2017, IEEE Transactions on Knowledge and Data Engineering.

[39]  Alessandro Sperduti,et al.  Business models enhancement through discovery of roles , 2013, 2013 IEEE Symposium on Computational Intelligence and Data Mining (CIDM).

[40]  Alberto Trombetta,et al.  BPMN: An introduction to the standard , 2012, Comput. Stand. Interfaces.

[41]  Jorge Munoz-Gama,et al.  Control-flow analysis of procedural skills competencies in medical training through process mining , 2019, Postgraduate Medical Journal.

[42]  Sooyoung Yoo,et al.  Discovery of Outpatient Care Process of a Tertiary University Hospital Using Process Mining , 2013, Healthcare informatics research.

[43]  Nophar Geifman,et al.  Mining post-surgical care processes in breast cancer patients , 2020, Artif. Intell. Medicine.

[44]  Frank Fox,et al.  A Data Quality Framework for Process Mining of Electronic Health Record Data , 2018, 2018 IEEE International Conference on Healthcare Informatics (ICHI).

[45]  Vicente Traver,et al.  Applying Evidence-Based Medicine in Telehealth: An Interactive Pattern Recognition Approximation , 2013, International journal of environmental research and public health.

[46]  Navjyot Hansi,et al.  Process mapping the patient journey: an introduction , 2010, BMJ : British Medical Journal.

[47]  Ernestina Menasalvas Ruiz,et al.  Reconstructing the patient's natural history from electronic health records , 2020, Artif. Intell. Medicine.

[48]  D. Blumenthal,et al.  Achieving a Nationwide Learning Health System , 2010, Science Translational Medicine.

[49]  Martin Matzner,et al.  Conformance checking: a state-of-the-art literature review , 2019, S-BPM ONE '19.

[50]  Yuval Shahar,et al.  The Asgaard project: a task-specific framework for the application and critiquing of time-oriented clinical guidelines , 1998, Artif. Intell. Medicine.

[51]  Roque Marín,et al.  Temporal similarity measures for querying clinical workflows , 2009, Artif. Intell. Medicine.

[52]  A. Detsky,et al.  Evidence-based medicine. A new approach to teaching the practice of medicine. , 1992, JAMA.

[53]  Hua Xu,et al.  A study of active learning methods for named entity recognition in clinical text , 2015, J. Biomed. Informatics.

[54]  Agusti Solanas,et al.  Process Mining in Healthcare: A Systematic Review , 2018, 2018 9th International Conference on Information, Intelligence, Systems and Applications (IISA).

[55]  Wil M. P. van der Aalst,et al.  Using Domain Knowledge to Enhance Process Mining Results , 2015, SIMPDA.

[56]  Bart Baesens,et al.  Getting a Grasp on Clinical Pathway Data: An Approach Based on Process Mining , 2012, PAKDD Workshops.

[57]  Hajo A. Reijers,et al.  Discovering Social Networks from Event Logs , 2005, Computer Supported Cooperative Work (CSCW).

[58]  Bart Baesens,et al.  A multi-dimensional quality assessment of state-of-the-art process discovery algorithms using real-life event logs , 2012, Inf. Syst..

[59]  Massimiliano de Leoni,et al.  Decision Discovery in Business Processes , 2019, Encyclopedia of Big Data Technologies.

[60]  Mor Peleg,et al.  Computer-interpretable clinical guidelines: A methodological review , 2013, J. Biomed. Informatics.

[61]  Ahmed Awad,et al.  Deducing Case IDs for Unlabeled Event Logs , 2015, Business Process Management Workshops.

[62]  Geert Poels,et al.  Towards a decision-aware declarative process modeling language for knowledge-intensive processes , 2017, Expert Syst. Appl..

[63]  John Fox,et al.  Comparing computer-interpretable guideline models: a case-study approach. , 2003, Journal of the American Medical Informatics Association : JAMIA.

[64]  Sander J. J. Leemans,et al.  PM ^2 : A Process Mining Project Methodology , 2015, CAiSE.

[65]  Gunnar Ellingsen,et al.  Infrastructuring in Healthcare through the OpenEHR Architecture , 2017, Computer Supported Cooperative Work (CSCW).

[66]  Jules White,et al.  Chapter One - Blockchain Technology Use Cases in Healthcare , 2018, Adv. Comput..

[67]  Mathias Weske,et al.  Repairing Event Logs Using Timed Process Models , 2013, OTM Workshops.

[68]  P. Vandervoort,et al.  Mobile Phone–Based Use of the Photoplethysmography Technique to Detect Atrial Fibrillation in Primary Care: Diagnostic Accuracy Study of the FibriCheck App , 2019, JMIR mHealth and uHealth.

[69]  Wil M. P. van der Aalst,et al.  Modeling Business Processes - A Petri Net-Oriented Approach , 2011, Cooperative Information Systems series.

[70]  Wil M. P. van der Aalst,et al.  Process-Aware Information System Development for the Healthcare Domain - Consistency, Reliability, and Effectiveness , 2009, Business Process Management Workshops.

[71]  Wil M. P. van der Aalst,et al.  Towards comprehensive support for organizational mining , 2008, Decis. Support Syst..

[72]  Tiago K. Colicchio,et al.  Unintended Consequences of Nationwide Electronic Health Record Adoption: Challenges and Opportunities in the Post-Meaningful Use Era , 2019, Journal of medical Internet research.

[73]  Johannes De Smedt,et al.  Fusion Miner: Process discovery for mixed-paradigm models , 2015, Decis. Support Syst..

[74]  Gert-Jan de Vries,et al.  Analysis and Optimization of a Sepsis Clinical Pathway Using Process Mining , 2019, Business Process Management Workshops.

[75]  Raghava Rao Mukkamala,et al.  Declarative Event-Based Workflow as Distributed Dynamic Condition Response Graphs , 2011, PLACES.

[76]  Mathias Weske,et al.  Bridging abstraction layers in process mining , 2014, Inf. Syst..

[77]  Mathias Weske,et al.  Discovering Stochastic Petri Nets with Arbitrary Delay Distributions from Event Logs , 2013, Business Process Management Workshops.

[78]  Owen A. Johnson,et al.  Process Mining in Cardiology: A Literature Review , 2018 .

[79]  Niels Peek,et al.  Process Mining in Primary Care: A Literature Review , 2018, MIE.

[80]  Minseok Song,et al.  Analysis of length of hospital stay using electronic health records: A statistical and data mining approach , 2018, PloS one.

[81]  Moe Thandar Wynn,et al.  A Framework for Cost-Aware Process Management: Cost Reporting and Cost Prediction , 2014, J. Univers. Comput. Sci..

[82]  Michiel van Genuchten,et al.  Mining processes in dentistry , 2012, IHI '12.

[83]  Wil M. P. van der Aalst,et al.  Process Mining Techniques: an Application to Stroke Care , 2008, MIE.

[84]  Ahmed Najjar,et al.  A two-step approach for mining patient treatment pathways in administrative healthcare databases , 2018, Artif. Intell. Medicine.

[85]  Owen Johnson,et al.  Process Mining in Frail Elderly Care: A Literature Review , 2019, HEALTHINF.

[86]  Sergio Tessaris,et al.  Completing Workflow Traces Using Action Languages , 2015, CAiSE.

[87]  Kathrin Figl.  Comprehension of Procedural Visual Business Process Models , 2017, Bus. Inf. Syst. Eng..

[88]  Silvana Quaglini,et al.  Improving structural medical process comparison by exploiting domain knowledge and mined information , 2014, Artif. Intell. Medicine.

[89]  Huilong Duan,et al.  On mining clinical pathway patterns from medical behaviors , 2012, Artif. Intell. Medicine.

[90]  Robert Andrews,et al.  Leveraging Data Quality to Better Prepare for Process Mining: An Approach Illustrated Through Analysing Road Trauma Pre-Hospital Retrieval and Transport Processes in Queensland , 2019, International journal of environmental research and public health.

[91]  Nick Goodwin,et al.  Understanding Integrated Care , 2016, International journal of integrated care.

[92]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[93]  Adam B. Wilcox,et al.  A Review of Predictive Analytics Solutions for Sepsis Patients , 2020, Applied Clinical Informatics.

[94]  Ezra Dessers,et al.  Instruments Measuring Integrated Care: A Systematic Review of Measurement Properties. , 2016, The Milbank quarterly.

[95]  Johan Gustav Bellika,et al.  The Learning Healthcare System: Where are we now? A systematic review , 2016, J. Biomed. Informatics.

[96]  Wil M. P. van der Aalst,et al.  Process Mining in Healthcare , 2020, Interactive Process Mining in Healthcare.

[97]  Andreas W Kempa-Liehr,et al.  Healthcare pathway discovery and probabilistic machine learning , 2020, Int. J. Medical Informatics.

[98]  Jorge Munoz-Gama,et al.  Process mining in healthcare: A literature review , 2016, J. Biomed. Informatics.

[99]  Jan Recker,et al.  Opportunities and constraints: the current struggle with BPMN , 2010, Bus. Process. Manag. J..

[100]  Mathias Weske,et al.  Blockchains for Business Process Management - Challenges and Opportunities , 2017, ACM Trans. Manag. Inf. Syst..

[101]  Moe Thandar Wynn,et al.  Mining Resource Profiles from Event Logs , 2017, ACM Trans. Manag. Inf. Syst..

[102]  Vicente Traver,et al.  Process Mining Methodology for Health Process Tracking Using Real-Time Indoor Location Systems , 2015, Sensors.

[103]  Owen Johnson,et al.  Process mining in oncology: A literature review , 2016, 2016 6th International Conference on Information Communication and Management (ICICM).

[104]  Sooyoung Yoo,et al.  Assessment of hospital processes using a process mining technique: Outpatient process analysis at a tertiary hospital , 2016, Int. J. Medical Informatics.

[105]  Andrea Burattin,et al.  Performance Analysis of Emergency Room Episodes Through Process Mining † , 2019, International journal of environmental research and public health.

[106]  Moe Thandar Wynn,et al.  Discovering work prioritisation patterns from event logs , 2017, Decis. Support Syst..

[107]  Boudewijn F. van Dongen,et al.  Discovering Social Networks Instantly: Moving Process Mining Computations to the Database and Data Entry Time , 2017, BPMDS/EMMSAD@CAiSE.

[108]  Mathias Weske,et al.  Embedding Conformance Checking in a Process Intelligence System in Hospital Environments , 2012, ProHealth/KR4HC.

[109]  J. M. Eklund,et al.  Blockchain Technology in Healthcare: A Systematic Review , 2019, Healthcare.

[110]  Moe T. Wynn,et al.  Directly Follows-Based Process Mining: Exploration & a Case Study , 2019, 2019 International Conference on Process Mining (ICPM).

[111]  Guilherme Del Fiol,et al.  Context-sensitive decision support (infobuttons) in electronic health records: a systematic review , 2017, J. Am. Medical Informatics Assoc..

[112]  Boudewijn F. van Dongen,et al.  Replaying history on process models for conformance checking and performance analysis , 2012, WIREs Data Mining Knowl. Discov..

[113]  Paola Mello,et al.  Conformance Checking of Executed Clinical Guidelines in Presence of Basic Medical Knowledge , 2011, Business Process Management Workshops.

[114]  Manfred Reichert,et al.  IT support for healthcare processes - premises, challenges, perspectives , 2007, Data Knowl. Eng..

[115]  Antonio Iera,et al.  The Internet of Things: A survey , 2010, Comput. Networks.

[116]  Nicholas R. Hardiker,et al.  The use of computerized clinical decision support systems in emergency care: a substantive review of the literature , 2017, J. Am. Medical Informatics Assoc..

[117]  Kris Braekers,et al.  Quality of input data in emergency department simulations: Framework and assessment techniques , 2019, Simul. Model. Pract. Theory.

[118]  Adaline C. Hayden,et al.  Classification of Diseases , 1896, The Dental register.

[119]  Jan Martijn E. M. van der Werf,et al.  Process Diagnostics: A Method Based on Process Mining , 2009, 2009 International Conference on Information, Process, and Knowledge Management.

[120]  Oscar González Rojas,et al.  Automated Discovery of Business Process Simulation Models from Event Logs , 2020, Decis. Support Syst..

[121]  Camille Salinesi,et al.  Process models of interrelated speech intentions from online health-related conversations , 2018, Artif. Intell. Medicine.

[122]  J. Cramm,et al.  Healthcare professionals’ views on patient-centered care in hospitals , 2015, BMC Health Services Research.

[123]  Mathias Weske,et al.  The Internet-of-Things Meets Business Process Management: Mutual Benefits and Challenges , 2017, ArXiv.

[124]  Niels Martin,et al.  The Use of Process Mining in Business Process Simulation Model Construction , 2016, Bus. Inf. Syst. Eng..

[125]  Arthur H. M. ter Hofstede,et al.  Improving Patient Flows at St. Andrew's War Memorial Hospital's Emergency Department Through Process Mining , 2018, Business Process Management Cases.

[126]  Wil M. P. van der Aalst,et al.  Enabling Interactive Process Analysis with Process Mining and Visual Analytics , 2017, HEALTHINF.

[127]  Wil M. P. van der Aalst,et al.  ProDiGy : Human-in-the-loop process discovery , 2018, 2018 12th International Conference on Research Challenges in Information Science (RCIS).

[128]  Jorge Munoz-Gama,et al.  Question-Driven Methodology for Analyzing Emergency Room Processes Using Process Mining , 2017 .

[129]  Kris Braekers,et al.  Simulation of emergency department operations: A comprehensive review of KPIs and operational improvements , 2019, Comput. Ind. Eng..

[130]  Bart Baesens,et al.  A Process Mining-Based Investigation of Adverse Events in Care Processes , 2014, Health information management : journal of the Health Information Management Association of Australia.

[131]  Antoine Piau,et al.  A smartphone Chatbot application to optimize monitoring of older patients with cancer , 2019, Int. J. Medical Informatics.

[132]  Marjan Hericko,et al.  Business process model and notation: The current state of affairs , 2015, Comput. Sci. Inf. Syst..

[133]  Geert Poels,et al.  Discovering health-care processes using DeciClareMiner , 2018, Health systems.

[134]  Orlenys López-Pintado,et al.  Extracting Event Logs for Process Mining from Data Stored on the Blockchain , 2019, Business Process Management Workshops.

[135]  Andreas Solti,et al.  Event Log Cleaning for Business Process Analytics , 2019, Encyclopedia of Big Data Technologies.

[136]  Gordon H Guyatt,et al.  Progress in evidence-based medicine: a quarter century on , 2017, The Lancet.

[137]  Moe Thandar Wynn,et al.  Event log imperfection patterns for process mining: Towards a systematic approach to cleaning event logs , 2017, Inf. Syst..

[138]  Shari J. Welch,et al.  Emergency department performance measures and benchmarking summit. , 2006, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[139]  Farhaan Mirza,et al.  A review on IoT healthcare monitoring applications and a vision for transforming sensor data into real-time clinical feedback , 2017, 2017 IEEE 21st International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[140]  Wil M. P. van der Aalst,et al.  Process Aware Information Systems: Bridging People and Software Through Process Technology , 2005 .

[141]  Adler J. Perotte,et al.  Risk prediction for chronic kidney disease progression using heterogeneous electronic health record data and time series analysis , 2015, J. Am. Medical Informatics Assoc..

[142]  Antonio Martinez-Millana,et al.  Interactive Data Cleaning for Process Mining: A Case Study of an Outpatient Clinic's Appointment System , 2019, Business Process Management Workshops.

[143]  Ekkart Kindler,et al.  On the declarative paradigm in hybrid business process representations: A conceptual framework and a systematic literature study , 2020, Inf. Syst..