A process-oriented methodology for evaluating the impact of IT: A proposal and an application in healthcare

In order to improve the performance of business processes often Information Technologies (ITs) are introduced. However, business processes are known to be complex and distributed among multiple business entities. As a result, the impact of new IT on an entire business process is typically hard to assess as quantitative methods for evaluation are missing. Therefore, in this paper, we propose a process-oriented methodology for evaluating the impact of IT on a business process ahead of its implementation. In our method, process mining and discrete event simulation are key ingredients. Based on automatically stored data, process mining allows for obtaining detailed knowledge on a business process, e.g., it can be discovered how a business process is actually executed. Using discrete event simulation, a model can be built which accurately mimicks the discovered process and which can subsequently be used for exploring and evaluating various redesign of the same process. Our method is evaluated by means of a detailed case study. For a complex dental process, it turns out that the introduction of new digital technologies is largely beneficial for patients and dental lab owners, whereas for dentists there is hardly any benefit.

[1]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[2]  A. Mehta Smart modeling-basic methodology and advanced tools , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[3]  Song,et al.  Supporting proces mining by showing events at a glance , 2007 .

[4]  Sheldon Howard Jacobson,et al.  Application of discrete-event simulation in health care clinics: A survey , 1999, J. Oper. Res. Soc..

[5]  Hans-Ulrich Prokosch,et al.  Visions and strategies to improve evaluation of health information systems: Reflections and lessons based on the HIS-EVAL workshop in Innsbruck , 2004, Int. J. Medical Informatics.

[6]  Rudy Hirschheim,et al.  Analysing information systems evaluation: another look at an old problem , 1998 .

[7]  Arvind Mehta Smart modeling: smart modeling - basic methodology and advanced tools , 2000, WSC '00.

[8]  Gianfranco Ciardo,et al.  Applications and Theory of Petri Nets 2005, 26th International Conference, ICATPN 2005, Miami, USA, June 20-25, 2005, Proceedings , 2005, ICATPN.

[9]  Jan Martijn E. M. van der Werf,et al.  Process Diagnostics: A Method Based on Process Mining , 2009, 2009 International Conference on Information, Process, and Knowledge Management.

[10]  Stephen D. Roberts,et al.  Applications of computer simulation in health care , 1978, WSC '78.

[11]  Wil M. P. van der Aalst,et al.  Process Mining - Discovery, Conformance and Enhancement of Business Processes , 2011 .

[12]  Yijin Ren,et al.  Application of Intra-Oral Dental Scanners in the Digital Workflow of Implantology , 2012, PloS one.

[13]  Lee W. Schruben,et al.  Simulation modeling for analysis , 2010, TOMC.

[14]  A. Benalouane,et al.  Digital dentistry: promise, reality and the role of software standards , 2011 .

[15]  Walter Fernandez,et al.  Success in IT projects: A matter of definition? , 2008 .

[16]  J. D. Johannes,et al.  Systems Simulation: The Art and Science , 1975, IEEE Transactions on Systems, Man, and Cybernetics.

[17]  Kees M. van Hee,et al.  Workflow Management: Models, Methods, and Systems , 2002, Cooperative information systems.

[18]  Lars Michael Kristensen,et al.  Coloured Petri Nets and CPN Tools for modelling and validation of concurrent systems , 2007, International Journal on Software Tools for Technology Transfer.

[19]  H. Reijers,et al.  Patients' preferences when comparing analogue implant impressions using a polyether impression material versus digital impressions (Intraoral Scan) of dental implants. , 2014, Clinical oral implants research.

[20]  Hussein Abdel-Wahab,et al.  Proceedings of the Joint Conference on Information Sciences , 1998 .

[21]  MansRonny,et al.  A process-oriented methodology for evaluating the impact of IT , 2013 .

[22]  German O Gallucci,et al.  Computer-aided design and computer-assisted manufacturing in prosthetic implant dentistry. , 2009, The International journal of oral & maxillofacial implants.

[23]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[24]  Boudewijn F. van Dongen,et al.  The ProM Framework: A New Era in Process Mining Tool Support , 2005, ICATPN.

[25]  Wil M. P. van der Aalst,et al.  Discovering simulation models , 2009, Inf. Syst..

[26]  Mh Monique Jansen-Vullers,et al.  Business process simulation - tool survey , 2006 .

[27]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[28]  Selwyn Piramuthu,et al.  Framework, strategy and evaluation of health care processes with RFID , 2010, Decis. Support Syst..

[29]  Daniel Wismeijer,et al.  Computer technology applications in surgical implant dentistry: a systematic review. , 2014, The International journal of oral & maxillofacial implants.

[30]  Kristen Nygaard,et al.  SIMULA: an ALGOL-based simulation language , 1966, CACM.

[31]  Randall P. Sadowski,et al.  Simulation with Arena , 1998 .

[32]  Boudewijn F. van Dongen,et al.  Business process mining: An industrial application , 2007, Inf. Syst..

[33]  Averill Law Simulation Modeling and Analysis with Expertfit Software , 2006 .

[34]  Rajiv Kohli,et al.  Performance Impacts of Information Technology: Is Actual Usage the Missing Link? , 2003, Manag. Sci..

[35]  Diogo R. Ferreira,et al.  Business process analysis in healthcare environments: A methodology based on process mining , 2012, Inf. Syst..

[36]  J. Banks,et al.  Discrete-Event System Simulation , 1995 .

[37]  Albert H. Segars,et al.  Information systems effectiveness: The construct space and patters of application , 1996, Inf. Manag..

[38]  Anastasia Papazafeiropoulou,et al.  Investigating evaluation frameworks for health information systems , 2008, Int. J. Medical Informatics.

[39]  Edmond P. Fitzgerald,et al.  Understanding “IS business value”: derivation of dimensions , 1999 .

[40]  Govindan Marthandan,et al.  Information systems evaluation: an ongoing measure , 2010, Int. J. Bus. Inf. Syst..

[41]  D. Sandy Staples,et al.  Dimensions of Information Systems Success , 1999, Commun. Assoc. Inf. Syst..