Multi-method System Simulation Analysis as an Implementation and Evaluation Tool for Computerised Pathology Order Entry Systems

Background: Computerised Physician Order Entry (CPOE) systems have the potential to lead to improvements in the quality and efficiency of health care delivery. However, CPOE systems have been found to be difficult and complex to implement and there has been an increased awareness of the need for rigorous evaluation techniques. To date pathology CPOE systems have not been widely researched or evaluated. System Simulation (SysSim) is the application of computer simulation to explore, understand and improve the interaction between structure and action in the health care sector. Objectives: This paper describes the methods for designing a robust SysSim model and illustrates how it will be used to examine the impact of CPOE on care delivery and outcomes. Methods: The model development will use integrated simulation methods that incorporate both agent and system dynamic approaches using the Anylogic object-oriented, Java-based software package. The model will be built using a comprehensive, iterative approach incorporating testing and refinement stages that include: conceptual development and construction; model calibration; simulation and policy testing; and performance experimentation. Results: Our review of the literature identified 10 domains which have been the focus of evaluations of the impact CPOE on pathology services and these have used 39 different indicators. The problem however is that the information contained in individual indicators is usually resented in isolation from other important indicator data. Discussion and conclusions: SysSim allows us to link up data and information and demonstrates how indicators interact and as such provides a powerful evaluation technique. SysSim makes it possible to take a holistic view to evaluation and implementation priorities, based on the understanding that many things are connected to each other. It has the potential to improve planning in complex healthcare environments and to a) investigate the impact of pathology CPOE systems; b) develop methods to increase their uptake and efficiency; and c) evaluate possible response scenarios for dealing with the challenges of implementation.

[1]  D. Bates,et al.  Computerized physician order entry systems in hospitals: mandates and incentives. , 2002, Health affairs.

[2]  Robert L. Wears,et al.  Response to commentaries on Koppel et al , 2005, J. Biomed. Informatics.

[3]  Y. Han,et al.  Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System , 2005, Pediatrics.

[4]  Margaret Williamson,et al.  The impact of computerised physician order entry systems on pathology services: A systematic review , 2007, Int. J. Medical Informatics.

[5]  M. Humber National programme for information technology , 2004, BMJ : British Medical Journal.

[6]  Hans-Ulrich Prokosch,et al.  Visions and strategies to improve evaluation of health information systems: Reflections and lessons based on the HIS-EVAL workshop in Innsbruck , 2004, Int. J. Medical Informatics.

[7]  William W. Stead,et al.  Review: Computer-based Physician Order Entry: The State of the Art , 1994, J. Am. Medical Informatics Assoc..

[8]  Glen Geiger,et al.  Methodology for evaluating physician order entry (POE) implementations. , 2003, Journal of evaluation in clinical practice.

[9]  David W Bates,et al.  Will electronic order entry reduce health care costs? , 2002, Effective clinical practice : ECP.

[10]  Davis Ej,et al.  Planning and managing computerized order entry: a case study of IT-enabled organizational transformation. , 1999 .

[11]  Anne Moen,et al.  Introducing a Module for Laboratory Test Order Entry and Reporting of Results at a Hospital Ward: An Evaluation Study Using a Multi-Method Approach , 1997, Journal of Medical Systems.

[12]  David W. Bates,et al.  Position Paper: Factors and Forces Affecting EHR System Adoption: Report of a 2004 ACMI Discussion , 2004, J. Am. Medical Informatics Assoc..

[13]  Hagop S. Mekhjian,et al.  Immediate benefits realized following implementation of physician order entry at an academic medical center. , 2002, Journal of the American Medical Informatics Association : JAMIA.

[14]  W S Smellie,et al.  Method for assessment of laboratory turnaround times: comparison before, during, and after analysis. , 1994, Journal of clinical pathology.

[15]  J. Sterman Learning from evidence in a complex world. , 2006, American journal of public health.

[16]  M Galloway,et al.  Benchmarking and the laboratory , 2001, Journal of clinical pathology.

[17]  Scott J Leischow,et al.  Systems thinking and modeling for public health practice. , 2006, American journal of public health.

[18]  Mario Plebani,et al.  Appropriateness in programs for continuous quality improvement in clinical laboratories. , 2003, Clinica chimica acta; international journal of clinical chemistry.

[19]  R. Wears,et al.  Computer technology and clinical work: still waiting for Godot. , 2005, JAMA.

[20]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005 .

[21]  Robert Axelrod Advancing the art of simulation in the social sciences , 1997 .