A simulation framework for mapping risks in clinical processes: the case of in-patient transfers

OBJECTIVE To model how individual violations in routine clinical processes cumulatively contribute to the risk of adverse events in hospital using an agent-based simulation framework. DESIGN An agent-based simulation was designed to model the cascade of common violations that contribute to the risk of adverse events in routine clinical processes. Clinicians and the information systems that support them were represented as a group of interacting agents using data from direct observations. The model was calibrated using data from 101 patient transfers observed in a hospital and results were validated for one of two scenarios (a misidentification scenario and an infection control scenario). Repeated simulations using the calibrated model were undertaken to create a distribution of possible process outcomes. The likelihood of end-of-chain risk is the main outcome measure, reported for each of the two scenarios. RESULTS The simulations demonstrate end-of-chain risks of 8% and 24% for the misidentification and infection control scenarios, respectively. Over 95% of the simulations in both scenarios are unique, indicating that the in-patient transfer process diverges from prescribed work practices in a variety of ways. CONCLUSIONS The simulation allowed us to model the risk of adverse events in a clinical process, by generating the variety of possible work subject to violations, a novel prospective risk analysis method. The in-patient transfer process has a high proportion of unique trajectories, implying that risk mitigation may benefit from focusing on reducing complexity rather than augmenting the process with further rule-based protocols.

[1]  Andrew Georgiou,et al.  Model Formulation: Multimethod Evaluation of Information and Communication Technologies in Health in the Context of Wicked Problems and Sociotechnical Theory , 2007, J. Am. Medical Informatics Assoc..

[2]  P. Garnerin,et al.  Measuring human-error probabilities in drug preparation: a pilot simulation study , 2007, European Journal of Clinical Pharmacology.

[3]  N Britten,et al.  “Doing prescribing”: how might clinicians work differently for better, safer care , 2003, Quality & safety in health care.

[4]  Douglas H. Fernald,et al.  Stopping the error cascade: a report on ameliorators from the ASIPS collaborative , 2007, Quality and Safety in Health Care.

[5]  Audit Branch Correct Patient, Correct Procedure and Correct Site - NSW Department of Health , 2007 .

[6]  Maarten SIERHUIS,et al.  Towards Organization Aware Agent-based Simulation , 2009 .

[7]  Erik Demeulemeester,et al.  Capacity of Clinical Pathways—A Strategic Multi-level Evaluation Tool , 2008, Journal of Medical Systems.

[8]  E. West Organisational sources of safety and danger: sociological contributions to the study of adverse events , 2000, Quality in health care : QHC.

[9]  Dario D. Salvucci,et al.  Threaded cognition: an integrated theory of concurrent multitasking. , 2008, Psychological review.

[10]  Nicolas Martelli,et al.  The application of hazard analysis and critical control points and risk management in the preparation of anti-cancer drugs. , 2009, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[11]  R. Gibberd,et al.  An analysis of the causes of adverse events from the Quality in Australian Health Care Study , 1999, The Medical journal of Australia.

[12]  Peter D. Stetson,et al.  Perceived Information Needs and Communication Difficulties of Inpatient Physicians and Nurses , 2002, J. Am. Medical Informatics Assoc..

[13]  Steven H. Woolf,et al.  A String of Mistakes: The Importance of Cascade Analysis in Describing, Counting, and Preventing Medical Errors , 2004, The Annals of Family Medicine.

[14]  J. Reason Human error: models and management , 2000, BMJ : British Medical Journal.

[15]  P. Bonnabry,et al.  Use of a systematic risk analysis method to improve safety in the production of paediatric parenteral nutrition solutions , 2005, Quality and Safety in Health Care.

[16]  Sheldon Howard Jacobson,et al.  Application of discrete-event simulation in health care clinics: A survey , 1999, J. Oper. Res. Soc..

[17]  A. Slonim,et al.  Assessing patient safety risk before the injury occurs: an introduction to sociotechnical probabilistic risk modelling in health care , 2003, Quality & safety in health care.

[18]  D. Bates,et al.  Improving safety with information technology. , 2003, The New England journal of medicine.

[19]  J. Moller,et al.  Iatrogenic injury in Australia , 2001 .

[20]  S. Spear,et al.  Ambiguity and Workarounds as Contributors to Medical Error , 2005, Annals of Internal Medicine.

[21]  Yaman Barlas,et al.  Formal aspects of model validity and validation in system dynamics , 1996 .

[22]  D R Baird,et al.  Post-operative endophthalmitis: the application of hazard analysis critical control points (HACCP) to an infection control problem. , 2001, The Journal of hospital infection.

[23]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[24]  Hardeep Singh,et al.  Reducing Diagnostic Errors through Effective Communication: Harnessing the Power of Information Technology , 2008, Journal of General Internal Medicine.

[25]  C. J. Griffith,et al.  The clinical application of hazard analysis critical control points (HACCP) , 2005 .

[26]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005, JAMA.

[27]  Michael Wooldridge,et al.  Intelligent Agents III , 1997 .

[28]  Fiona Neely HAND HYGIENE POLICY , 2009 .

[29]  David E. Kieras,et al.  The GOMS family of user interface analysis techniques: comparison and contrast , 1996, TCHI.

[30]  Dominik Aronsky,et al.  Forecasting emergency department crowding: a discrete event simulation. , 2008, Annals of emergency medicine.

[31]  Marilyn M. Anderson,et al.  Research Paper: Evaluating the Capability of Information Technology to Prevent Adverse Drug Events: A Computer Simulation Approach , 2002, J. Am. Medical Informatics Assoc..

[32]  Maria Laura Chiozza,et al.  FMEA: a model for reducing medical errors. , 2009, Clinica chimica acta; international journal of clinical chemistry.

[33]  Rick Iedema,et al.  New approaches to researching patient safety. , 2009, Social science & medicine.

[34]  Ray J. Paul,et al.  Simulation modelling in healthcare: reviewing legacies and investigating futures , 2007, J. Oper. Res. Soc..

[35]  D. Kopec,et al.  Human Errors in Medical Practice: Systematic Classification and Reduction with Automated Information Systems , 2003, Journal of Medical Systems.

[36]  J. Gregory Trafton,et al.  Memory for Goals: An Architectural Perspective , 2020, Proceedings of the Twenty First Annual Conference of the Cognitive Science Society.

[37]  F. Glascoe Improving clinical communication: a view from psychology. , 2001 .

[38]  John R. Anderson,et al.  ACT-R: A Theory of Higher Level Cognition and Its Relation to Visual Attention , 1997, Hum. Comput. Interact..

[39]  David L. Cooke,et al.  A system analysis of a suboptimal surgical experience , 2009, Patient safety in surgery.

[40]  Maarten Sierhuis,et al.  Brahms: a multi-agent modelling environment for simulating work processes and practices , 2007, Int. J. Simul. Process. Model..

[41]  Marek Laskowski,et al.  Agent-Based Simulation of Emergency Departments with Patient Diversion , 2008, eHealth.

[42]  J. Burgmeier,et al.  Failure mode and effect analysis: an application in reducing risk in blood transfusion. , 2002, The Joint Commission journal on quality improvement.

[43]  James G. Anderson,et al.  The need for organizational change in patient safety initiatives , 2006, Int. J. Medical Informatics.

[44]  Sue Hignett,et al.  Patient handovers within the hospital: translating knowledge from motor racing to healthcare , 2010, Quality and Safety in Health Care.

[45]  D M Barends,et al.  Risk analysis by FMEA as an element of analytical validation. , 2009, Journal of pharmaceutical and biomedical analysis.

[46]  C Wagner,et al.  Adverse events and potentially preventable deaths in Dutch hospitals: results of a retrospective patient record review study , 2002, Quality & Safety in Health Care.

[47]  J. Gregory Trafton,et al.  Memory for goals: an activation-based model , 2002, Cogn. Sci..

[48]  Mei-Sing Ong,et al.  Safety through redundancy: a case study of in-hospital patient transfers , 2010, Quality and Safety in Health Care.

[49]  T. Brennan,et al.  The nature of adverse events in hospitalized patients. Results of the Harvard Medical Practice Study II. , 1991, The New England journal of medicine.

[50]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[51]  Melissa Heigham,et al.  Using Failure Mode and Effects Analysis for safe administration of chemotherapy to hospitalized children with cancer. , 2006, Joint Commission journal on quality and patient safety.

[52]  J Rasmussen,et al.  Human error and the problem of causality in analysis of accidents. , 1990, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[53]  Arthur C. Graesser,et al.  Is it an Agent, or Just a Program?: A Taxonomy for Autonomous Agents , 1996, ATAL.

[54]  J. Wreathall,et al.  Assessing risk: the role of probabilistic risk assessment (PRA) in patient safety improvement , 2004, Quality and Safety in Health Care.

[55]  Tosha B. Wetterneck,et al.  Technology Evaluation: Workarounds to Barcode Medication Administration Systems: Their Occurrences, Causes, and Threats to Patient Safety , 2008, J. Am. Medical Informatics Assoc..