A systematic analysis of the optimization of computerized physician order entry and clinical decision support systems: A qualitative study in English hospitals

This article analyzes the range of system optimization activities taking place over an extended period following the implementation of computerized physician order entry and clinical decision support systems. We undertook 207 qualitative semi-structured interviews, 24 rounds of non-participant observations of meetings and system use, and collected 17 organizational documents in five hospitals over three time periods between 2011 and 2016. We developed a systematic analysis of system optimization activities with eight sub-categories grouped into three main categories. This delineates the range of system optimization activities including resolving misalignments between technology and clinical practices, enhancing the adopted system, and improving user capabilities to utilize/further optimize systems. This study highlights the optimization efforts by user organizations adopting multi-user, organization-spanning information technologies. Hospitals must continue to attend to change management for an extended period (up to 5 years post-implementation) and develop a strategy for long-term system optimization including sustained user engagement, training, and broader capability development to ensure smoother and quicker realization of benefits.

[1]  David W. Bates,et al.  Ten key considerations for the successful optimization of large-scale health information technology , 2017, J. Am. Medical Informatics Assoc..

[2]  I. Coyne.  Sampling in qualitative research. Purposeful and theoretical sampling; merging or clear boundaries? , 1997, Journal of advanced nursing.

[3]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[4]  Margaret Williamson,et al.  Computerized clinical decision support for prescribing: provision does not guarantee uptake. , 2010, Journal of the American Medical Informatics Association : JAMIA.

[5]  G. Pisano,et al.  Disrupted Routines: Team Learning and New Technology Implementation in Hospitals , 2001 .

[6]  Christine Nadel,et al.  Case Study Research Design And Methods , 2016 .

[7]  Jonathan M. Teich,et al.  The impact of computerized physician order entry on medication error prevention. , 1999, Journal of the American Medical Informatics Association : JAMIA.

[8]  A. Sheikh,et al.  Workarounds to hospital electronic prescribing systems: a qualitative study in English hospitals , 2016, BMJ Quality & Safety.

[9]  Eric G. Poon,et al.  Research Paper: The Extent and Importance of Unintended Consequences Related to Computerized Provider Order Entry , 2007, J. Am. Medical Informatics Assoc..

[10]  Robin Williams,et al.  Software and Organisations: The Biography of the Enterprise-Wide System or How SAP Conquered the World , 2008 .

[11]  Y. Han,et al.  Unexpected Increased Mortality After Implementation of a Commercially Sold Computerized Physician Order Entry System , 2005, Pediatrics.

[12]  D. Leonard.  Implementation as Mutual Adaptation of Technology and Organization , 2011 .

[13]  James D. Carpenter,et al.  Categorizing the unintended sociotechnical consequences of computerized provider order entry , 2007, Int. J. Medical Informatics.

[14]  Sia Siew Kien,et al.  Misalignments in ERP Implementation: A Dialectic Perspective , 2003, Int. J. Hum. Comput. Interact..

[15]  David W. Bates,et al.  The evolution of the market for commercial computerized physician order entry and computerized decision support systems for prescribing , 2016, J. Am. Medical Informatics Assoc..

[16]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005 .

[17]  Marc Berg,et al.  Case Report: Understanding Implementation: The Case of a Computerized Physician Order Entry System in a Large Dutch University Medical Center , 2004, J. Am. Medical Informatics Assoc..

[18]  Juliet M. Corbin,et al.  Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory , 2008 .

[19]  D. Bates,et al.  Exploring the roots of unintended safety threats associated with the introduction of hospital ePrescribing systems and candidate avoidance and/or mitigation strategies: a qualitative study , 2017, BMJ Quality & Safety.

[20]  Guy G. Gable,et al.  An ERP-client benefit-oriented maintenance taxonomy , 2002, J. Syst. Softw..

[21]  K. Arrow.  The Economic Implications of Learning by Doing , 1962 .

[22]  Andrew Robson,et al.  Benefits realisation from IT-enabled innovation: A capability challenge for NHS English acute hospital trusts? , 2018, Inf. Technol. People.

[23]  M. Lynne Markus,et al.  Tailoring ERP systems: a spectrum of choices and their implications , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[24]  H. Turunen,et al.  Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. , 2013, Nursing & health sciences.

[25]  Jan Savage,et al.  Ethnographic evidence , 2006 .

[26]  Robin Williams,et al.  e-Infrastructures: How Do We Know and Understand Them? Strategic Ethnography and the Biography of Artefacts , 2010, Computer Supported Cooperative Work (CSCW).

[27]  Jos Aarts,et al.  Same system, different outcomes: Comparing the transitions from two paper-based systems to the same computerized physician order entry system , 2009, Int. J. Medical Informatics.

[28]  A. Sheikh,et al.  The Challenges of Implementing Packaged Hospital Electronic Prescribing and Medicine Administration Systems in UK Hospitals: Premature Purchase of Immature Solutions? , 2017 .

[29]  A. Sheikh,et al.  Five key recommendations for the implementation of hospital electronic prescribing and medicines administration systems in Scotland , 2016, BMJ Health & Care Informatics.

[30]  Hsien-Chang Lin,et al.  Use of electronic medical records differs by specialty and office settings. , 2013, Journal of the American Medical Informatics Association : JAMIA.

[31]  A. Sheikh,et al.  A toolkit to support the implementation of electronic prescribing systems into UK hospitals: preliminary recommendations , 2014, Journal of the Royal Society of Medicine.

[32]  Aziz Sheikh,et al.  Sustained User Engagement in Health Information Technology: The Long Road from Implementation to System Optimization of Computerized Physician Order Entry and Clinical Decision Support Systems for Prescribing in Hospitals in England , 2017, Health services research.

[33]  Aziz Sheikh,et al.  Anglicization of hospital information systems: Managing diversity alongside particularity , 2018, Int. J. Medical Informatics.

[34]  J Savage,et al.  Ethnography and health care , 2000, BMJ : British Medical Journal.

[35]  Deena J. Chisolm,et al.  Moving from Good to Great in Ambulatory Electronic Health Record Implementation , 2010, Journal for healthcare quality : official publication of the National Association for Healthcare Quality.

[36]  E. Burton Swanson,et al.  The dimensions of maintenance , 1976, ICSE '76.

[37]  Hajar Mozaffar,et al.  Health Technology Development and Use: From Practice‐bound Imagination to Evolving Impacts , 2011 .

[38]  Bernard Grabot,et al.  Implementation and optimisation of ERP systems: A better integration of processes, roles, knowledge and user competencies , 2005, Comput. Ind..

[39]  Neil Pollock,et al.  Generification Work in the Production of Organizational Software Packages , 2022 .

[40]  Aziz Sheikh,et al.  A systematic scoping review of the domains and innovations in secondary uses of digitised health-related data , 2016, BMJ Health & Care Informatics.

[41]  Julia Adler-Milstein,et al.  Making IT work - harnessing the power of health information technology ti improve care in England , 2016 .

[42]  Ned Chapin,et al.  Types of software evolution and software maintenance , 2001, J. Softw. Maintenance Res. Pract..

[43]  Marc Berg,et al.  A tale of two hospitals: a sociotechnical appraisal of the introduction of computerized physician order entry in two Dutch hospitals , 2004, MedInfo.

[44]  N. Hoffart.  Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory , 2000 .

[45]  A. Sheikh,et al.  Understanding Contrasting Approaches to Nationwide Implementations of Electronic Health Record Systems: England, the USA and Australia , 2011 .

[46]  M. Markus,et al.  The Enterprise System Experience— From Adoption to Success , 2000 .

[47]  Jos Aarts,et al.  Implementation of computerized physician order entry in seven countries. , 2009, Health affairs.

[48]  Robin Williams,et al.  The Wrong Trousers? Beyond the Design Fallacy: Social Learning and the User , 2005 .

[49]  Nicholas Walliman,et al.  Social research methods , 2006 .