Paving the COWpath: data-driven design of pediatric order sets.

OBJECTIVE Evidence indicates that users incur significant physical and cognitive costs in the use of order sets, a core feature of computerized provider order entry systems. This paper develops data-driven approaches for automating the construction of order sets that match closely with user preferences and workflow while minimizing physical and cognitive workload. MATERIALS AND METHODS We developed and tested optimization-based models embedded with clustering techniques using physical and cognitive click cost criteria. By judiciously learning from users' actual actions, our methods identify items for constituting order sets that are relevant according to historical ordering data and grouped on the basis of order similarity and ordering time. We evaluated performance of the methods using 47,099 orders from the year 2011 for asthma, appendectomy and pneumonia management in a pediatric inpatient setting. RESULTS In comparison with existing order sets, those developed using the new approach significantly reduce the physical and cognitive workload associated with usage by 14-52%. This approach is also capable of accommodating variations in clinical conditions that affect order set usage and development. DISCUSSION There is a critical need to investigate the cognitive complexity imposed on users by complex clinical information systems, and to design their features according to 'human factors' best practices. Optimizing order set generation using cognitive cost criteria introduces a new approach that can potentially improve ordering efficiency, reduce unintended variations in order placement, and enhance patient safety. CONCLUSIONS We demonstrate that data-driven methods offer a promising approach for designing order sets that are generalizable, data-driven, condition-based, and up to date with current best practices.

[1]  Gunther Schadow,et al.  A Recommendation Algorithm for Automating Corollary Order Generation , 2009, AMIA.

[2]  P. Candy,et al.  Preventing "information overdose": developing information-literate practitioners. , 2000, The Journal of continuing education in the health professions.

[3]  Vimla L. Patel,et al.  A framework for analyzing the cognitive complexity of computer-assisted clinical ordering , 2003, J. Biomed. Informatics.

[4]  Vimla L. Patel,et al.  Research Paper: Impact of a Computer-based Patient Record System on Data Collection, Knowledge Organization, and Reasoning , 2000, J. Am. Medical Informatics Assoc..

[5]  Guilherme Del Fiol,et al.  Towards an on-demand peer feedback system for a clinical knowledge base: A case study with order sets , 2008, J. Biomed. Informatics.

[6]  Jennifer Lai,et al.  Unintended Consequences of Information Technologies in Health Care—An Interactive Sociotechnical Analysis , 2007 .

[7]  Svetlana Z. Lowry,et al.  NIST guide to the processes approach for improving the usability of electronic health records , 2010 .

[8]  Hagop S. Mekhjian,et al.  Implementation Brief: Key Attributes of a Successful Physician Order Entry System Implementation in a Multi-hospital Environment , 2002, J. Am. Medical Informatics Assoc..

[9]  Ann Scheck McAlearney,et al.  Utilization of evidence-based computerized order sets in pediatrics , 2006, Int. J. Medical Informatics.

[10]  Adam Wright,et al.  Use of order sets in inpatient computerized provider order entry systems: A comparative analysis of usage patterns at seven sites , 2012, Int. J. Medical Informatics.

[11]  Ling Li,et al.  The safety of electronic prescribing: manifestations, mechanisms, and rates of system-related errors associated with two commercial systems in hospitals , 2013, J. Am. Medical Informatics Assoc..

[12]  Charlotte A. Weaver,et al.  Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA. , 2013, Journal of the American Medical Informatics Association : JAMIA.

[13]  Rema Padman,et al.  Data-driven Order Set Generation and Evaluation in the Pediatric Environment , 2012, AMIA.

[14]  Ritu Agarwal,et al.  Evolving Work Routines: Adaptive Routinization of Information Technology in Healthcare , 2011, Inf. Syst. Res..

[15]  Rema Padman,et al.  Reducing Provider Cognitive Workload in CPOE Use: Optimizing Order Sets , 2013, MedInfo.

[16]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[17]  Rema Padman,et al.  Toward Order Set Optimization Using Click Cost Criteria in the Pediatric Environment , 2013, 2013 46th Hawaii International Conference on System Sciences.

[18]  Michael G Leu,et al.  Effects of CPOE on Provider Cognitive Workload: A Randomized Crossover Trial , 2012, Pediatrics.

[19]  A. Reber Implicit learning and tacit knowledge , 1993 .

[20]  Denise Maguire Neural Cowpaths in the NICU , 2002, Neonatal Network.

[21]  Albert-László Barabási,et al.  A Dynamic Network Approach for the Study of Human Phenotypes , 2009, PLoS Comput. Biol..

[22]  Rajika L. Munasinghe,et al.  Improving the utilization of admission order sets in a computerized physician order entry system by integrating modular disease specific order subsets into a general medicine admission order set , 2011, J. Am. Medical Informatics Assoc..

[23]  Mark E. Nissen,et al.  An Experiment to Assess the Performance of a Redesign Knowledge System , 2000, J. Manag. Inf. Syst..

[24]  M. Eraut Non-formal learning and tacit knowledge in professional work. , 2000, The British journal of educational psychology.

[25]  V. Patel,et al.  Assessment of a computerized patient record system: a cognitive approach to evaluating medical technology. , 1996, M.D. computing : computers in medical practice.

[26]  B. Jacobs,et al.  Reduction in Clinical Variance Using Targeted Design Changes in Computerized Provider Order Entry (CPOE) Order Sets , 2012, Applied Clinical Informatics.

[27]  Adam Wright,et al.  Automated Development of Order Sets and Corollary Orders by Data Mining in an Ambulatory Computerized Physician Order Entry System , 2006, AMIA.

[28]  D. Bates,et al.  Medication errors and adverse drug events in pediatric inpatients. , 2001, JAMA.

[29]  J. Marc Overhage,et al.  Editorial Comments: Physicians, Information Technology, and Health Care Systems: A Journey, Not a Destination , 2003, J. Am. Medical Informatics Assoc..

[30]  Kaveh G Shojania,et al.  Usability evaluation of order sets in a computerised provider order entry system , 2011, BMJ quality & safety.

[31]  Soon Myoung Chung,et al.  Parallel bisecting k-means with prediction clustering algorithm , 2006, The Journal of Supercomputing.

[32]  Monique W. M. Jaspers,et al.  Physicians' Perceptions on the usefulness of contextual information for prioritizing and presenting alerts in computerized physician order entry systems , 2012, BMC Medical Informatics and Decision Making.

[33]  H. Simon,et al.  Rational choice and the structure of the environment. , 1956, Psychological review.

[34]  Z. Dienes,et al.  A theory of implicit and explicit knowledge , 1999, Behavioral and Brain Sciences.