Evaluating a handheld decision support device in pediatric intensive care settings.

Objective To evaluate end-user acceptance and the effect of a commercial handheld decision support device in pediatric intensive care settings. The technology, pac2, was designed to assist nurses in calculating medication dose volumes and infusion rates at the bedside. Materials and Methods The devices, manufactured by InformMed Inc., were deployed in the pediatric and neonatal intensive care units in 2 health systems. This mixed methods study assessed end-user acceptance, as well as pac2's effect on the cognitive load associated with bedside dose calculations and the rate of administration errors. Towards this end, data were collected in both pre- and postimplementation phases, including through ethnographic observations, semistructured interviews, and surveys. Results Although participants desired a handheld decision support tool such as pac2, their use of pac2 was limited. The nature of the critical care environment, nurses' risk perceptions, and the usability of the technology emerged as major barriers to use. Data did not reveal significant differences in cognitive load or administration errors after pac2 was deployed. Discussion and Conclusion Despite its potential for reducing adverse medication events, the commercial standalone device evaluated in the study was not used by the nursing participants and thus had very limited effect. Our results have implications for the development and deployment of similar mobile decision support technologies. For example, they suggest that integrating the technology into hospitals' existing IT infrastructure and employing targeted implementation strategies may facilitate nurse acceptance. Ultimately, the usability of the design will be essential to reaping any potential benefits.

[1]  M. Makary,et al.  Medical error—the third leading cause of death in the US , 2016, British Medical Journal.

[2]  F. Rocchi,et al.  The development of medicines for children. Part of a series on Pediatric Pharmacology, guest edited by Gianvincenzo Zuccotti, Emilio Clementi, and Massimo Molteni. , 2011, Pharmacological research.

[3]  A. Strauss,et al.  The Discovery of Grounded Theory , 1967 .

[4]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[5]  Philip J Schneider,et al.  ASHP national survey of pharmacy practice in hospital settings: Prescribing and transcribing-2016. , 2017, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[6]  Wilbert Mason,et al.  Development, Testing, and Findings of a Pediatric-Focused Trigger Tool to Identify Medication-Related Harm in US Children's Hospitals , 2008, Pediatrics.

[7]  C. Aydin,et al.  Evaluating Health Care Information Systems: Methods and Applications , 1993 .

[8]  H. Stelfox,et al.  Clinical review: Medication errors in critical care , 2008, Critical care.

[9]  James M. Walker,et al.  Measuring workload of ICU nurses with a questionnaire survey: the NASA Task Load Index (TLX) , 2011, IIE transactions on healthcare systems engineering.

[10]  Cody S. Olsen,et al.  Reported medication events in a paediatric emergency research network: sharing to improve patient safety , 2012, Emergency Medicine Journal.

[11]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[12]  C. Webster,et al.  A systems approach to the reduction of medication error on the hospital ward. , 2001, Journal of advanced nursing.

[13]  J. P. Vroom,et al.  Advances in Psychology. , 1998, Canadian Medical Association journal.

[14]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[15]  D. Ashcroft,et al.  Prevalence and Nature of Medication Administration Errors in Health Care Settings: A Systematic Review of Direct Observational Evidence , 2013, The Annals of pharmacotherapy.

[16]  C. Landrigan,et al.  Temporal trends in rates of patient harm resulting from medical care. , 2010, The New England journal of medicine.

[17]  B. Franklin,et al.  Methodological variations and their effects on reported medication administration error rates , 2013, BMJ quality & safety.

[18]  D. Bates,et al.  Medication errors and adverse drug events in pediatric inpatients. , 2001, JAMA.

[19]  E. Balas,et al.  Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success , 2005, BMJ : British Medical Journal.

[20]  J. Bliss-Holtz Discriminating types of medication calculation errors in nursing practice. , 1994, Nursing research.

[21]  Ramin Khorasani,et al.  The hazard of software updates to clinical workstations: a natural experiment. , 2013, Journal of the American Medical Informatics Association : JAMIA.

[22]  Juan Miguel García-Gómez,et al.  Mobile Clinical Decision Support Systems and Applications: A Literature and Commercial Review , 2013, Journal of Medical Systems.

[23]  D. Classen,et al.  'Global trigger tool' shows that adverse events in hospitals may be ten times greater than previously measured. , 2011, Health affairs.

[24]  L. Kohn,et al.  To Err Is Human : Building a Safer Health System , 2007 .

[25]  Dean F. Sittig,et al.  Defining health information technology-related errors: new developments since to err is human. , 2011, Archives of internal medicine.

[26]  Michael Juntao Yuan,et al.  Evaluation of User Interface and Workflow Design of a Bedside Nursing Clinical Decision Support System , 2013, Interactive journal of medical research.

[27]  Karen A. Esquibel,et al.  Focused Ethnographic Observations , 2014 .

[28]  V. Montgomery Effect of fatigue, workload, and environment on patient safety in the pediatric intensive care unit , 2007, Pediatric critical care medicine : a journal of the Society of Critical Care Medicine and the World Federation of Pediatric Intensive and Critical Care Societies.

[29]  R Brian Haynes,et al.  Features of effective computerised clinical decision support systems: meta-regression of 162 randomised trials , 2013, BMJ : British Medical Journal.

[30]  D. Classen,et al.  Prevalence of adverse events in pediatric intensive care units in the United States* , 2010, Pediatric critical care medicine : a journal of the Society of Critical Care Medicine and the World Federation of Pediatric Intensive and Critical Care Societies.

[31]  TonseN. K. Raju,et al.  MEDICATION ERRORS IN NEONATAL AND PAEDIATRIC INTENSIVE-CARE UNITS , 1989, The Lancet.

[32]  Ling Li,et al.  Impact of commercial computerized provider order entry (CPOE) and clinical decision support systems (CDSSs) on medication errors, length of stay, and mortality in intensive care units: a systematic review and meta-analysis , 2017, J. Am. Medical Informatics Assoc..

[33]  Graham R. Gibbs,et al.  Analyzing Qualitative Data , 2014 .

[34]  Alissa L. Russ,et al.  Recommendations to improve the usability of drug-drug interaction clinical decision support alerts , 2015, J. Am. Medical Informatics Assoc..

[35]  Jane M Carrington,et al.  A Systematic Review of Nurses' Experiences With Unintended Consequences When Using the Electronic Health Record , 2015, Nursing administration quarterly.

[36]  B. Franklin,et al.  The incidence and nature of prescribing and medication administration errors in paediatric inpatients , 2010, Archives of Disease in Childhood.

[37]  Eric S. Kirkendall,et al.  Measuring Adverse Events and Levels of Harm in Pediatric Inpatients With the Global Trigger Tool , 2012, Pediatrics.

[38]  David W Bates,et al.  Comparison of methods for detecting medication errors in 36 hospitals and skilled-nursing facilities. , 2002, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[39]  Marc Berg,et al.  Overriding of drug safety alerts in computerized physician order entry. , 2006, Journal of the American Medical Informatics Association : JAMIA.

[40]  P. Beare,et al.  Performance on a mathematics/drug calculation test: relationship to subsequent reported medication errors. , 1988, Journal of nursing staff development : JNSD.

[41]  Susana Rubio,et al.  Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA‐TLX, and Workload Profile Methods , 2004 .

[42]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[43]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[44]  D. Cousins,et al.  Medication errors in children: a descriptive summary of medication error reports submitted to the United States pharmacopeia , 2001 .

[45]  C. Pamer,et al.  Retrospective analysis of mortalities associated with medication errors. , 2001, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[46]  J. Ford,et al.  Estimating the requirement for manipulation of medicines to provide accurate doses for children , 2012 .

[47]  K. Charmaz,et al.  Constructing Grounded Theory , 2014 .

[48]  S. Keogh,et al.  Dishing the drugs: a qualitative study to explore paediatric nurses' attitudes and practice related to medication administration. , 2005, Collegian.

[49]  David W. Bates,et al.  Synthesis of Research Paper: Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality , 2003, J. Am. Medical Informatics Assoc..

[50]  D. Bates,et al.  Evaluation of medium-term consequences of implementing commercial computerized physician order entry and clinical decision support prescribing systems in two 'early adopter' hospitals. , 2014, Journal of the American Medical Informatics Association : JAMIA.

[51]  J C Russo,et al.  Medication error prevention by clinical pharmacists in two children's hospitals. , 1987, Pediatrics.

[52]  P. Metnitz,et al.  Errors in administration of parenteral drugs in intensive care units: multinational prospective study , 2009, BMJ : British Medical Journal.

[53]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[54]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005 .

[55]  Computerized pharmaceutical algorithm reduces medication administration errors during simulated resuscitations. , 2010, The journal of pediatric pharmacology and therapeutics : JPPT : the official journal of PPAG.

[56]  Philip J Schneider,et al.  ASHP national survey of pharmacy practice in hospital settings: dispensing and administration--2002. , 2003, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[57]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[58]  Charles P. Friedman,et al.  Development and initial validation of an instrument to measure physicians' use of, knowledge about, and attitudes toward computers. , 1998, Journal of the American Medical Informatics Association : JAMIA.

[59]  Nick Barber,et al.  Systematic Review of Medication Errors in Pediatric Patients , 2006, The Annals of pharmacotherapy.

[60]  B Sheehan,et al.  Developing Clinical Decision Support within a Commercial Electronic Health Record System to Improve Antimicrobial Prescribing in the Neonatal ICU , 2014, Applied Clinical Informatics.

[61]  Marcia J. Bates,et al.  Encyclopedia of Library and Information Sciences , 2009 .

[62]  Stephan Krähenbühl,et al.  Drug-Related Problems in Hospitals , 2007, Drug safety.

[63]  D. Ashcroft,et al.  Understanding the causes of intravenous medication administration errors in hospitals: a qualitative critical incident study , 2015, BMJ Open.

[64]  S. Haun,et al.  Acetaminophen toxicity in children. , 2002, American family physician.

[65]  F. Gill,et al.  An exploration of pediatric nurses' compliance with a medication checking and administration protocol. , 2012, Journal for specialists in pediatric nursing : JSPN.