Assessment of Innovative Emergency Department Information Displays in a Clinical Simulation Center

The objective of this work was to assess the functional utility of new display concepts for an emergency department information system created using cognitive systems engineering methods, by comparing them to similar displays currently in use. The display concepts were compared to standard displays in a clinical simulation study during which nurse-physician teams performed simulated emergency department tasks. Questionnaires were used to assess the cognitive support provided by the displays, participants’ level of situation awareness, and participants’ workload during the simulated tasks. Participants rated the new displays significantly higher than the control displays in terms of cognitive support. There was no significant difference in workload scores between the display conditions. There was no main effect of display type on situation awareness, but there was a significant interaction; participants using the new displays showed improved situation awareness from the middle to the end of the session. This study demonstrates that cognitive systems engineering methods can be used to create innovative displays that better support emergency medicine tasks, without increasing workload, compared to more standard displays. These methods provide a means to develop emergency department information systems—and more broadly, health information technology—that better support the cognitive needs of healthcare providers.

[1]  Judith A. Effken,et al.  Using Cognitive Work Analysis to fit decision support tools to nurse managers' work flow , 2011, Int. J. Medical Informatics.

[2]  Catherine M. Burns,et al.  Modeling a medical environment: an ontology for integrated medical informatics design , 2001, Int. J. Medical Informatics.

[3]  Stephen J. Morrissey,et al.  Reviews of Human Factors and Ergonomics , 2008 .

[4]  Vimla L. Patel,et al.  The multitasking clinician: Decision-making and cognitive demand during and after team handoffs in emergency care , 2007, Int. J. Medical Informatics.

[5]  Catherine M. Burns,et al.  Usability Evaluation of a Mobile Ecological Interface Design Application for Diabetes Management , 2005 .

[6]  Ulf Ahlstrom,et al.  Work domain analysis for air traffic controller weather displays. , 2005, Journal of safety research.

[7]  E. Redfern,et al.  Identifying vulnerabilities in communication in the emergency department , 2009, Emergency Medicine Journal.

[8]  S. Schenkel.  Promoting patient safety and preventing medical error in emergency departments. , 2000, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[9]  Ian Findley,et al.  Assessing Impact, Handbook of EIA and SEA Follow-up , 2004 .

[10]  Alex Mihailidis,et al.  Twenty Years of Cognitive Work Analysis in Health Care , 2014 .

[11]  Li Lin,et al.  Engineering Better Health IT: Cognitive Systems Engineering of a Novel Emergency Department IT System , 2012 .

[12]  A. Parush.  Displays for Health Care Teams: A Conceptual Framework and Design Methodology , 2014 .

[13]  Stephen F. Smith,et al.  Designing Collaborative Automated Planners for Agile Adaptation to Dynamic Change , 2012 .

[14]  Donald A. Norman,et al.  Cognitive artifacts , 1991 .

[15]  N. Naikar,et al.  Analysing activity in complex systems with cognitive work analysis: concepts, guidelines and case study for control task analysis , 2006 .

[16]  Robert L. Wears,et al.  Emergency department status boards: user-evolved artefacts for inter- and intra-group coordination , 2007, Cognition, Technology & Work.

[17]  Li Lin,et al.  Development of a Simulation Environment to Study Emergency Department Information Technology , 2010, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[18]  Jesper Simonsen,et al.  Visual overview, oral detail: The use of an emergency-department whiteboard , 2015, Int. J. Hum. Comput. Stud..

[19]  A. Zachary Hettinger,et al.  Usability evaluation and assessment of a novel emergency department IT system developed using a cognitive systems engineering approach , 2014 .

[20]  Michael E. Lesk,et al.  Quantifying adaptation parameters for information support of trauma teams , 2008, CHI Extended Abstracts.

[21]  Rollin J Fairbanks,et al.  Emergency department communication links and patterns. , 2007, Annals of emergency medicine.

[22]  Rollin J. Fairbanks,et al.  Cognitive Artifacts in Transition: An Analysis of Information Content Changes between Manual and Electronic Patient Tracking Systems , 2008 .

[23]  Catherine M. Burns,et al.  Lessons From a Comparison of Work Domain Models: Representational Choices and Their Implications , 2004, Hum. Factors.

[24]  Christopher Nemeth,et al.  Support for ICU Clinician Cognitive Work through CSE , 2014 .

[25]  Rollin J. Fairbanks,et al.  Assessing the Impact of Computerization on Work Practice: Information Technology in Emergency Departments , 2007 .

[26]  Annamaria Bagnasco,et al.  Identifying and correcting communication failures among health professionals working in the Emergency Department. , 2013, International emergency nursing.

[27]  Avi Parush,et al.  Communication and team situation awareness in the OR: Implications for augmentative information display , 2011, J. Biomed. Informatics.

[28]  Jens Rasmussen,et al.  Cognitive Systems Engineering , 2022 .

[29]  C. Probst,et al.  Engagement and Macroergonomics: Using Cognitive Engineering to Improve Patient Safety , 2014 .

[30]  W. Cordell,et al.  Emergency department workplace interruptions: are emergency physicians "interrupt-driven" and "multitasking"? , 2000, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[31]  Judith A. Effken,et al.  Different lenses, improved outcomes: a new approach to the analysis and design of healthcare information systems , 2002, Int. J. Medical Informatics.

[33]  Samer Faraj,et al.  What whiteboards in a trauma center operating suite can teach us about emergency department communication. , 2007, Annals of emergency medicine.

[34]  Jesper Simonsen,et al.  Work-practice changes associated with an electronic emergency department whiteboard , 2013, Health Informatics J..

[35]  K. J. Vicente,et al.  Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work , 1999 .

[36]  Catherine M. Burns,et al.  Ecological Interface Design , 2004 .

[37]  Neelam Naikar.  Work Domain Analysis: Concepts, Guidelines, and Cases , 2013 .

[38]  Judith A. Effken,et al.  Clinical information displays to improve ICU outcomes , 2008, Int. J. Medical Informatics.

[39]  Rollin J. Fairbanks,et al.  Emergency Department Status Boards: A Case Study in Information Systems Transition , 2010 .

[40]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[41]  Rollin J. Fairbanks,et al.  Cognitive Engineering Design of an Emergency Department Information System , 2014 .

[42]  Thomas L. Seamster,et al.  Applied Cognitive Task Analysis in Aviation , 1997 .

[43]  Mica R. Endsley,et al.  Theoretical Underpinnings of Situation Awareness, A Critical Review , 2000 .

[44]  Arthur J. Helmicki,et al.  The Application of the Ecological Interface Design Approach to Neonatal Intensive Care Medicine , 1998 .

[45]  Rollin J. Fairbanks,et al.  Cognitive systems engineering in health care , 2014 .

[46]  Emily Kilner,et al.  The role of teamwork and communication in the emergency department: a systematic review. , 2010, International emergency nursing.

[47]  P. Croskerry,et al.  Emergency medicine: A practice prone to error? , 2001, CJEM.

[48]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[49]  Kim J. Vicente,et al.  Integrating Task- and Work Domain-Based Work Analyses in Ecological Interface Design: A Process Control Case Study , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[50]  Shawna J Perry,et al.  An overlooked alliance: using human factors engineering to reduce patient harm. , 2004, Joint Commission journal on quality and safety.

[51]  Catherine M. Burns,et al.  Applications of cognitive work analysis , 2008 .