Eye-Tracking and Retrospective Verbal Protocol to Support Information Systems Design

As capabilities for storing and sharing electronic health data expand, it becomes increasingly important to classify, prioritize, and contextually link patient health data. Providers using electronic health records (EHR) complain that it is difficult for them to rapidly find information they need and that key information can be missed. Unfortunately, phases of human-centered design that support defining information needs and developing an understanding of the work environment are sometimes shortchanged. We present a knowledge elicitation approach for the purposes of supporting EHR design that combines the rich contextual data gained through recording information use activities during actual patient care followed by retrospective verbal protocol interviews of the provider as they watch and listen to playback of their information use activities. As a means of analyzing qualitative data collected through techniques such as these, we apply grounded theory based content analysis techniques. The goal of our research is the development of principles to support better organization and prioritization in the presentation of electronic health data. As a secondary objective, we also seek to identify criteria that, with computational algorithms, may be used to prioritize specific data in context to support intelligent contextualized information display. In this paper, we present details of our methods (data collection and analyses), preliminary findings that have resulted from these efforts, and specific advantages and disadvantages to our approach.

[1]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[2]  A. Russ,et al.  Healthcare Workers' Perceptions of Information in the Electronic Health Record , 2009 .

[3]  Vimla L. Patel,et al.  Usability testing in medical informatics: cognitive approaches to evaluation of information systems and user interfaces , 1997, AMIA.

[4]  Y. Donchin,et al.  A look into the nature and causes of human errors in the intensive care unit , 2022 .

[5]  Richard I. Cook,et al.  SPECIAL SECTION: Adapting to New Technology in the Operating Room , 1996, Hum. Factors.

[6]  Kaveh G Shojania,et al.  The impact of adverse events in the intensive care unit on hospital mortality and length of stay , 2008, BMC health services research.

[7]  Karen Holtzblatt,et al.  Contextual design , 1997, INTR.

[8]  Kim J. Vicente,et al.  Ecological interface design: theoretical foundations , 1992, IEEE Trans. Syst. Man Cybern..

[9]  Kim J. Vicente,et al.  Ecological Interface Design: Progress and Challenges , 2002, Hum. Factors.

[10]  Beth Crandall,et al.  Critical care physician cognitive task analysis: an exploratory study , 2009, Critical care.

[11]  N. Mack,et al.  Qualitative Research Methods Overview , 2005 .

[12]  Mica R. Endsley,et al.  Designing for Situation Awareness : An Approach to User-Centered Design , 2003 .

[13]  L. Lingard,et al.  Making sense of grounded theory in medical education , 2006, Medical education.

[14]  Jean-Blaise Wasserfallen,et al.  Human errors in a multidisciplinary intensive care unit: a 1-year prospective study , 2001, Intensive Care Medicine.

[15]  Noa Segall,et al.  Qualitative and Task Analytic Methods to Support Comprehensible Intelligent System Design , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[16]  C. Pope,et al.  Qualitative Research: Observational methods in health care settings , 1995, BMJ.

[17]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.

[18]  Abuse Humans and Automation : Use , Misuse , Disuse , , 2008 .

[19]  Marcus Watson,et al.  Designing for Attention With Sound: Challenges and Extensions to Ecological Interface Design , 2007, Hum. Factors.

[20]  K. Charmaz,et al.  Constructing Grounded Theory , 2014 .