An Observation Tool for Studying Patient-oriented Workflow in Hospital Emergency Departments

BACKGROUND Studying workflow is a critical step in designing, implementing and evaluating informatics interventions in complex sociotechnical settings, such as hospital emergency departments (EDs). Known approaches to studying workflow in clinical settings attend to the activities of individual clinicians, thus being inadequate to characterize patient care as a cooperative work. OBJECTIVES The purpose of this paper is twofold. First, we introduce a novel, theory-driven patient-oriented workflow methodology, which better addresses the complex, multiple-provider nature of patient care. Second, we report the development of an observational tool and protocol for use in studies of this type, and the results of an evaluation study. METHODS We created a tablet computer implementation of an instrument to efficiently capture patient-oriented workflow, and evaluated it through a field study in three EDs. We focused on activities occurring over time during a single patient care episode as well as the roles of the ED staff members who conducted the activities. RESULTS The evidence generated supports the validity, viability, and reliability of the tool. The coverage of the tool in terms of activities and roles was satisfactory. The tool was able to capture the sequence of activity-role pairs for 108 patient care episodes. The inter-rater reliability assessment yielded a high kappa value (0.79). DISCUSSION The patient-oriented workflow methodology has the potential to facilitate modeling patient care in EDs by characterizing both roles and activities in sequence. The methodology also provides researchers and practitioners a more realistic and comprehensive workflow perspective that can inform the design, implementation and evaluation of health information technology interventions.

[1]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[2]  Kim M. Unertl,et al.  Traversing the many paths of workflow research: developing a conceptual framework of workflow terminology through a systematic literature review , 2010, J. Am. Medical Informatics Assoc..

[3]  B. Lomov The Problem of Activity in Psychology , 1982 .

[4]  Roger Bakeman,et al.  Observer agreement for event sequences: Methods and software for sequence alignment and reliability estimates , 2007, Behavior research methods.

[5]  Rachel Davis,et al.  Communication patterns in a UK emergency department. , 2007, Annals of emergency medicine.

[6]  Laurent Lecornu,et al.  Development framework for a patient-centered record , 2012, Comput. Methods Programs Biomed..

[7]  Stephen J. Wright,et al.  Optimizing financial effects of HIE: a multi-party linear programming approach , 2012, J. Am. Medical Informatics Assoc..

[8]  Todd R. Johnson,et al.  Interruptions in Workflow for RNs in a Level One Trauma Center , 2005, AMIA.

[9]  Michael X Cohen,et al.  Routines and Other Recurring Action Patterns of Organizations: Contemporary Research Issues , 1996 .

[10]  Yuchiao Chang,et al.  Increasing Operating Room Efficiency Through Parallel Processing , 2006, Annals of surgery.

[11]  Abdul V. Roudsari,et al.  Computerization of workflows, guidelines, and care pathways: a review of implementation challenges for process-oriented health information systems , 2011, J. Am. Medical Informatics Assoc..

[12]  Kees M. van Hee,et al.  Workflow Management: Models, Methods, and Systems , 2002, Cooperative information systems.

[13]  E Ammenwerth,et al.  The Time Needed for Clinical Documentation versus Direct Patient Care , 2009, Methods of Information in Medicine.

[14]  Rollin J Fairbanks,et al.  Emergency department communication links and patterns. , 2007, Annals of emergency medicine.

[15]  Kim M. Unertl,et al.  Research Paper: Describing and Modeling Workflow and Information Flow in Chronic Disease Care , 2009, J. Am. Medical Informatics Assoc..

[16]  J. C. Segen Concise dictionary of modern medicine , 2006 .

[17]  T. Bodenheimer,et al.  Can health care teams improve primary care practice? , 2004, JAMA.

[18]  Vimla L. Patel,et al.  Technology for Emergency Care: Cognitive and Workflow Considerations , 2006, AMIA.

[19]  Graham Kalton,et al.  Introduction to Survey Sampling , 1983 .

[20]  Madhu C. Reddy,et al.  Incorporating ideas from computer-supported cooperative work , 2004, J. Biomed. Informatics.

[21]  Carla Simone,et al.  Mind the Gap! Towards a Unified View of CSCW , 2000, COOP.

[22]  Philip Smith Roger Bakeman John M. Gottman , 1987, Animal Behaviour.

[23]  N. Lazaric The role of routines, rules and habits in collective learning: some epistemological and ontological considerations , 2000 .

[24]  Dominik Aronsky,et al.  Emergency physicians' behaviors and workload in the presence of an electronic whiteboard , 2005, Int. J. Medical Informatics.

[25]  Patricia Flatley Brennan,et al.  Revisiting sociotechnical systems in a case of unreported use of health information exchange system in three hospital emergency departments. , 2013, Journal of evaluation in clinical practice.

[26]  Shenyang Guo,et al.  Nonprobability Sampling in Social Work Research , 2004 .

[27]  Robert L. Wears,et al.  A Conceptual Framework for Studying the Safety of Transitions in Emergency Care , 2005 .

[28]  Kevin Crowston,et al.  Tools for inventing organizations: toward a handbook of organizational processes , 1993, [1993] Proceedings Second Workshop on Enabling Technologies@m_Infrastructure for Collaborative Enterprises.

[29]  L. Suchman Plans and situated actions , 1987 .

[30]  Jos Aarts,et al.  Patient-centered care requires a patient-oriented workflow model. , 2013, Journal of the American Medical Informatics Association : JAMIA.

[31]  Patricia Flatley Brennan,et al.  A concept analysis of phenomenon workflow. , 2008, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[32]  Emily S. Patterson,et al.  Research Paper: Improving Patient Safety by Identifying Side Effects from Introducing Bar Coding in Medication Administration , 2002, J. Am. Medical Informatics Assoc..

[33]  Blackford Middleton,et al.  Complementary methods of system usability evaluation: Surveys and observations during software design and development cycles , 2010, J. Biomed. Informatics.

[34]  Terrence J Adam,et al.  Systematic refinement of a health information technology time and motion workflow instrument for inpatient nursing care using a standardized interface terminology. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[35]  A. Viera,et al.  Understanding interobserver agreement: the kappa statistic. , 2005, Family medicine.

[36]  A. Abbott Sequence analysis: new methods for old ideas , 1995 .

[37]  Madhu C. Reddy,et al.  Coordinating heterogeneous work: Information and representation in medical care , 2001, ECSCW.

[38]  John Bowers,et al.  Workflow From Within and Without: Technology and Cooperative Work on the Print Industry Shopfloor , 1995, ECSCW.

[39]  W H Cordell,et al.  How do physicians and nurses spend their time in the emergency department? , 1998, Annals of emergency medicine.

[40]  M. Feldman,et al.  Reconceptualizing Organizational Routines as a Source of Flexibility and Change , 2003 .

[41]  John C. Morey,et al.  Error reduction and performance improvement in the emergency department through formal teamwork training: evaluation results of the MedTeams project. , 2002, Health services research.

[42]  S D Berns,et al.  The potential for improved teamwork to reduce medical errors in the emergency department. The MedTeams Research Consortium. , 1999, Annals of emergency medicine.

[43]  K. Yen,et al.  The effect of in-room registration on emergency department length of stay. , 2005, Annals of emergency medicine.

[44]  D. R. Heise,et al.  The Syntax of Social Life: The Theory and Method of Comparative Narratives. , 1989 .

[45]  Patricia Flatley Brennan,et al.  Characterizing patient care in hospital emergency departments , 2012 .

[46]  Kai Zheng,et al.  Quantifying the impact of health IT implementations on clinical workflow: a new methodological perspective , 2010, J. Am. Medical Informatics Assoc..

[47]  D. Coplen Types of Unintended Consequences Related to Computerized Provider Order Entry , 2007 .

[48]  Carla Simone,et al.  Coordination mechanisms: Towards a conceptual foundation of CSCW systems design , 1996, Computer Supported Cooperative Work (CSCW).

[49]  Vimla L. Patel,et al.  The multitasking clinician: Decision-making and cognitive demand during and after team handoffs in emergency care , 2007, Int. J. Medical Informatics.

[50]  B. Pentland,et al.  Organizational Routines as Grammars of Action , 1994 .

[51]  Vimla L. Patel,et al.  A framework for analyzing the cognitive complexity of computer-assisted clinical ordering , 2003, J. Biomed. Informatics.

[52]  Pascale Carayon,et al.  Evaluation of Nurse Interaction With Bar Code Medication Administration Technology in the Work Environment , 2007 .

[53]  Bonnie Kaplan,et al.  Review: Addressing Organizational Issues into the Evaluation of Medical Systems , 1997, J. Am. Medical Informatics Assoc..

[54]  Colin F. Mackenzie,et al.  Negotiation and conflict in large scale collaboration: a preliminary field study , 2006, Cognition, Technology & Work.

[55]  E. Thomas,et al.  Workflow in intensive care unit remote monitoring: A time-and-motion study* , 2007, Critical care medicine.

[56]  W H Cordell,et al.  Work interrupted: a comparison of workplace interruptions in emergency departments and primary care offices. , 2001, Annals of emergency medicine.

[57]  Eric G. Poon,et al.  Research Paper: The Extent and Importance of Unintended Consequences Related to Computerized Provider Order Entry , 2007, J. Am. Medical Informatics Assoc..

[58]  Stuart B. Boxerman,et al.  Describing Nurses' Work: Combining Quantitative and Qualitative Analysis , 2006, Hum. Factors.

[59]  Samer Faraj,et al.  What whiteboards in a trauma center operating suite can teach us about emergency department communication. , 2007, Annals of emergency medicine.

[60]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[61]  L. Whyte,et al.  The nursing process in the care of the mentally ill. , 1984, Nursing times.

[62]  Ben-Tzion Karsh,et al.  Work System Analysis: The Key to Understanding Health Care Systems , 2005 .

[63]  Gregory Makoul,et al.  Examining emergency department communication through a staff-based participatory research method: identifying barriers and solutions to meaningful change. , 2010, Annals of emergency medicine.