Balancing volume and duration of information consumption by physicians: The case of health information exchange in critical care

BACKGROUND The realization of the potential benefits of health information exchange systems (HIEs) for emergency departments (EDs) depends on the way these systems are actually used. The attributes of volume of information and duration of information processing are important for the study of HIE use patterns in the ED, as cognitive load and time constraints may result in a trade-off between these attributes. Experts and non-experts often use different problem-solving strategies, which may be consequential for their system use patterns. Little previous research focuses on the trade-off between volume and duration of system use or on the factors that affect it, including user expertise. OBJECTIVES This study aims at exploring the trade-off of volume and duration of use, examining whether this relationship differs between experts and non-experts, and identifying factors that are associated with use patterns characterized by volume and duration. METHODS The research objectives are pursued in the context of critically-ill patients, treated at a busy ED in the period 2010-2012. The primary source of internal and external data is an HIE linked to 14 hospitals, over 1300 clinics, and other clinical facilities. We define four use profiles based on the attributes of duration and volume: quick and basic, quick and deep, slow and basic, and slow and deep. The volume and duration of use are computed using HIE log files as the number of screens and the time per screen, respectively. Each session is then classified into a specific profile based on distances from predefined profile centroids. Experts are physicians that are board-certified in emergency medicine. We test the distribution of use profiles and their associations with multiple variables that describe the patient, physician, situation, information available in the HIE system, and use dynamics within the encounter. RESULTS The quick and basic profile is the most prevalent. While available admission summaries are associated with quick and basic use, lab and imaging results are associated with slower or deeper use. Physicians who are the first to use the system or are sole users during an encounter are less inclined to quick and deep use. These effects are intensified for experts. DISCUSSION A trade-off between volume and duration is identified. While system use is overall similar for experts and non-experts, the circumstances in which a certain profile is more likely to be observed vary across these two groups. Information availability and multiple-physician dynamics within the encounter emerge as important for the prediction of use profiles. The findings of this study provide implications for the design, implementation, and research of HIE use.

[1]  Rajiv Kohli,et al.  Performance Impacts of Information Technology: Is Actual Usage the Missing Link? , 2003, Manag. Sci..

[2]  Diogo R. Ferreira,et al.  Business process analysis in healthcare environments: A methodology based on process mining , 2012, Inf. Syst..

[3]  K. T. Fong,et al.  Surgical team behaviors and patient outcomes. , 2009, American journal of surgery.

[4]  D. Blumenthal,et al.  Information technology comes to medicine. , 2007, The New England journal of medicine.

[5]  Mark E. Frisse,et al.  Estimated financial savings associated with health information exchange and ambulatory care referral , 2007, J. Biomed. Informatics.

[6]  Vimla L. Patel,et al.  The general and specific nature of medical expertise: A critical look. , 1991 .

[7]  Y. Tabak,et al.  An Automated Model to Identify Heart Failure Patients at Risk for 30-Day Readmission or Death Using Electronic Medical Record Data , 2010, Medical care.

[8]  Dustin Charles,et al.  Hospital electronic health information exchange grew substantially in 2008-12. , 2013, Health affairs.

[9]  Vimla L. Patel,et al.  Customizing clinical narratives for the electronic medical record interface using cognitive methods , 2006, Int. J. Medical Informatics.

[10]  Joshua R. Vest,et al.  Factors Associated with Health Information Exchange System Usage in a Safety-Net Ambulatory Care Clinic Setting , 2012, Journal of Medical Systems.

[11]  Vimla L. Patel,et al.  Review: A Primer on Aspects of Cognition for Medical Informatics , 2001, J. Am. Medical Informatics Assoc..

[12]  Nadir Weibel,et al.  Computational Ethnography: Automated and Unobtrusive Means for Collecting Data In Situ for Human–Computer Interaction Evaluation Studies , 2015 .

[13]  Gary Klein,et al.  Naturalistic Decision Making , 2008, Hum. Factors.

[14]  Vimla L. Patel,et al.  Emerging paradigms of cognition in medical decision-making , 2002, J. Biomed. Informatics.

[15]  J. R. Larson,et al.  Diagnosing groups: the pooling, management, and impact of shared and unshared case information in team-based medical decision making. , 1998, Journal of personality and social psychology.

[16]  William R. Hersh,et al.  BMC Medical Informatics and Decision Making , 2009 .

[17]  Carolyn Watters,et al.  A field study characterizing Web-based information-seeking tasks , 2007 .

[18]  Robert Cooley,et al.  The use of web structure and content to identify subjectively interesting web usage patterns , 2003, TOIT.

[19]  Joseph L. Kannry,et al.  Research Paper: Emergency Physicians' Perceptions of Health Information Exchange , 2007, J. Am. Medical Informatics Assoc..

[20]  Joshua R. Vest,et al.  Health information exchange: persistent challenges and new strategies , 2010, J. Am. Medical Informatics Assoc..

[21]  Dirk Van den Poel,et al.  Predicting online-purchasing behaviour , 2005, Eur. J. Oper. Res..

[22]  John W. Payne,et al.  Walking with the scarecrow: The information-processing approach to decision research. , 2008 .

[23]  S. Goodacre,et al.  Who waits longest in the emergency department and who leaves without being seen? , 2005, Emergency Medicine Journal.

[24]  et al.,et al.  How is the electronic health record being used? Use of EHR data to assess physician-level variability in technology use , 2014, J. Am. Medical Informatics Assoc..

[25]  S. Goodacre,et al.  Appropriate analysis and reporting of cluster randomised trials. , 2005, Emergency medicine journal : EMJ.

[26]  Lior Fink,et al.  The Effect of Organizational Factors on the Business Value of IT: Universalistic, Contingency, and Configurational Predictions , 2011, Inf. Syst. Manag..

[27]  Vimla L. Patel,et al.  Usability testing in medical informatics: cognitive approaches to evaluation of information systems and user interfaces , 1997, AMIA.

[28]  Kim M. Unertl,et al.  Health information exchange technology on the front lines of healthcare: workflow factors and patterns of use , 2011, J. Am. Medical Informatics Assoc..

[29]  Lior Fink,et al.  Use patterns of health information exchange systems and admission decisions: Reductionistic and configurational approaches , 2015, Int. J. Medical Informatics.

[30]  Ofir Ben-Assuli,et al.  Using Electronic Medical Record Systems for Admission Decisions in Emergency Departments: Examining the Crowdedness Effect , 2012, Journal of Medical Systems.

[31]  D. Bates,et al.  What Affects Clinicians’ Usage of Health Information Exchange? , 2011, Applied Clinical Informatics.

[32]  Vimla L. Patel,et al.  Research Paper: Impact of a Computer-based Patient Record System on Data Collection, Knowledge Organization, and Reasoning , 2000, J. Am. Medical Informatics Assoc..

[33]  Wendy W. Moe,et al.  The Influence of Goal‐Directed and Experiential Activities on Online Flow Experiences , 2003 .

[34]  Kim M. Unertl,et al.  Health information exchange usage in emergency departments and clinics: the who, what, and why , 2011, J. Am. Medical Informatics Assoc..

[35]  K. Baumlin,et al.  A Pilot Study on Usability Analysis of Emergency Department Information System by Nurses , 2012, Applied Clinical Informatics.

[36]  Amy Franklin,et al.  Comparing the information seeking strategies of residents, nurse practitioners, and physician assistants in critical care settings. , 2014, Journal of the American Medical Informatics Association : JAMIA.

[37]  José Manuel Ortega Egea,et al.  eHealth usage patterns of European general practitioners: A five-year (2002-2007) comparative study , 2010, Int. J. Medical Informatics.

[38]  D. Tabatabai,et al.  How experts and novices search the Web , 2005 .

[39]  H. Quan,et al.  Coding Algorithms for Defining Comorbidities in ICD-9-CM and ICD-10 Administrative Data , 2005, Medical care.

[40]  David W. Bates,et al.  Health information exchange and patient safety , 2007, J. Biomed. Informatics.

[41]  David Andreoff Evans,et al.  Cognitive Science in Medicine: Biomedical Modeling , 1989 .

[42]  Detmar W. Straub,et al.  Reconceptualizing System Usage: An Approach and Empirical Test , 2006, Inf. Syst. Res..

[43]  Joshua R. Vest,et al.  What should we measure? Conceptualizing usage in health information exchange , 2010, J. Am. Medical Informatics Assoc..

[44]  Ryen W. White,et al.  Characterizing the influence of domain expertise on web search behavior , 2009, WSDM '09.

[45]  W. Cordell,et al.  Emergency department workplace interruptions: are emergency physicians "interrupt-driven" and "multitasking"? , 2000, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[46]  J Marc Overhage,et al.  All health care is not local: an evaluation of the distribution of Emergency Department care delivered in Indiana. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[47]  J. Richards,et al.  Overcrowding in the nation's emergency departments: complex causes and disturbing effects. , 2000, Annals of emergency medicine.

[48]  Lior Fink,et al.  Use patterns of health information exchange through a multidimensional lens: Conceptual framework and empirical validation , 2014, J. Biomed. Informatics.

[49]  Joshua R. Vest,et al.  Factors motivating and affecting health information exchange usage , 2011, J. Am. Medical Informatics Assoc..

[50]  Kevin B. Johnson,et al.  Playing smallball: Approaches to evaluating pilot health information exchange systems , 2007, J. Biomed. Informatics.

[51]  Kyung-Sun Kim,et al.  Information-seeking on the Web: Effects of user and task variables , 2001 .

[52]  Joshua R. Vest,et al.  How are Health Professionals Using Health Information Exchange Systems? Measuring Usage for Evaluation and System Improvement , 2012, Journal of Medical Systems.

[53]  Joshua R. Vest,et al.  Use of a health information exchange system in the emergency care of children , 2011, BMC Medical Informatics Decis. Mak..

[54]  Martina A. Clarke,et al.  Determining differences in user performance between expert and novice primary care doctors when using an electronic health record (EHR). , 2014, Journal of evaluation in clinical practice.

[55]  David C. Chan,et al.  Improving safety and eliminating redundant tests: cutting costs in U.S. hospitals. , 2009, Health affairs.

[56]  Kim M. Unertl,et al.  The financial impact of health information exchange on emergency department care , 2011, J. Am. Medical Informatics Assoc..

[57]  Ling Li,et al.  Does an integrated Emergency Department Information System change the sequence of clinical work? A mixed-method cross-site study , 2014, Int. J. Medical Informatics.

[58]  James J. Cimino,et al.  Patterns of Usage for a Web-Based Clinical Information System , 2004, MedInfo.

[59]  Nicholas H. Lurie,et al.  Searching for Experience on the Web: An Empirical Examination of Consumer Behavior for Search and Experience Goods , 2009 .

[60]  George Hripcsak,et al.  Emergency Department Access to a Longitudinal Medical Record , 2007, J. Am. Medical Informatics Assoc..

[61]  A. Stiell,et al.  Prevalence of information gaps in the emergency department and the effect on patient outcomes. , 2003, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[62]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[63]  Joyce J. Elam,et al.  A Comparative Study of How Experts and Novices Use a Decision Aid to Solve Problems in Complex Knowledge Domains , 1992, Inf. Syst. Res..

[64]  Jason S Shapiro,et al.  Health Information Exchange in Emergency Medicine. , 2016, Annals of emergency medicine.

[65]  L. McCaig,et al.  Analysis of ambulance transports and diversions among US emergency departments. , 2006, Annals of emergency medicine.

[66]  G. Kuperman,et al.  Approaches to patient health information exchange and their impact on emergency medicine. , 2006, Annals of emergency medicine.

[67]  Ofir Ben-Assuli,et al.  The impact of EHR and HIE on reducing avoidable admissions: controlling main differential diagnoses , 2013, BMC Medical Informatics and Decision Making.

[68]  L. Lemieux-Charles,et al.  What Do We Know about Health Care Team Effectiveness? A Review of the Literature , 2006, Medical care research and review : MCRR.

[69]  A. Tsui,et al.  Configurational Approaches to Organizational Analysis , 1993 .

[70]  V. Govindarajan.  A Contingency Approach to Strategy Implementation at the Business-Unit Level: Integrating Administrative Mechanisms with Strategy , 1988 .

[71]  K. Mandl,et al.  Patients treated at multiple acute health care facilities: quantifying information fragmentation. , 2010, Archives of internal medicine.

[72]  D. Blumenthal,et al.  The "meaningful use" regulation for electronic health records. , 2010, The New England journal of medicine.

[73]  Anders Grimsmo,et al.  Instant availability of patient records, but diminished availability of patient information: A multi-method study of GP's use of electronic patient records , 2008, BMC Medical Informatics Decis. Mak..

[74]  Shin-Yuan Hung,et al.  Expert versus novice use of the executive support systems: an empirical study , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[76]  Jane M. Mackay,et al.  An Empirical Investigation of the Effects of Decision Aids on Problem-Solving Processes* , 1992 .

[77]  Jaideep Srivastava,et al.  Web usage mining: discovery and applications of usage patterns from Web data , 2000, SKDD.

[78]  Rolph E. Anderson,et al.  Multivariate Data Analysis (7th ed. , 2009 .

[79]  Peter Williams,et al.  Establishing metrics for the evaluation of touch screen kiosks , 2001, J. Inf. Sci..

[80]  V L Patel,et al.  Developmental accounts of the transition from medical student to doctor: some problems and suggestions , 1991, Medical education.

[81]  Vimla L. Patel,et al.  Diagnostic Reasoning and Medical Expertise , 1994 .

[82]  Shira Elqayam,et al.  Evaluation of Physicians’ Cognitive Styles , 2014, Medical decision making : an international journal of the Society for Medical Decision Making.

[83]  Ofir Ben-Assuli,et al.  EHR in Emergency Rooms: Exploring the Effect of Key Information Components on Main Complaints , 2014, Journal of Medical Systems.