Towards a Cardiology/EHR Interaction Workflow Usability Evaluation Method

Understanding physician cognitive workflow while using Electronic Health Records (EHRs) and how the user interface interaction can support cognitive workflow is essential to premium patient care. One way to further understand the relationship between physician cognitive workflow and the user interface is through usability evaluations. The purpose of this paper is to present, test and analyze a usability evaluation method that is robust and yet flexible enough to understand the complexity and needs of a physicians' cognitive workflow when using an EHR system. Further, our usability evaluation method was designed from the perspective of the physician, rather than an information technology perspective. Important contributions of this study are that we demonstrate a way to evaluate an EHR in the actual cardiac care setting and produce results that identify actionable and realistic system improvement recommendations.

[1]  Nicola T. Shaw,et al.  The impact of a Critical Care Information System (CCIS) on time spent charting and in direct patient care by staff in the ICU: A review of the literature , 2009, Int. J. Medical Informatics.

[2]  R. Niska,et al.  National Hospital Ambulatory Medical Care Survey: 2006 emergency department summary. , 2008, National health statistics reports.

[3]  John Dowell,et al.  A framework for human factors evaluation , 1991 .

[4]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[5]  J. Frankovich,et al.  Evidence-based medicine in the EMR era. , 2011, The New England journal of medicine.

[6]  Cathleen Wharton,et al.  The cognitive walkthrough method: a practitioner's guide , 1994 .

[7]  R. Niska,et al.  National Hospital Ambulatory Medical Care Survey: 2007 emergency department summary. , 2010, National health statistics reports.

[8]  Ann L. Fruhling,et al.  An Evaluation of the Usability of a Computerized Decision Support System for Nursing Homes , 2011, Applied Clinical Informatics.

[9]  Charlotte A. Weaver,et al.  Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA. , 2013, Journal of the American Medical Informatics Association : JAMIA.

[10]  S. J. Lewis,et al.  Health Information Technology—Results From a Roundtable Discussion , 2009, Journal of Managed Care Pharmacy : JMCP.

[11]  Andreas Holzinger,et al.  Usability engineering methods for software developers , 2005, CACM.

[12]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[13]  Emily S. Patterson,et al.  (NISTIR 7804) Technical Evaluation, Testing and Validation of the Usability of Electronic Health Records , 2012 .

[14]  Thomas H. Payne,et al.  Prescriber and staff perceptions of an electronic prescribing system in primary care: a qualitative assessment , 2010, BMC Medical Informatics Decis. Mak..

[15]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[16]  Vimla L. Patel,et al.  The multitasking clinician: Decision-making and cognitive demand during and after team handoffs in emergency care , 2007, Int. J. Medical Informatics.

[17]  Jeffery L. Belden,et al.  Defining and testing EMR usability: Principles and proposed methods of EMR usability evaluation and rating. , 2009 .

[18]  Jiajie Zhang,et al.  TURF: Toward a unified framework of EHR usability , 2011, J. Biomed. Informatics.

[19]  Nicolette de Keizer,et al.  The impact of computerized physician medication order entry in hospitalized patients - A systematic review , 2008, Int. J. Medical Informatics.

[20]  N. Woelfl,et al.  Adoption of Electronic Health Records , 2011, Applied Clinical Informatics.

[21]  C. Fink,et al.  Adenosine-stress dynamic real-time myocardial perfusion CT and adenosine-stress first-pass dual-energy myocardial perfusion CT for the assessment of acute chest pain: initial results. , 2012, European journal of radiology.

[22]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[23]  Lisa A. Grabenbauer,et al.  Electronic Health Record Adoption – Maybe It’s not about the Money , 2011, Applied Clinical Informatics.

[24]  Edward H. Kennedy,et al.  Use of health IT for higher-value critical care. , 2013, The New England journal of medicine.

[25]  D. Sackett,et al.  Evidence based medicine: what it is and what it isn't , 1996, BMJ.

[26]  Christophe Kolski,et al.  State of the Art on the Cognitive Walkthrough Method, Its Variants and Evolutions , 2010, Int. J. Hum. Comput. Interact..

[27]  Fabio Paternò,et al.  Automatic Support for Usability Evaluation , 1998, IEEE Trans. Software Eng..

[28]  Kim M. Unertl,et al.  Viewpoint Paper: Crossing the Implementation Chasm: A Proposal for Bold Action , 2008, J. Am. Medical Informatics Assoc..

[29]  Mark D. Huffman,et al.  Heart disease and stroke statistics--2013 update: a report from the American Heart Association. , 2013, Circulation.

[30]  Tom Carey,et al.  ACM SIGCHI Curricula for Human-Computer Interaction , 1992 .

[31]  Marita Franzke,et al.  Usability evaluation with the cognitive walkthrough , 1995, CHI 95 Conference Companion.

[32]  Vimla L. Patel,et al.  Usability testing in medical informatics: cognitive approaches to evaluation of information systems and user interfaces , 1997, AMIA.

[33]  Cathleen Wharton,et al.  Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces , 1990, CHI '90.

[34]  Robin Jeffries,et al.  User interface evaluation in the real world: a comparison of four techniques , 1991, CHI.

[35]  J. Kalus.  Health information technology--results from a roundtable discussion. , 2009 .

[36]  Jennifer Lai,et al.  Unintended Consequences of Information Technologies in Health Care—An Interactive Sociotechnical Analysis , 2007 .

[37]  Viswanath Venkatesh,et al.  Assessing a Firm's Web Presence: A Heuristic Evaluation Procedure for the Measurement of Usability , 2002, Inf. Syst. Res..

[38]  Mark D. Huffman,et al.  Executive summary: heart disease and stroke statistics--2013 update: a report from the American Heart Association. , 2013, Circulation.