Leveraging user's performance in reporting patient safety events by utilizing text prediction in narrative data entry

BACKGROUND Narrative data entry pervades computerized health information systems and serves as a key component in collecting patient-related information in electronic health records and patient safety event reporting systems. The quality and efficiency of clinical data entry are critical in arriving at an optimal diagnosis and treatment. The application of text prediction holds potential for enhancing human performance of data entry in reporting patient safety events. OBJECTIVE This study examined two functions of text prediction intended for increasing efficiency and data quality of text data entry reporting patient safety events. METHODS The study employed a two-group randomized design with 52 nurses. The nurses were randomly assigned into a treatment group or a control group with a task of reporting five patient fall cases in Chinese using a web-based test system, with or without the prediction functions. T-test, Chi-square and linear regression model were applied to evaluating the outcome differences in free-text data entry between the groups. RESULTS While both groups of participants exhibited a good capacity for accomplishing the assigned task of reporting patient falls, the results from the treatment group showed an overall increase of 70.5% in text generation rate, an increase of 34.1% in reporting comprehensiveness score and a reduction of 14.5% in the non-adherence of the comment fields. The treatment group also showed an increasing text generation rate over time, whereas no such an effect was observed in the control group. CONCLUSION As an attempt investigating the effectiveness of text prediction functions in reporting patient safety events, the study findings proved an effective strategy for assisting reporters in generating complementary free text when reporting a patient safety event. The application of the strategy may be effective in other clinical areas when free text entries are required.

[1]  John Eng,et al.  Informatics in Radiology (infoRAD): radiology report entry with automatic phrase completion driven by language modeling. , 2004, Radiographics : a review publication of the Radiological Society of North America, Inc.

[2]  Robyn Tamblyn,et al.  Review Paper: The Impact of Electronic Health Records on Time Efficiency of Physicians and Nurses: A Systematic Review , 2005, J. Am. Medical Informatics Assoc..

[3]  Nestor Garay-Vitoria,et al.  Text prediction systems: a survey , 2006, Universal Access in the Information Society.

[4]  Yang Gong,et al.  Text Prediction on Structured Data Entry in Healthcare , 2014, Applied Clinical Informatics.

[5]  J Allan,et al.  Patient-centered documentation: an effective and efficient use of clinical information systems. , 2000, The Journal of nursing administration.

[6]  Simon P. Levine,et al.  Effect of a word prediction feature on user performance , 1996 .

[7]  M. Harrison,et al.  Improving patient safety in hospitals: Contributions of high-reliability theory and normal accident theory. , 2006, Health services research.

[8]  Donald A. Norman,et al.  Cognitive artifacts , 1991 .

[9]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[10]  Lei Hua,et al.  Developing a User-centered Voluntary Medical Incident Reporting System , 2010, MedInfo.

[11]  R. William Soukoreff,et al.  Text entry for mobile computing: models and methods , 2002 .

[12]  L. Kohn,et al.  To Err Is Human : Building a Safer Health System , 2007 .

[13]  W. G. Cole,et al.  Metaphrase: An Aid to the Clinical Conceptualization and Formalization of Patient Problems in Healthcare Enterprises , 1998, Methods of Information in Medicine.

[14]  B Kaplan.  Reducing barriers to physician data entry for computer-based patient records. , 1994, Topics in health information management.

[15]  Lei Hua,et al.  Information Gaps in Reporting Patient Falls: the Challenges and Technical Solutions , 2013, CSHI.

[16]  Yang Gong,et al.  Terminology in a voluntary medical incident reporting system: a human-centered perspective , 2010, IHI.

[17]  Lei Hua,et al.  Design of a User-Centered Voluntary Patient Safety Reporting System: Understanding the Time and Response Variances by Retrospective Think-aloud Protocols , 2013, MedInfo.

[18]  Richard J. Holden,et al.  A Review of Medical Error Reporting System Design Considerations and a Proposed Cross-Level Systems Research Framework , 2007, Hum. Factors.

[19]  I. Scott MacKenzie,et al.  Text Entry for Mobile Computing: Models and Methods,Theory and Practice , 2002, Hum. Comput. Interact..

[20]  Janice Light,et al.  The effects of message encoding techniques on recall by literate adults using AAC systems , 1990 .

[21]  J. Lachin,et al.  Properties of permuted-block randomization in clinical trials. , 1988, Controlled clinical trials.

[22]  D. Hantula.  Sources of Power: How People Make Decisions , 2001 .

[23]  Yang Gong.  Data Consistency in a Voluntary Medical Incident Reporting System , 2009, Journal of Medical Systems.

[24]  Lei Hua,et al.  Usability Evaluation of a Voluntary Patient Safety Reporting System: Understanding the Difference between Predicted and Observed Time Values by Retrospective Think-Aloud Protocols , 2013, HCI.

[25]  Pierre Lewalle,et al.  Towards an International Classification for Patient Safety: the conceptual framework , 2009, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[26]  David W. Bates,et al.  Results of a survey on medical error reporting systems in Korean hospitals , 2006, Int. J. Medical Informatics.

[27]  Stephen H Walsh.  The clinician's perspective on electronic health records and how they can affect patient care , 2004, BMJ : British Medical Journal.

[28]  Kim Adams,et al.  The effect of context priming and task type on augmentative communication performance , 2009, Augmentative and alternative communication.

[29]  M Tamuz,et al.  Defining and classifying medical error: lessons for patient safety reporting systems , 2004, Quality and Safety in Health Care.

[30]  H H Koester,et al.  Learning and performance of able-bodied individuals using scanning systems with and without word prediction. , 1994, Assistive technology : the official journal of RESNA.

[31]  Sheri Hunnicutt,et al.  Improving word prediction using Markov models and Heuristic methods , 2001 .