Medical Text Simplification by Medical Trainees: A Feasibility Study

Current healthcare practice is transitioning from a provider-centered model to a patient-centered model of care, where patients are no longer passive recipients of care, but are encouraged to actively engage in and take greater responsibility for medical decision-making. As part of this trend patients are gaining access to larger and more diverse sets of medical texts through Electronic Medical Record (EMR) systems (e.g., doctor's notes, discharge summaries, etc.). The availability of medical notes that are accurate and easily understandable for patients will be crucial for the success of this new care model. However, medical notes are primarily written for the purpose of providerto-provider communication and are generally difficult for lay persons to understand, especially those individuals with low health literacy. Thus, patients are not fully able to utilize this information due to linguistic and literacy barriers. Our ultimate goal is to develop a health IT intervention that addresses this gap by combining information technology with untapped human expertise, such as knowledge held by medical students and other trainees. This paper describes an initial feasibility study to determine whether medical trainees have sufficient expertise to convert medical reports into understandable, everyday language. We measure the effect of simplifications on objective comprehensibility, patient preferences, and then relate the outcome to linguistic characteristics of the texts. Our results show that comprehensibility improves substantially even without prior task-specific training of medical students, and that studentgenerated simplifications are strongly preferred over the original medical texts.

[1]  David Kauchak,et al.  User Evaluation of the Effects of a Text Simplification Algorithm Using Term Familiarity on Perception, Understanding, Learning, and Information Retention , 2013, Journal of medical Internet research.

[2]  Rudolf Franz Flesch,et al.  How to write plain English : a book for lawyers and consumers , 1979 .

[4]  Joann G Elmore,et al.  Inviting Patients to Read Their Doctors' Notes: Patients and Doctors Look Ahead , 2011, Annals of Internal Medicine.

[5]  Alla Keselman,et al.  Beyond Surface Characteristics: A New Health Text-Specific Readability Measurement , 2007, AMIA.

[6]  Susan S Woods,et al.  Patient Experiences With Full Electronic Access to Health Records and Clinical Notes Through the My HealtheVet Personal Health Record Pilot: Qualitative Study , 2013, Journal of medical Internet research.

[7]  Jeffrey Kristan,et al.  Using online crowdsourcing to understand young adult attitudes toward expert-authored messages aimed at reducing hazardous alcohol consumption and to collect peer-authored messages , 2015, Translational behavioral medicine.

[8]  Serguei V. S. Pakhomov,et al.  Automated Disambiguation of Acronyms and Abbreviations in Clinical Texts: Window and Training Size Considerations , 2012, AMIA.

[9]  D. DeWalt,et al.  A heart failure self-management program for patients of all literacy levels: A randomized, controlled trial [ISRCTN11535170] , 2006, BMC Health Services Research.

[10]  Joann G. Elmore,et al.  The road toward fully transparent medical records. , 2014, The New England journal of medicine.

[11]  Sigrid Harendza,et al.  Translating medical documents into plain language enhances communication skills in medical students--A pilot study. , 2015, Patient education and counseling.

[12]  Bei Yu,et al.  Crowdsourcing Participatory Evaluation of Medical Pictograms Using Amazon Mechanical Turk , 2013, Journal of medical Internet research.

[13]  Qing Zeng-Treitler,et al.  Exploring and developing consumer health vocabularies. , 2006, Journal of the American Medical Informatics Association : JAMIA.

[14]  Qing Zeng-Treitler,et al.  Creating Consumer Friendly Health Content: Implementing and Testing a Readability Diagnosis and Enhancement Tool , 2013, 2013 46th Hawaii International Conference on System Sciences.

[15]  Gondy Leroy,et al.  The influence of text characteristics on perceived and actual difficulty of health information , 2010, Int. J. Medical Informatics.

[16]  Graciela Rosemblat,et al.  Text Features and Readability: Expert Evaluation of Consumer Health Text , 2006 .

[17]  Katrin Kirchhoff,et al.  A comparison of human and machine translation of health promotion materials for public health practice: time, costs, and quality. , 2014, Journal of public health management and practice : JPHMP.

[18]  Alla Keselman,et al.  Text Characteristics of Clinical Reports and Their Implications for the Readability of Personal Health Records , 2007, MedInfo.

[19]  Amittai Axelrod,et al.  Application of statistical machine translation to public health information: a feasibility study , 2011, J. Am. Medical Informatics Assoc..

[20]  M. Coleman,et al.  A computer readability formula designed for machine scoring. , 1975 .

[21]  Chen-Tan Lin,et al.  Review Paper: The Effects of Promoting Patient Access to Medical Records: A Review , 2003, J. Am. Medical Informatics Assoc..

[22]  David Kauchak,et al.  The effect of word familiarity on actual and perceived text difficulty. , 2014, Journal of the American Medical Informatics Association : JAMIA.

[23]  Gondy Leroy,et al.  Term Familiarity to Indicate Perceived and Actual Difficulty of Text in Medical Digital Libraries , 2011, ICADL.

[24]  Maria Skeppstedt,et al.  Synonym extraction and abbreviation expansion with ensembles of semantic spaces , 2014, Journal of Biomedical Semantics.

[25]  E. Boyko,et al.  Brief questions to identify patients with inadequate health literacy. , 2004, Family medicine.

[26]  Genevieve B. Melton,et al.  Challenges and Practical Approaches with Word Sense Disambiguation of Acronyms and Abbreviations in the Clinical Domain , 2015, Healthcare informatics research.

[27]  Edith G. Smit,et al.  Should We Be Afraid of Simple Messages? The Effects of Text Difficulty and Illustrations in People With Low or High Health Literacy , 2015, Health communication.

[28]  Joann G Elmore,et al.  Inviting Patients to Read Their Doctors' Notes: A Quasi-experimental Study and a Look Ahead , 2011, Annals of Internal Medicine.