Hedging their Mets: The Use of Uncertainty Terms in Clinical Documents and its Potential Implications when Sharing the Documents with Patients

In this study, we quantified the use of uncertainty expressions, referred to as 'hedge' phrases, among a corpus of 100,000 clinical documents retrieved from our institution's electronic health record system. The frequency of each hedge phrase appearing in the corpus was characterized across document types and clinical departments. We also used a natural language processing tool to identify clinical concepts that were spatially, and potentially semantically, associated with the hedge phrases identified. The objective was to delineate the prevalence of hedge phrase usage in clinical documentation which may have a profound impact on patient care and provider-patient communication, and may become a source of unintended consequences when such documents are made directly accessible to patients via patient portals.

[1]  Peter L. Elkin,et al.  A controlled trial of automated classification of negation from clinical notes , 2005, BMC Medical Informatics Decis. Mak..

[2]  Mary M Christopher,et al.  Cytologic diagnosis: expression of probability by clinical pathologists. , 2004, Veterinary clinical pathology.

[3]  M. Ruffin,et al.  Patients' interpretation of qualitative probability statements. , 1994, Archives of family medicine.

[4]  Malcolm Galloway,et al.  The Interpretation of Phrases Used to Describe Uncertainty in Pathology Reports , 2011, Pathology research international.

[5]  Padmini Srinivasan,et al.  The Language of Bioscience: Facts, Speculations, and Statements In Between , 2004, HLT-NAACL 2004.

[6]  Hong Yu,et al.  Detecting hedge cues and their scope in biomedical text with conditional random fields , 2010, J. Biomed. Informatics.

[7]  M. Nakao,et al.  Numbers are better than words. Verbal specifications of frequency have no place in medicine. , 1983, The American journal of medicine.

[8]  Richard M Frankel,et al.  Is it good to express uncertainty to a patient? Correlates and consequences for medical students in a standardized patient visit. , 2009, Patient education and counseling.

[9]  P R Dear,et al.  How do parents of babies interpret qualitative expressions of probability? , 1990, Archives of disease in childhood.

[10]  Lauren Vogel.  OpenNotes Project “levels the playing field” between doctors and patients , 2010, Canadian Medical Association Journal.

[11]  Dale Guenter,et al.  Clinical uncertainty: helping our learners. , 2011, Canadian family physician Medecin de famille canadien.

[12]  R M Kenney,et al.  Between never and always. , 1981, The New England journal of medicine.

[13]  Joann G. Elmore,et al.  Open Notes: Doctors and Patients Signing On , 2010, Annals of Internal Medicine.

[14]  M. Biehl,et al.  Adolescents' and adults' understanding of probability expressions. , 2001, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[15]  Matthew S. McGlone,et al.  Anchoring in the interpretation of probability expressions , 1998 .

[16]  J. Levenkron,et al.  Does physician uncertainty affect patient satisfaction? , 1988, Journal of General Internal Medicine.

[17]  Ruth Beyth-Marom,et al.  How probable is probable? A numerical translation of verbal probability expressions , 1982 .

[18]  J. Merz,et al.  Patients' interpretations of verbal expressions of probability: implications for securing informed consent to medical interventions. , 1994, Behavioral sciences & the law.

[19]  Ramin Khorasani,et al.  Is terminology used effectively to convey diagnostic certainty in radiology reports? , 2003, Academic radiology.

[20]  B J O'Brien,et al.  Words or numbers? The evaluation of probability expressions in general practice. , 1989, The Journal of the Royal College of General Practitioners.

[21]  J. Toogood,et al.  WHAT DO WE MEAN BY "USUALLY"? , 1980, The Lancet.

[22]  János Csirik,et al.  The BioScope corpus: biomedical texts annotated for uncertainty, negation and their scopes , 2008, BMC Bioinformatics.

[23]  Junji Otaki,et al.  Interpretation of and preference for probability expressions among Japanese patients and physicians. , 2002, Family practice.

[24]  János Csirik,et al.  Proceedings of the Fourteenth Conference on Computational Natural Language Learning: Shared Task, CoNLL 2010, Uppsala, Sweden, July 15-16, 2010 , 2010, CoNLL Shared Task.

[25]  D H Hickam,et al.  Patients’ interpretations of probability terms , 1991, Journal of general internal medicine.

[26]  R E Mapes,et al.  Verbal and numerical estimates of probability in therapeutic contexts. , 1979, Social science & medicine.

[27]  Alan R. Aronson,et al.  An overview of MetaMap: historical perspective and recent advances , 2010, J. Am. Medical Informatics Assoc..

[28]  Özlem Uzuner,et al.  Machine learning and rule-based approaches to assertion classification. , 2009, Journal of the American Medical Informatics Association : JAMIA.

[29]  How medical professionals evaluate expressions of probability. , 1987, The New England journal of medicine.

[30]  J H Galla,et al.  Properdin deficiency with IgA nephropathy. , 1981, The New England journal of medicine.

[31]  Joann G Elmore,et al.  Inviting Patients to Read Their Doctors' Notes: Patients and Doctors Look Ahead , 2011, Annals of Internal Medicine.

[32]  Marion Danis,et al.  Patient Autonomy and the Challenge of Clinical Uncertainty , 2002, Kennedy Institute of Ethics journal.

[33]  Lynette Hirschman,et al.  The MITRE Identification Scrubber Toolkit: Design, training, and assessment , 2010, Int. J. Medical Informatics.

[34]  Debra A Swoboda.  Negotiating the diagnostic uncertainty of contested illnesses: physician practices and paradigms , 2008, Health.

[35]  Beverly A. Lewin,et al.  Hedging: an exploratory study of authors' and readers' identification of ‘toning down’ in scientific texts , 2005 .

[36]  Jane Ogden,et al.  Doctors expressions of uncertainty and patient confidence. , 2002, Patient education and counseling.

[37]  G. Gordon,et al.  Physician expressions of uncertainty during patient encounters. , 2000, Patient education and counseling.

[38]  Richard N. Shiffman,et al.  A Model of Ambiguity and Vagueness in Clinical Practice Guideline Recommendations , 2005, AMIA.

[39]  Elke U. Weber,et al.  Contextual Effects in the Interpretations of Probability Words: Perceived Base Rate and Severity of Events , 1990 .

[40]  M. Christopher,et al.  Interpretation by clinicians of probability expressions in cytology reports and effect on clinical decision-making. , 2010, Journal of veterinary internal medicine.

[41]  R Fuller,et al.  Risk communication and older people-understanding of probability and risk information by medical inpatients aged 75 years and older. , 2001, Age and ageing.

[42]  A K Dixon,et al.  Communication of doubt and certainty in radiological reports. , 2000, The British journal of radiology.

[43]  János Csirik,et al.  The CoNLL-2010 Shared Task: Learning to Detect Hedges and their Scope in Natural Language Text , 2010, CoNLL Shared Task.

[44]  Caroline Wellbery.  The value of medical uncertainty? , 2010, The Lancet.

[45]  Geoffrey R. Norman,et al.  Expressions of probability: words and numbers. , 1980 .

[46]  Marek J Druzdzel.  Verbal Uncertainty Expressions : Literature Review , 1989 .

[47]  Wibecke Brun,et al.  Verbal probabilities: Ambiguous, context-dependent, or both? , 1988 .

[48]  Alan R. Aronson,et al.  Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program , 2001, AMIA.

[49]  Thomas A. Brown,et al.  Quantifying Uncertainty into Numerical Probabilities for the Reporting of Intelligence , 1973 .

[50]  G R Norman,et al.  Expressions of probability: words and numbers. , 1980, The New England journal of medicine.

[51]  György Szarvas,et al.  Hedge Classification in Biomedical Texts with a Weakly Supervised Selection of Keywords , 2008, ACL.

[52]  Murilo Foppa,et al.  Limitations in the use of qualitative terms to inform diagnoses. , 2011, Archives of internal medicine.

[53]  Lei Yang,et al.  Voice-dictated versus typed-in clinician notes: linguistic properties and the potential implications on natural language processing. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[54]  M. Henry,et al.  Uncertainty, responsibility, and the evolution of the physician/patient relationship , 2006, Journal of Medical Ethics.

[55]  Erik Velldal,et al.  Predicting speculation: a simple disambiguation approach to hedge detection in biomedical literature , 2011, J. Biomed. Semant..

[56]  D. Timmermans,et al.  The Roles of Experience and Domain of Expertise in Using Numerical and Verbal Probability Terms in Medical Decisions , 1994, Medical decision making : an international journal of the Society for Medical Decision Making.

[57]  Liana Fraenkel,et al.  Uncertainty and patients' preferred role in decision making. , 2011, Patient education and counseling.