Fall Detection in EHR using Word Embeddings and Deep Learning

Electronic health records (EHR) are an important source of information to detect adverse events in patients. In-hospital fall incidents represent the largest category of adverse event reports. The detection of such incidents leads to better understanding of the event and improves the quality of patient health care. In this work, we evaluate several language models with state-of-the art recurrent neural networks (RNN) to detect fall incidents in progress notes. Our experiments show that the deep-learning approach outperforms previous works in the task of detecting fall events. Vector representation of words in the biomedical domain was able to detect falls with an F-Measure of 90%. Additionally, we made available an annotated dataset with 1,078 de-identified progress notes for replication purposes.

[1]  Roland Vollgraf,et al.  FLAIR: An Easy-to-Use Framework for State-of-the-Art NLP , 2019, NAACL.

[2]  Renata Vieira,et al.  An Initial Investigation of the Charlson Comorbidity Index Regression Based on Clinical Notes , 2018, 2018 IEEE 31st International Symposium on Computer-Based Medical Systems (CBMS).

[3]  Nathan Hartmann,et al.  Portuguese Word Embeddings: Evaluating on Word Analogies and Natural Language Tasks , 2017, STIL.

[4]  Zhenchao Jiang,et al.  Training word embeddings for deep learning in biomedical text mining tasks , 2015, 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[5]  Melissa J. Krauss,et al.  Characteristics and circumstances of falls in a hospital setting , 2004, Journal of General Internal Medicine.

[6]  Tao Yang,et al.  Word Embedding for Understanding Natural Language: A Survey , 2018 .

[7]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[8]  Tomas Mikolov,et al.  Enriching Word Vectors with Subword Information , 2016, TACL.

[9]  Dezon Finch,et al.  Finding falls in ambulatory care clinical documents using statistical text mining , 2013, J. Am. Medical Informatics Assoc..

[10]  John P. A. Ioannidis,et al.  Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review , 2017, J. Am. Medical Informatics Assoc..

[11]  S. Brunak,et al.  Mining electronic health records: towards better research applications and clinical care , 2012, Nature Reviews Genetics.

[12]  Roland Vollgraf,et al.  Pooled Contextualized Embeddings for Named Entity Recognition , 2019, NAACL.

[13]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[14]  Antonio Jimeno-Yepes,et al.  Knowledge-Based Biomedical Word Sense Disambiguation with Neural Concept Embeddings , 2016, 2017 IEEE 17th International Conference on Bioinformatics and Bioengineering (BIBE).

[15]  Shin-ichi Toyabe,et al.  Detecting inpatient falls by using natural language processing of electronic medical records , 2012, BMC Health Services Research.

[16]  D. Blumenthal,et al.  The benefits of health information technology: a review of the recent literature shows predominantly positive results. , 2011, Health affairs.

[17]  Hong Yu,et al.  Bidirectional RNN for Medical Event Detection in Electronic Health Records , 2016, NAACL.

[18]  Raj M. Ratwani,et al.  Identifying Harm Events in Clinical Care through Medical Narratives , 2017, BCB.

[19]  Gail Powell-Cope,et al.  Improving identification of fall-related injuries in ambulatory care using statistical text mining. , 2015, American journal of public health.

[20]  Monica Chiarini Tremblay,et al.  Identifying fall-related injuries: Text mining the electronic medical record , 2009, Inf. Technol. Manag..

[21]  Iryna Gurevych,et al.  WebAnno: A Flexible, Web-based and Visually Supported System for Distributed Annotations , 2013, ACL.

[22]  Ilya Sutskever,et al.  Language Models are Unsupervised Multitask Learners , 2019 .

[23]  Bradley V Watts,et al.  Identification of Inpatient Falls Using Automated Review of Text-Based Medical Records , 2016, Journal of patient safety.

[24]  D. Oliver,et al.  Preventing falls and fall injuries in hospital: a major risk management challenge , 2007 .

[25]  Stefan M. Rüger,et al.  Adverse Drug Reaction Classification With Deep Neural Networks , 2016, COLING.

[26]  Renata Vieira,et al.  DDC-Outlier: Preventing Medication Errors Using Unsupervised Learning , 2019, IEEE Journal of Biomedical and Health Informatics.

[27]  Kathryn H. Bowles,et al.  Mining fall-related information in clinical notes: Comparison of rule-based and novel word embedding-based machine learning approaches , 2019, J. Biomed. Informatics.

[28]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[29]  Cynthia Brandt,et al.  Classification of radiology reports for falls in an HIV study cohort , 2016, J. Am. Medical Informatics Assoc..