Deep Learning for Electronic Health Records Analytics

Recent technological advancements have led to a deluge of medical data from various domains. However, the recorded data from divergent sources comes poorly annotated, noisy, and unstructured. Hence, the data is not fully leveraged to establish actionable insights that can be used in clinical applications. These data recorded in hospital’s Electronic Health Records (EHR) consists of patient information, clinical notes, charted events, medications, procedures, laboratory test results, diagnosis codes, and so on. Traditional machine learning and statistical methods have failed to offer insights that can be used by physicians to treat patients as they need to obtain an expert opinion assisted features before building a benchmark task model. With the rise of deep learning methods, there is a need to understand how deep learning can save lives. The purpose of this study was to offer an intuitive explanation for possible use cases of deep learning with EHR. We reflect on techniques that can be applied by health informatics professionals by giving technical intuitions and blue prints on how each clinical task can be approached by a deep learning algorithm.

[1]  Robert E. Schapire,et al.  Explaining AdaBoost , 2013, Empirical Inference.

[2]  D. Dimitrov.  Medical Internet of Things and Big Data in Healthcare , 2016, Healthcare informatics research.

[3]  Georg Langs,et al.  Unsupervised Pre-training Across Image Domains Improves Lung Tissue Classification , 2014, MCV.

[4]  Samuel H. Hawkins,et al.  Deep Feature Transfer Learning in Combination with Traditional Features Predicts Survival Among Patients with Lung Adenocarcinoma , 2016, Tomography.

[5]  Stefan M. Rüger,et al.  Adverse Drug Reaction Classification With Deep Neural Networks , 2016, COLING.

[6]  Gene H. Golub,et al.  Singular value decomposition and least squares solutions , 1970, Milestones in Matrix Computation.

[7]  Li Li,et al.  Automated disease cohort selection using word embeddings from Electronic Health Records , 2018, PSB.

[8]  Fei Wang,et al.  Deep learning for healthcare: review, opportunities and challenges , 2018, Briefings Bioinform..

[9]  Peter Szolovits,et al.  The Use of Autoencoders for Discovering Patient Phenotypes , 2017, ArXiv.

[10]  Jimeng Sun,et al.  Medical Concept Representation Learning from Electronic Health Records and its Application on Heart Failure Prediction , 2016, ArXiv.

[11]  Magdy Bayoumi,et al.  Automatic epileptic seizure detection based on empirical mode decomposition and deep neural network , 2018, 2018 IEEE 14th International Colloquium on Signal Processing & Its Applications (CSPA).

[12]  Hongfang Liu,et al.  CLAMP – a toolkit for efficiently building customized clinical natural language processing pipelines , 2017, J. Am. Medical Informatics Assoc..

[13]  Yan Liu,et al.  Distilling Knowledge from Deep Networks with Applications to Healthcare Domain , 2015, ArXiv.

[14]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Charles Elkan,et al.  Learning to Diagnose with LSTM Recurrent Neural Networks , 2015, ICLR.

[16]  Leonid Karlinsky,et al.  A Region Based Convolutional Network for Tumor Detection and Classification in Breast Mammography , 2016, LABELS/DLMIA@MICCAI.

[17]  Barbara J. Grosz,et al.  Natural-Language Processing , 1982, Artificial Intelligence.

[18]  Ying Liu,et al.  Deep Reinforcement Learning for Dynamic Treatment Regimes on Medical Registry Data , 2017, 2017 IEEE International Conference on Healthcare Informatics (ICHI).

[19]  Anne E Carpenter,et al.  Opportunities and obstacles for deep learning in biology and medicine , 2017, bioRxiv.

[20]  Helder Araújo,et al.  Deep EndoVO: A recurrent convolutional neural network (RCNN) based visual odometry approach for endoscopic capsule robots , 2017, Neurocomputing.

[21]  Sukumar Mishra,et al.  Maintaining Security and Privacy in Health Care System Using Learning Based Deep-Q-Networks , 2018, Journal of Medical Systems.

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Richard C. Zink.  Detecting Safety Signals Among Adverse Events in Clinical Trials , 2018 .

[24]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[25]  Walter F. Stewart,et al.  Doctor AI: Predicting Clinical Events via Recurrent Neural Networks , 2015, MLHC.

[26]  Nedialko S. Nedialkov,et al.  Probabilistic Graphical Models and Deep Belief Networks for Prognosis of Breast Cancer , 2015, 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA).

[27]  Cui Tao,et al.  Correlating Lab Test Results in Clinical Notes with Structured Lab Data: A Case Study in HbA1c and Glucose , 2017, CRI.

[28]  Joel H. Saltz,et al.  Disease phenotyping using deep learning: A diabetes case study , 2018, ArXiv.

[29]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[30]  Priyanka Gupta,et al.  Transfer Learning for Clinical Time Series Analysis using Recurrent Neural Networks , 2018, ArXiv.

[31]  Wei Ma,et al.  RxNorm: prescription for electronic drug information exchange , 2005, IT Professional.

[32]  Joseph Picone,et al.  Gated recurrent networks for seizure detection , 2017, 2017 IEEE Signal Processing in Medicine and Biology Symposium (SPMB).

[33]  Massimo Iacoviello,et al.  Predicting mortality in patients with acute heart failure: Role of risk scores. , 2015, World journal of cardiology.

[34]  Guang-Zhong Yang,et al.  Deep Learning for Health Informatics , 2017, IEEE Journal of Biomedical and Health Informatics.

[35]  Atsushi Suzuki,et al.  Feature Extraction from Electronic Health Records of Diabetic Nephropathy Patients with Convolutioinal Autoencoder , 2018, AAAI Workshops.

[36]  Tara N. Sainath,et al.  Deep convolutional neural networks for LVCSR , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[37]  Anne Cocos,et al.  Deep learning for pharmacovigilance: recurrent neural network architectures for labeling adverse drug reactions in Twitter posts , 2017, J. Am. Medical Informatics Assoc..

[38]  Hong Yu,et al.  Bidirectional RNN for Medical Event Detection in Electronic Health Records , 2016, NAACL.

[39]  S. Mohamad R. Soroushmehr,et al.  Deep Learning in Pharmacogenomics: From Gene Regulation to Patient Stratification , 2018, Pharmacogenomics.

[40]  Ping Zhang,et al.  Risk Prediction with Electronic Health Records: A Deep Learning Approach , 2016, SDM.

[41]  Jimeng Sun,et al.  Using recurrent neural network models for early detection of heart failure onset , 2016, J. Am. Medical Informatics Assoc..

[42]  Kent A. Spackman,et al.  SNOMED RT: a reference terminology for health care , 1997, AMIA.

[43]  Philip S. Yu,et al.  Multi-Task Pharmacovigilance Mining from Social Media Posts , 2018, WWW.

[44]  Byung Bok Ahn.  The Compact 3 D Convolutional Neural Network for Medical Images , .

[45]  Sunghwan Sohn,et al.  Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications , 2010, J. Am. Medical Informatics Assoc..

[46]  Li Li,et al.  Deep Patient: An Unsupervised Representation to Predict the Future of Patients from the Electronic Health Records , 2016, Scientific Reports.

[47]  Weidong Zhou,et al.  Denoising Sparse Autoencoder-Based Ictal EEG Classification , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[48]  Yue Gao,et al.  A Stacked Sparse Autoencoder-Based Detector for Automatic Identification of Neuromagnetic High Frequency Oscillations in Epilepsy , 2018, IEEE Transactions on Medical Imaging.

[49]  Jaewoo Kang,et al.  Drug drug interaction extraction from the literature using a recursive neural network , 2018, PloS one.

[50]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[51]  Huifang Deng,et al.  Medical Image Classification Based on Deep Features Extracted by Deep Model and Statistic Feature Fusion with Multilayer Perceptron‬ , 2018, Comput. Intell. Neurosci..

[52]  B L Humphreys,et al.  The UMLS project: making the conceptual connection between users and the information they need. , 1993, Bulletin of the Medical Library Association.

[53]  Adler J. Perotte,et al.  Risk prediction for chronic kidney disease progression using heterogeneous electronic health record data and time series analysis , 2015, J. Am. Medical Informatics Assoc..

[54]  Nick Glozier,et al.  Impact of serious mental illness on surgical patient outcomes , 2018, ANZ journal of surgery.

[55]  Parisa Rashidi,et al.  Deep EHR: A Survey of Recent Advances in Deep Learning Techniques for Electronic Health Record (EHR) Analysis , 2017, IEEE Journal of Biomedical and Health Informatics.

[56]  Daniel J. Feller,et al.  Using Clinical Notes and Natural Language Processing for Automated HIV Risk Assessment , 2017, Journal of acquired immune deficiency syndromes.

[57]  Volker Tresp,et al.  Predicting Clinical Events by Combining Static and Dynamic Information Using Recurrent Neural Networks , 2016, 2016 IEEE International Conference on Healthcare Informatics (ICHI).

[58]  A. Stephen McGough,et al.  Stacked Denoising Autoencoders for Mortality Risk Prediction Using Imbalanced Clinical Data , 2018, 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA).

[59]  David Sontag,et al.  Multi-task Prediction of Disease Onsets from Longitudinal Laboratory Tests , 2016, MLHC.

[60]  Michael E. Miller,et al.  Electronic Health Records , 2014, Annals of Internal Medicine.

[61]  Kai Yang,et al.  SAFS: A deep feature selection approach for precision medicine , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[62]  Judea Pearl,et al.  Theoretical Impediments to Machine Learning With Seven Sparks from the Causal Revolution , 2018, WSDM.

[63]  Truyen Tran,et al.  Predicting healthcare trajectories from medical records: A deep learning approach , 2017, J. Biomed. Informatics.

[64]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[65]  Tu Bao Ho,et al.  Learning Treatment Regimens from Electronic Medical Records , 2018, PAKDD.

[66]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[67]  Pietro Cerveri,et al.  Stacked sparse autoencoder networks and statistical shape models for automatic staging of distal femur trochlear dysplasia , 2018, The international journal of medical robotics + computer assisted surgery : MRCAS.

[68]  S. Singh,et al.  Application of Artificial Neural Networks in Modern Drug Discovery Chapter – 6 published in Artificial Neural Network for Drug Design, Delivery and Disposition , 2015 .

[69]  Fei Wang,et al.  Combining Knowledge and Data Driven Insights for Identifying Risk Factors using Electronic Health Records , 2012, AMIA.

[70]  A. Burgun,et al.  Next generation phenotyping using narrative reports in a rare disease clinical data warehouse , 2018, Orphanet Journal of Rare Diseases.

[71]  Gregory N Nicola,et al.  Current procedural terminology; a primer , 2014, Journal of NeuroInterventional Surgery.

[72]  Daniel Dajun Zeng,et al.  Using deep learning to improve medication safety: the untapped potential of social media , 2017, Therapeutic advances in drug safety.

[73]  Sheng Yu,et al.  PheProb: probabilistic phenotyping using diagnosis codes to improve power for genetic association studies , 2018, J. Am. Medical Informatics Assoc..

[74]  David Sontag,et al.  Learning Low-Dimensional Representations of Medical Concepts , 2016, CRI.

[75]  Nigam H. Shah,et al.  The Effectiveness of Transfer Learning in Electronic Health Records Data , 2017, ICLR.

[76]  Vijayan K. Asari,et al.  Recurrent Residual Convolutional Neural Network based on U-Net (R2U-Net) for Medical Image Segmentation , 2018, ArXiv.

[77]  Gregory D. Hager,et al.  Adversarial deep structured nets for mass segmentation from mammograms , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[78]  R. Fetter,et al.  Diagnosis related groups: product line management within hospitals. , 1986, Academy of management review. Academy of Management.

[79]  Vivek Kumar Singh,et al.  Conditional Generative Adversarial and Convolutional Networks for X-ray Breast Mass Segmentation and Shape Classification , 2018, MICCAI.

[80]  Guillaume Lample,et al.  Neural Architectures for Named Entity Recognition , 2016, NAACL.

[81]  Jimeng Sun,et al.  Multi-layer Representation Learning for Medical Concepts , 2016, KDD.

[82]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..

[83]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[84]  Ayman M. Eldeib,et al.  Breast cancer classification using deep belief networks , 2016, Expert Syst. Appl..

[85]  Kai Yang,et al.  A Predictive Approach Using Deep Feature Learning for Electronic Medical Records: A Comparative Study , 2018, ArXiv.

[86]  Jessica M Franklin,et al.  Predicting Adherence to Chronic Disease Medications in Patients with Long-term Initial Medication Fills Using Indicators of Clinical Events and Health Behaviors , 2018, Journal of managed care & specialty pharmacy.

[87]  V. N. Slee,et al.  The International Classification of Diseases: ninth revision (ICD-9) , 1978, Annals of internal medicine.

[88]  Peter Szolovits,et al.  MIMIC-III, a freely accessible critical care database , 2016, Scientific Data.

[89]  George Hripcsak,et al.  Caveats for the use of operational electronic health record data in comparative effectiveness research. , 2013, Medical care.

[90]  Jimeng Sun,et al.  Opportunities and challenges in developing deep learning models using electronic health records data: a systematic review , 2018, J. Am. Medical Informatics Assoc..

[91]  Abeed Sarker,et al.  Pharmacovigilance from social media: mining adverse drug reaction mentions using sequence labeling with word embedding cluster features , 2015, J. Am. Medical Informatics Assoc..

[92]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[93]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[94]  Daniel Rueckert,et al.  Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[95]  Son Doan,et al.  Application of information technology: MedEx: a medication information extraction system for clinical narratives , 2010, J. Am. Medical Informatics Assoc..

[96]  Svetha Venkatesh,et al.  Learning vector representation of medical objects via EMR-driven nonnegative restricted Boltzmann machines (eNRBM) , 2015, J. Biomed. Informatics.

[97]  Franck Dernoncourt,et al.  Comparing deep learning and concept extraction based methods for patient phenotyping from clinical narratives , 2018, PloS one.

[98]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[99]  T. Lasko,et al.  Computational Phenotype Discovery Using Unsupervised Feature Learning over Noisy, Sparse, and Irregular Clinical Data , 2013, PloS one.

[100]  Hong Yu,et al.  Overview of the First Natural Language Processing Challenge for Extracting Medication, Indication, and Adverse Drug Events from Electronic Health Record Notes (MADE 1.0) , 2019, Drug Safety.

[101]  Zachariah Zhang,et al.  Deep EHR: Chronic Disease Prediction Using Medical Notes , 2018, MLHC.

[102]  Pablo Lamata,et al.  Recurrent Fully Convolutional Neural Networks for Multi-slice MRI Cardiac Segmentation , 2016, RAMBO+HVSMR@MICCAI.

[103]  Olivier Bodenreider,et al.  The Unified Medical Language System (UMLS): integrating biomedical terminology , 2004, Nucleic Acids Res..

[104]  Weiguo Fan,et al.  A Deep Learning Based Named Entity Recognition Approach for Adverse Drug Events Identification and Extraction in Health Social Media , 2017, ICSH.

[105]  Slobodan Vucetic,et al.  EHR phenotyping via jointly embedding medical concepts and words into a unified vector space , 2018, BMC Medical Informatics and Decision Making.