Coupled Graph Convolutional Neural Networks for Text-Oriented Clinical Diagnosis Inference

Text-oriented clinical diagnosis inference is to predict a set of diagnoses for a specific patient given its medical notes. Due to the great potential of automatic diagnosis inference, machine learning methods have began to be applied to this domain. However, existing approaches focus on performing either labor-intensive feature engineering or sequential modeling of each medical note separately, without considering the information sharing among similar patients, which is essential for evidence-based medicine, an emerging new diagnosis process. Motivated by this issue and the recently proposed graph convolutional network (GCN) for text classification, we propose to apply GCN for the text-oriented clinical diagnosis inference task. To encode the comorbidity of diagnoses into the GCN model and allow information sharing between patients, we devise a coupled graph convolutional neural networks (CGCN), where a note-dependent graph and a label-dependent graph are learned collaboratively with hyperplane projection to ensure they are in the same semantic space. The comprehensive results on two real datasets show that our method outperforms the state-of-art methods in text-oriented diagnosis inference.

[1]  Zhiyuan Liu,et al.  Graph Neural Networks: A Review of Methods and Applications , 2018, AI Open.

[2]  Joan Bruna,et al.  Deep Convolutional Networks on Graph-Structured Data , 2015, ArXiv.

[3]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[4]  Oladimeji Farri,et al.  Condensed Memory Networks for Clinical Diagnostic Inferencing , 2016, AAAI.

[5]  Malik Yousef,et al.  One-Class SVMs for Document Classification , 2002, J. Mach. Learn. Res..

[6]  Jin Wang,et al.  Combining Knowledge with Deep Convolutional Neural Networks for Short Text Classification , 2017, IJCAI.

[7]  Jason Weston,et al.  Key-Value Memory Networks for Directly Reading Documents , 2016, EMNLP.

[8]  A. Zink,et al.  Comorbidities in Patients with Rheumatoid Arthritis and Their Association with Patient-reported Outcomes: Results of Claims Data Linked to Questionnaire Survey , 2019, The Journal of Rheumatology.

[9]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[10]  R. Jensen,et al.  Cluster headache is associated with unhealthy lifestyle and lifestyle-related comorbid diseases: Results from the Danish Cluster Headache Survey , 2018, Cephalalgia : an international journal of headache.

[11]  William G. Baxt,et al.  Use of an Artificial Neural Network for Data Analysis in Clinical Decision-Making: The Diagnosis of Acute Coronary Occlusion , 1990, Neural Computation.

[12]  Wei Zhang,et al.  Knowledge-Aware Deep Dual Networks for Text-Based Mortality Prediction , 2019, 2019 IEEE 35th International Conference on Data Engineering (ICDE).

[13]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[14]  Khalil Sima'an,et al.  Graph Convolutional Encoders for Syntax-aware Neural Machine Translation , 2017, EMNLP.

[15]  Philip Resnik,et al.  Political Ideology Detection Using Recursive Neural Networks , 2014, ACL.

[16]  D. Sackett,et al.  Evidence based medicine: what it is and what it isn't , 1996, BMJ.

[17]  Yuan Luo,et al.  Graph Convolutional Networks for Text Classification , 2018, AAAI.

[18]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[19]  Christopher D. Manning,et al.  Baselines and Bigrams: Simple, Good Sentiment and Topic Classification , 2012, ACL.

[20]  Jianxin Li,et al.  Large-Scale Hierarchical Text Classification with Recursively Regularized Deep Graph-CNN , 2018, WWW.

[21]  Charles Elkan,et al.  Learning to Diagnose with LSTM Recurrent Neural Networks , 2015, ICLR.

[22]  Elisabetta Binaghi A fuzzy logic inference model for a rule-based system in medical diagnosis , 1990 .

[23]  Guoyin Wang,et al.  Joint Embedding of Words and Labels for Text Classification , 2018, ACL.

[24]  Walter F. Stewart,et al.  Doctor AI: Predicting Clinical Events via Recurrent Neural Networks , 2015, MLHC.

[25]  Gordon H Guyatt,et al.  Progress in evidence-based medicine: a quarter century on , 2017, The Lancet.

[26]  Diyi Yang,et al.  Hierarchical Attention Networks for Document Classification , 2016, NAACL.

[27]  Anna Rumshisky,et al.  Unfolding physiological state: mortality modelling in intensive care units , 2014, KDD.

[28]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[29]  Josemir W Sander,et al.  Comorbidities of epilepsy: current concepts and future perspectives , 2016, The Lancet Neurology.

[30]  Noémie Elhadad,et al.  Multi-Label Classification of Patient Notes: Case Study on ICD Code Assignment , 2018, AAAI Workshops.

[31]  Peter Szolovits,et al.  MIMIC-III, a freely accessible critical care database , 2016, Scientific Data.

[32]  Yaohui Jin,et al.  Multi-Task Label Embedding for Text Classification , 2017, EMNLP.

[33]  Max Welling,et al.  Modeling Relational Data with Graph Convolutional Networks , 2017, ESWC.

[34]  Johannes Fürnkranz,et al.  Large-Scale Multi-label Text Classification - Revisiting Neural Networks , 2013, ECML/PKDD.

[35]  Jiayu Zhou,et al.  Graph convolutional networks for computational drug development and discovery , 2019, Briefings Bioinform..