A Wide and Deep Neural Network for Survival Analysis from Anatomical Shape and Tabular Clinical Data

We introduce a wide and deep neural network for prediction of progression from patients with mild cognitive impairment to Alzheimer's disease. Information from anatomical shape and tabular clinical data (demographics, biomarkers) are fused in a single neural network. The network is invariant to shape transformations and avoids the need to identify point correspondences between shapes. To account for right censored time-to-event data, i.e., when it is only known that a patient did not develop Alzheimer's disease up to a particular time point, we employ a loss commonly used in survival analysis. Our network is trained end-to-end to combine information from a patient's hippocampus shape and clinical biomarkers. Our experiments on data from the Alzheimer's Disease Neuroimaging Initiative demonstrate that our proposed model is able to learn a shape descriptor that augments clinical biomarkers and outperforms a deep neural network on shape alone and a linear model on common clinical biomarkers.

[1]  Adrian Preda,et al.  Multimodal and Multiscale Deep Neural Networks for the Early Diagnosis of Alzheimer’s Disease using structural MR and FDG-PET images , 2018, Scientific Reports.

[2]  C. Jack,et al.  Tracking pathophysiological processes in Alzheimer's disease: an updated hypothetical model of dynamic biomarkers , 2013, The Lancet Neurology.

[3]  David R. Cox,et al.  Regression models and life tables (with discussion , 1972 .

[4]  E Biganzoli,et al.  Feed forward neural networks for the analysis of censored survival data: a partial logistic regression approach. , 1998, Statistics in medicine.

[5]  Marie Chupin,et al.  Multidimensional classification of hippocampal shape features discriminates Alzheimer's disease and mild cognitive impairment from normal aging , 2009, NeuroImage.

[6]  Christian Wachinger,et al.  Deep Multi-Structural Shape Analysis: Application to Neuroanatomy , 2018, MICCAI.

[7]  Nick C Fox,et al.  The Diagnosis of Mild Cognitive Impairment due to Alzheimer’s Disease: Recommendations from the National Institute on Aging-Alzheimer’s Association Workgroups on Diagnostic Guidelines for Alzheimer’s Disease , 2011 .

[8]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[9]  F. Harrell,et al.  Evaluating the yield of medical tests. , 1982, JAMA.

[10]  Bruce Fischl,et al.  FreeSurfer , 2012, NeuroImage.

[11]  Clifford R. Jack,et al.  Time-to-event voxel-based techniques to assess regional atrophy associated with MCI risk of progression to AD , 2011, NeuroImage.

[12]  J. Morris,et al.  The diagnosis of dementia due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer's disease , 2011, Alzheimer's & Dementia.

[13]  R. Mayeux,et al.  Hippocampal and entorhinal atrophy in mild cognitive impairment , 2007, Neurology.

[14]  Tom Heskes,et al.  A neural-Bayesian approach to survival analysis , 1999 .

[15]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[16]  Li Yao,et al.  Prediction of Mild Cognitive Impairment Conversion Using a Combination of Independent Component Analysis and the Cox Model , 2017, Front. Hum. Neurosci..

[17]  Dinggang Shen,et al.  View‐aligned hypergraph learning for Alzheimer's disease diagnosis with incomplete multi‐modality data , 2017, Medical Image Anal..

[18]  K. Liestøl,et al.  Survival analysis and neural nets. , 1994, Statistics in medicine.

[19]  Dinggang Shen,et al.  Stability-Weighted Matrix Completion of Incomplete Multi-modal Data for Disease Diagnosis , 2016, MICCAI.

[20]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[21]  Martin Styner,et al.  Particle-Based Shape Analysis of Multi-object Complexes , 2008, MICCAI.

[22]  Rossana Ganzola,et al.  Mapping local hippocampal changes in Alzheimer's disease and normal ageing with MRI at 3 Tesla. , 2008, Brain : a journal of neurology.

[23]  R. Petersen Clinical practice. Mild cognitive impairment. , 2011, The New England journal of medicine.

[24]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[25]  B T Hyman,et al.  Temporoparietal MR Imaging Measures of Atrophy in Subjects with Mild Cognitive Impairment That Predict Subsequent Diagnosis of Alzheimer Disease , 2009, American Journal of Neuroradiology.

[26]  Kan Li,et al.  A prognostic model of Alzheimer's disease relying on multiple longitudinal measures and time-to-event data , 2018, Alzheimer's & Dementia.

[27]  R. Petersen,et al.  Mild cognitive impairment , 2006, The Lancet.

[28]  Alzheimer's Disease Neuroimaging Initiative,et al.  A point-based tool to predict conversion from mild cognitive impairment to probable Alzheimer's disease , 2014, Alzheimer's & Dementia.

[29]  Dinggang Shen,et al.  Latent Representation Learning for Alzheimer’s Disease Diagnosis With Incomplete Multi-Modality Neuroimaging and Genetic Data , 2019, IEEE Transactions on Medical Imaging.

[30]  Uri Shaham,et al.  DeepSurv: personalized treatment recommender system using a Cox proportional hazards deep neural network , 2016, BMC Medical Research Methodology.

[31]  Hucheng Zhou,et al.  Dual-Model Radiomic Biomarkers Predict Development of Mild Cognitive Impairment Progression to Alzheimer’s Disease , 2019, Front. Neurosci..

[32]  Denise C. Park,et al.  Toward defining the preclinical stages of Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease , 2011, Alzheimer's & Dementia.

[33]  M. Weiner,et al.  Automated MRI measures predict progression to Alzheimer's disease , 2010, Neurobiology of Aging.

[34]  Nassir Navab,et al.  Survival analysis for high-dimensional, heterogeneous medical data: Exploring feature extraction as an alternative to feature selection , 2016, Artif. Intell. Medicine.

[35]  Marie Chupin,et al.  Automatic classi fi cation of patients with Alzheimer ' s disease from structural MRI : A comparison of ten methods using the ADNI database , 2010 .

[36]  Z. Khachaturian Alzheimer's & Dementia: The Journal of the Alzheimer's Association , 2008, Alzheimer's & Dementia.

[37]  Ion Stoica,et al.  Tune: A Research Platform for Distributed Model Selection and Training , 2018, ArXiv.

[38]  O. Andreassen,et al.  Combining Polygenic Hazard Score With Volumetric MRI and Cognitive Measures Improves Prediction of Progression From Mild Cognitive Impairment to Alzheimer's Disease , 2018, Front. Neurosci..

[39]  Hasan Demirel,et al.  Classification of Alzheimer's disease and prediction of mild cognitive impairment-to-Alzheimer's conversion from structural magnetic resource imaging using feature ranking and a genetic algorithm , 2017, Comput. Biol. Medicine.

[40]  Brigitte Landeau,et al.  Using voxel-based morphometry to map the structural changes associated with rapid conversion in MCI: A longitudinal MRI study , 2005, NeuroImage.

[41]  D Faraggi,et al.  A neural network model for survival data. , 1995, Statistics in medicine.

[42]  J. Trojanowski,et al.  Integration and relative value of biomarkers for prediction of MCI to AD progression: Spatial patterns of brain atrophy, cognitive scores, APOE genotype and CSF biomarkers , 2013, NeuroImage: Clinical.

[43]  Harald Hampel,et al.  CSF total tau, Aβ42 and phosphorylated tau protein as biomarkers for Alzheimer’s disease , 2001, Molecular Neurobiology.

[44]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Sterling C. Johnson,et al.  Predicting Alzheimer’s disease progression using multi-modal deep learning approach , 2019, Scientific Reports.

[46]  Sterling C. Johnson,et al.  Multimodal and Multiscale Deep Neural Networks for the Early Diagnosis of Alzheimer's Disease using structural MR and FDG-PET images , 2017, ArXiv.

[47]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[48]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[49]  Daoqiang Zhang,et al.  Multi-modal multi-task learning for joint prediction of multiple regression and classification variables in Alzheimer's disease , 2012, NeuroImage.

[50]  for the Alzheimer’s Disease Neuroimaging Initiative Predicting Alzheimer’s disease progression using multi-modal deep learning approach , 2019 .

[51]  Heikki Huttunen,et al.  Machine learning framework for early MRI-based Alzheimer's conversion prediction in MCI subjects , 2015, NeuroImage.

[52]  K. Langa,et al.  The diagnosis and management of mild cognitive impairment: a clinical review. , 2014, JAMA.

[53]  Angelika Steger,et al.  A Model of Fast Hebbian Spike Latency Normalization , 2017, Front. Comput. Neurosci..

[54]  Stefan J. Teipel,et al.  The relative importance of imaging markers for the prediction of Alzheimer's disease dementia in mild cognitive impairment — Beyond classical regression , 2015, NeuroImage: Clinical.

[55]  D. Selkoe Alzheimer's disease. , 2011, Cold Spring Harbor perspectives in biology.

[56]  Teresa Wu,et al.  Use of multimodality imaging and artificial intelligence for diagnosis and prognosis of early stages of Alzheimer's disease , 2018, Translational research : the journal of laboratory and clinical medicine.

[57]  Daniel Rueckert,et al.  A Novel Grading Biomarker for the Prediction of Conversion From Mild Cognitive Impairment to Alzheimer's Disease , 2017, IEEE Transactions on Biomedical Engineering.

[58]  D. Salat,et al.  Whole-brain analysis reveals increased neuroanatomical asymmetries in dementia for hippocampus and amygdala. , 2016, Brain : a journal of neurology.

[59]  Christian Wachinger,et al.  Domain adaptation for Alzheimer's disease diagnostics , 2016, NeuroImage.

[60]  N. Foster,et al.  Metabolic reduction in the posterior cingulate cortex in very early Alzheimer's disease , 1997, Annals of neurology.