Latent Representation Learning for Alzheimer’s Disease Diagnosis With Incomplete Multi-Modality Neuroimaging and Genetic Data

The fusion of complementary information contained in multi-modality data [e.g., magnetic resonance imaging (MRI), positron emission tomography (PET), and genetic data] has advanced the progress of automated Alzheimer’s disease (AD) diagnosis. However, multi-modality based AD diagnostic models are often hindered by the missing data, i.e., not all the subjects have complete multi-modality data. One simple solution used by many previous studies is to discard samples with missing modalities. However, this significantly reduces the number of training samples, thus leading to a sub-optimal classification model. Furthermore, when building the classification model, most existing methods simply concatenate features from different modalities into a single feature vector without considering their underlying associations. As features from different modalities are often closely related (e.g., MRI and PET features are extracted from the same brain region), utilizing their inter-modality associations may improve the robustness of the diagnostic model. To this end, we propose a novel latent representation learning method for multi-modality based AD diagnosis. Specifically, we use all the available samples (including samples with incomplete modality data) to learn a latent representation space. Within this space, we not only use samples with complete multi-modality data to learn a common latent representation, but also use samples with incomplete multi-modality data to learn independent modality-specific latent representations. We then project the latent representations to the label space for AD diagnosis. We perform experiments using 737 subjects from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database, and the experimental results verify the effectiveness of our proposed method.

[1]  Daoqiang Zhang,et al.  Relationship Induced Multi-Template Learning for Diagnosis of Alzheimer’s Disease and Mild Cognitive Impairment , 2016, IEEE Transactions on Medical Imaging.

[2]  A. Fagan,et al.  Multimodal techniques for diagnosis and prognosis of Alzheimer's disease , 2009, Nature.

[3]  Dinggang Shen,et al.  Adversarial Similarity Network for Evaluating Image Alignment in Deep Learning Based Registration , 2018, MICCAI.

[4]  Jason H. Moore,et al.  Alzheimer's Disease Neuroimaging Initiative biomarkers as quantitative phenotypes: Genetics core aims, progress, and plans , 2010, Alzheimer's & Dementia.

[5]  Seong-Whan Lee,et al.  Latent feature representation with stacked auto-encoder for AD/MCI diagnosis , 2013, Brain Structure and Function.

[6]  Dinggang Shen,et al.  Brain-Wide Genome-Wide Association Study for Alzheimer's Disease via Joint Projection Learning and Sparse Regression Model , 2019, IEEE Transactions on Biomedical Engineering.

[7]  Ehsan Adeli,et al.  A Hierarchical Feature and Sample Selection Framework and Its Application for Alzheimer’s Disease Diagnosis , 2017, Scientific Reports.

[8]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[9]  Yong Xu,et al.  Incomplete Multi-view Clustering via Graph Regularized Matrix Factorization , 2018, ECCV Workshops.

[10]  Dinggang Shen,et al.  Knowledge-Guided Robust MRI Brain Extraction for Diverse Large-Scale Neuroimaging Studies on Humans and Non-Human Primates , 2014, PloS one.

[11]  Daoqiang Zhang,et al.  Temporally Constrained Group Sparse Learning for Longitudinal Data Analysis in Alzheimer's Disease , 2017, IEEE Transactions on Biomedical Engineering.

[12]  Dinggang Shen,et al.  CLASSIC: Consistent Longitudinal Alignment and Segmentation for Serial Image Computing , 2005, IPMI.

[13]  Dinggang Shen,et al.  Multi‐channel multi‐scale fully convolutional network for 3D perivascular spaces segmentation in 7T MR images , 2018, Medical Image Anal..

[14]  Eric Westman,et al.  Combining MRI and CSF measures for classification of Alzheimer's disease and prediction of mild cognitive impairment conversion , 2012, NeuroImage.

[15]  R. Gur,et al.  Unaffected Family Members and Schizophrenia Patients Share Brain Structure Patterns: A High-Dimensional Pattern Classification Study , 2008, Biological Psychiatry.

[16]  D. Blacker,et al.  Systematic meta-analyses of Alzheimer disease genetic association studies: the AlzGene database , 2007, Nature Genetics.

[17]  W. Thies,et al.  2013 Alzheimer's disease facts and figures , 2013, Alzheimer's & Dementia.

[18]  Dinggang Shen,et al.  Joint Robust Imputation and Classification for Early Dementia Detection Using Incomplete Multi-modality Data , 2018, PRIME@MICCAI.

[19]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[20]  Alzheimer's Disease Neuroimaging Initiative,et al.  Genome-wide association study in different clinical stages of Alzheimer’s disease , 2015, Alzheimer's & Dementia.

[21]  Andrew J. Saykin,et al.  Increased brain activation during working memory in cognitively intact adults with the APOE ε4 allele , 2006 .

[22]  Alan C. Evans,et al.  3D Anatomical Atlas of the Human Brain , 1998, NeuroImage.

[23]  Paul M. Thompson,et al.  Bi-level multi-source learning for heterogeneous block-wise missing data , 2014, NeuroImage.

[24]  Shao-Yuan Li,et al.  Partial Multi-View Clustering , 2014, AAAI.

[25]  Shiqian Ma,et al.  Fixed point and Bregman iterative methods for matrix rank minimization , 2009, Math. Program..

[26]  Daoqiang Zhang,et al.  Human cell structure-driven model construction for predicting protein subcellular location from biological images , 2015, Bioinform..

[27]  Dinggang Shen,et al.  Multi-modal Neuroimaging Data Fusion via Latent Space Learning for Alzheimer's Disease Diagnosis , 2018, PRIME@MICCAI.

[28]  Yi Ma,et al.  The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices , 2010, Journal of structural biology.

[29]  G. Sapiro,et al.  A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo-electron tomography. , 2013, Journal of structural biology.

[30]  Shuiwang Ji,et al.  SLEP: Sparse Learning with Efficient Projections , 2011 .

[31]  Daoqiang Zhang,et al.  Hierarchical fusion of features and classifier decisions for Alzheimer's disease diagnosis , 2014, Human brain mapping.

[32]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[33]  H. Soininen,et al.  Hippocampus and entorhinal cortex in mild cognitive impairment and early AD , 2004, Neurobiology of Aging.

[34]  Dinggang Shen,et al.  Conversion and time‐to‐conversion predictions of mild cognitive impairment using low‐rank affinity pursuit denoising and matrix completion , 2018, Medical Image Anal..

[35]  C. Jack,et al.  Effectiveness of regional DTI measures in distinguishing Alzheimer's disease, MCI, and normal aging☆ , 2013, NeuroImage: Clinical.

[36]  Dinggang Shen,et al.  Effective feature learning and fusion of multimodality data using stage‐wise deep neural network for dementia diagnosis , 2018, Human brain mapping.

[37]  Dinggang Shen,et al.  HAMMER: hierarchical attribute matching mechanism for elastic registration , 2002, IEEE Transactions on Medical Imaging.

[38]  Dinggang Shen,et al.  Multi‐task diagnosis for autism spectrum disorders using multi‐modality features: A multi‐center study , 2017, Human brain mapping.

[39]  Dinggang Shen,et al.  Subspace Regularized Sparse Multitask Learning for Multiclass Neurodegenerative Disease Identification , 2016, IEEE Transactions on Biomedical Engineering.

[40]  J. Ramírez,et al.  Feature selection using factor analysis for Alzheimer's diagnosis using 18F-FDG PET images. , 2010, Medical physics.

[41]  John Shawe-Taylor,et al.  Canonical Correlation Analysis: An Overview with Application to Learning Methods , 2004, Neural Computation.

[42]  Dinggang Shen,et al.  Structured Sparse Kernel Learning for Imaging Genetics Based Alzheimer's Disease Diagnosis , 2016, MICCAI.

[43]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[44]  Daoqiang Zhang,et al.  Joint Binary Classifier Learning for ECOC-Based Multi-Class Classification , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Dinggang Shen,et al.  Neurodegenerative disease diagnosis using incomplete multi-modality data via matrix shrinkage and completion , 2014, NeuroImage.

[46]  Peter A. Bandettini,et al.  Does feature selection improve classification accuracy? Impact of sample size and feature selection on classification using anatomical magnetic resonance images , 2012, NeuroImage.

[47]  David J. Hand,et al.  A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems , 2001, Machine Learning.

[48]  Xingyu Wang,et al.  Temporally Constrained Sparse Group Spatial Patterns for Motor Imagery BCI , 2019, IEEE Transactions on Cybernetics.

[49]  Jie Yang,et al.  Robust Visual Tracking via Online Discriminative and Low-Rank Dictionary Learning , 2018, IEEE Transactions on Cybernetics.

[50]  Prateek Jain,et al.  Low-rank matrix completion using alternating minimization , 2012, STOC '13.

[51]  Taehyun Rhee,et al.  Low-Rank Matrix Completion to Reconstruct Incomplete Rendering Images , 2018, IEEE Transactions on Visualization and Computer Graphics.

[52]  Jianping Yin,et al.  Multiple Kernel Learning in the Primal for Multimodal Alzheimer’s Disease Classification , 2013, IEEE Journal of Biomedical and Health Informatics.

[53]  Yun Fu,et al.  Incomplete Multi-Modal Visual Data Grouping , 2016, IJCAI.

[54]  Jiayu Zhou,et al.  Modeling disease progression via multi-task learning , 2013, NeuroImage.

[55]  Dinggang Shen,et al.  View‐aligned hypergraph learning for Alzheimer's disease diagnosis with incomplete multi‐modality data , 2017, Medical Image Anal..

[56]  Paul M. Thompson,et al.  Multi-source feature learning for joint analysis of incomplete multiple heterogeneous neuroimaging data , 2012, NeuroImage.

[57]  A. Convit,et al.  Atrophy of the medial occipitotemporal, inferior, and middle temporal gyri in non-demented elderly predict decline to Alzheimer’s disease☆ , 2000, Neurobiology of Aging.

[58]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[59]  Daoqiang Zhang,et al.  Feature selection with effective distance , 2016, Neurocomputing.

[60]  Dazhe Zhao,et al.  Sparse shared structure based multi-task learning for MRI based cognitive performance prediction of Alzheimer's disease , 2017, Pattern Recognit..

[61]  Feiping Nie,et al.  Multi-View Clustering and Feature Learning via Structured Sparsity , 2013, ICML.

[62]  Gholam-Ali Hossein-Zadeh,et al.  Structured and Sparse Canonical Correlation Analysis as a Brain-Wide Multi-Modal Data Fusion Approach , 2017, IEEE Transactions on Medical Imaging.

[63]  Dinggang Shen,et al.  BIRNet: Brain image registration using dual‐supervised fully convolutional networks , 2018, Medical Image Anal..

[64]  Russ B. Altman,et al.  Missing value estimation methods for DNA microarrays , 2001, Bioinform..

[65]  Brian B. Avants,et al.  Dementia induces correlated reductions in white matter integrity and cortical thickness: A multivariate neuroimaging study with sparse canonical correlation analysis , 2010, NeuroImage.

[66]  Deng Cai,et al.  Laplacian Score for Feature Selection , 2005, NIPS.

[67]  Songcan Chen,et al.  Doubly Aligned Incomplete Multi-view Clustering , 2018, IJCAI.

[68]  Daniel Rueckert,et al.  Random forest-based similarity measures for multi-modal classification of Alzheimer's disease , 2013, NeuroImage.

[69]  Andrew J. Saykin,et al.  Genetic Interactions Explain Variance in Cingulate Amyloid Burden: An AV-45 PET Genome-Wide Association and Interaction Study in the ADNI Cohort , 2015, BioMed research international.