Multi-View Based Multi-Model Learning for MCI Diagnosis

Mild cognitive impairment (MCI) is the early stage of Alzheimer’s disease (AD). Automatic diagnosis of MCI by magnetic resonance imaging (MRI) images has been the focus of research in recent years. Furthermore, deep learning models based on 2D view and 3D view have been widely used in the diagnosis of MCI. The deep learning architecture can capture anatomical changes in the brain from MRI scans to extract the underlying features of brain disease. In this paper, we propose a multi-view based multi-model (MVMM) learning framework, which effectively combines the local information of 2D images with the global information of 3D images. First, we select some 2D slices from MRI images and extract the features representing 2D local information. Then, we combine them with the features representing 3D global information learned from 3D images to train the MVMM learning framework. We evaluate our model on the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database. The experimental results show that our proposed model can effectively recognize MCI through MRI images (accuracy of 87.50% for MCI/HC and accuracy of 83.18% for MCI/AD).

[1]  Bin Hu,et al.  Alzheimer’s Disease Classification Based on Individual Hierarchical Networks Constructed With 3-D Texture Features , 2017, IEEE Transactions on NanoBioscience.

[2]  C. Jack,et al.  Alzheimer's Disease Neuroimaging Initiative , 2008 .

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  David S Knopman,et al.  Classification and epidemiology of MCI. , 2013, Clinics in geriatric medicine.

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Yi Pan,et al.  Classification of Alzheimer's Disease Using Whole Brain Hierarchical Network , 2018, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[7]  Yuan Ma,et al.  Voxel-Based Morphometry: Improving the Diagnosis of Alzheimer’s Disease Based on an Extreme Learning Machine Method from the ADNI cohort , 2019, Neuroscience.

[8]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Dinggang Shen,et al.  Deep ensemble learning of sparse regression models for brain disease diagnosis , 2017, Medical Image Anal..

[10]  Michael S. Ryoo,et al.  Representation Flow for Action Recognition , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Hervé Delingette,et al.  3D Convolutional Neural Networks for Tumor Segmentation using Long-range 2D Context , 2018, Comput. Medical Imaging Graph..

[12]  Loris Nanni,et al.  Texture descriptors and voxels for the early diagnosis of Alzheimer's disease , 2019, Artif. Intell. Medicine.

[13]  Hyunjin Park,et al.  Joint-Connectivity-Based Sparse Canonical Correlation Analysis of Imaging Genetics for Detecting Biomarkers of Parkinson’s Disease , 2020, IEEE Transactions on Medical Imaging.

[14]  Dinggang Shen,et al.  Inter-modality relationship constrained multi-modality multi-task feature selection for Alzheimer's Disease and mild cognitive impairment identification , 2014, NeuroImage.

[15]  Jun Fu,et al.  Dual Attention Network for Scene Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Rachna Jain,et al.  Convolutional neural network based Alzheimer’s disease classification from magnetic resonance brain images , 2019, Cognitive Systems Research.

[17]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[18]  Linda G. Shapiro,et al.  ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation , 2018, ECCV.

[19]  John G. Csernansky,et al.  Open Access Series of Imaging Studies (OASIS): Cross-sectional MRI Data in Young, Middle Aged, Nondemented, and Demented Older Adults , 2007, Journal of Cognitive Neuroscience.

[20]  Yang Zhang,et al.  Magnetic Source Imaging and Infant MEG: Current Trends and Technical Advances , 2019, Brain sciences.

[21]  Tara N. Sainath,et al.  State-of-the-Art Speech Recognition with Sequence-to-Sequence Models , 2017, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[23]  Christopher D. Manning,et al.  Effective Approaches to Attention-based Neural Machine Translation , 2015, EMNLP.

[24]  Nicola Amoroso,et al.  Multiplex Networks for Early Diagnosis of Alzheimer's Disease , 2018, Front. Aging Neurosci..

[25]  Jyoti Islam,et al.  Brain MRI analysis for Alzheimer’s disease diagnosis using an ensemble system of deep convolutional neural networks , 2018, Brain Informatics.

[26]  Yi Pan,et al.  Improving Alzheimer's Disease Classification by Combining Multiple Measures , 2018, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[27]  Yi Pan,et al.  Enhancing the feature representation of multi-modal MRI data by combining multi-view information for MCI classification , 2020, Neurocomputing.

[28]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[29]  Liang Chen,et al.  Self-supervised learning for medical image analysis using image context restoration , 2019, Medical Image Anal..

[30]  Guoyin Wang,et al.  Computer aided Alzheimer's disease diagnosis by an unsupervised deep learning technology , 2020, Neurocomputing.

[31]  Kei Yamada,et al.  Machine learning studies on major brain diseases: 5-year trends of 2014–2018 , 2018, Japanese Journal of Radiology.

[32]  Dinggang Shen,et al.  Landmark‐based deep multi‐instance learning for brain disease diagnosis , 2018, Medical Image Anal..

[33]  Nick C. Fox,et al.  Global and local gray matter loss in mild cognitive impairment and Alzheimer's disease , 2004, NeuroImage.

[34]  Christian Desrosiers,et al.  Deep Radiomic Analysis of MRI Related to Alzheimer’s Disease , 2018, IEEE Access.

[35]  Jimin Liang,et al.  Accurate Segmentation of Heart Volume in CTA With Landmark-Based Registration and Fully Convolutional Network , 2019, IEEE Access.

[36]  C. Jack,et al.  Qualitative estimates of medial temporal atrophy as a predictor of progression from mild cognitive impairment to dementia. , 2007, Archives of neurology.

[37]  Jin Liu,et al.  Applications of deep learning to MRI images: A survey , 2018, Big Data Min. Anal..

[38]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[39]  Massimo Filippi,et al.  Automated classification of Alzheimer's disease and mild cognitive impairment using a single MRI and deep neural networks , 2018, NeuroImage: Clinical.

[40]  M. Carrillo,et al.  Summary of the evidence on modifiable risk factors for cognitive decline and dementia: A population-based perspective , 2015, Alzheimer's & Dementia.

[41]  John Ashburner,et al.  A fast diffeomorphic image registration algorithm , 2007, NeuroImage.

[42]  Marcia Hon,et al.  Transfer Learning With Intelligent Training Data Selection for Prediction of Alzheimer’s Disease , 2019, IEEE Access.

[43]  Dewen Hu,et al.  Multi-Center Brain Imaging Classification Using a Novel 3D CNN Approach , 2018, IEEE Access.

[44]  Khaoula Ben Abdellafou,et al.  An improved machine learning technique based on downsized KPCA for Alzheimer's disease classification , 2018, Int. J. Imaging Syst. Technol..

[45]  M. Sharkas,et al.  Fetal Brain Abnormality Classification from MRI Images of Different Gestational Age , 2019, Brain sciences.

[46]  Kathryn Ziegler-Graham,et al.  Forecasting the global burden of Alzheimer’s disease , 2007, Alzheimer's & Dementia.

[47]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[48]  J. Guàrdia-Olmos,et al.  Using an Overlapping Time Interval Strategy to Study Diagnostic Instability in Mild Cognitive Impairment Subtypes , 2019, Brain sciences.

[49]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[50]  Michael W. Weiner,et al.  Worldwide Alzheimer’s Disease Neuroimaging Initiative , 2012, Alzheimer's & Dementia.

[51]  Xiangyu Wang,et al.  Ensemble of 3D densely connected convolutional network for diagnosis of mild cognitive impairment and Alzheimer's disease , 2019, Neurocomputing.

[52]  Mark E. Schmidt,et al.  The Alzheimer’s Disease Neuroimaging Initiative: A review of papers published since its inception , 2012, Alzheimer's & Dementia.

[53]  Jong Hun Kim,et al.  Diagnosis and prognosis of Alzheimer's disease using brain morphometry and white matter connectomes , 2018, NeuroImage: Clinical.

[54]  David Picard,et al.  2D/3D Pose Estimation and Action Recognition Using Multitask Deep Learning , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[55]  Kun Ho Lee,et al.  Early diagnosis of Alzheimer’s disease using combined features from voxel-based morphometry and cortical, subcortical, and hippocampus regions of MRI T1 brain images , 2019, PloS one.

[56]  D. Selkoe Alzheimer's disease. , 2011, Cold Spring Harbor perspectives in biology.

[57]  J. Baron,et al.  Relationships between Hippocampal Atrophy, White Matter Disruption, and Gray Matter Hypometabolism in Alzheimer's Disease , 2008, The Journal of Neuroscience.

[58]  N. Kaabouch,et al.  A Deep Learning approach for Diagnosis of Mild Cognitive Impairment Based on MRI Images , 2019, Brain sciences.

[59]  Pritee Khanna,et al.  Early detection of Alzheimer's disease using fusion techniques on 3D brain views , 2017, 2017 Conference on Information and Communication Technology (CICT).