Multi-task Dictionary Learning Based on Convolutional Neural Networks for Longitudinal Clinical Score Predictions in Alzheimer's Disease

Computer-aided diagnosis (CAD) systems for medical images are seen as effective tools to improve the efficiency of diagnosis and prognosis of Alzheimer’s disease (AD). The current state-of-the-art models for many images analyzing tasks are based on Convolutional Neural Networks (CNN). However, the lack of training data is a common challenge in applying CNN to the diagnosis of AD and its prodromal stages. Another challenge for CAD applications is the controversy between the requiring of longitudinal cortical structural information for higher diagnosis/prognosis accuracy and the computing ability for processing varied imaging features. To address these two challenges, we propose a novel computer-aided AD diagnosis system CNN-Stochastic Coordinate Coding (MSCC) which integrates CNN with transfer learning strategy, a novel MSCC algorithm and our effective AD-related biomarkers–multivariate morphometry statistics (MMS). We applied the novel CNN-MSCC system on the Alzheimer’s Disease Neuroimaging Initiative (ADNI) dataset to predict future cognitive clinical measures with baseline Hippocampal/Ventricle MMS features and cortical thickness. The experimental results showed that CNN-MSCC achieved superior results. The proposed system may aid in expediting the diagnosis of AD progress, facilitating earlier clinical intervention, and resulting in improved clinical outcomes.

[1]  Joseph F. Murray,et al.  Convolutional Networks Can Learn to Generate Affinity Graphs for Image Segmentation , 2010, Neural Computation.

[2]  Adrian A Canutescu,et al.  Cyclic coordinate descent: A robotics algorithm for protein loop closure , 2003, Protein science : a publication of the Protein Society.

[3]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[4]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[5]  R. Buckner Memory and Executive Function in Aging and AD Multiple Factors that Cause Decline and Reserve Factors that Compensate , 2004, Neuron.

[6]  Kenji Suzuki,et al.  Overview of deep learning in medical imaging , 2017, Radiological Physics and Technology.

[7]  Paul M. Thompson,et al.  Studying ventricular abnormalities in mild cognitive impairment with hyperbolic Ricci flow and tensor-based morphometry , 2015, NeuroImage.

[8]  Moo K. Chung,et al.  Tensor-Based Cortical Surface Morphometry via Weighted Spherical Harmonic Representation , 2008, IEEE Transactions on Medical Imaging.

[9]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[10]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[11]  J. Molinuevo,et al.  White matter microstructure is altered in cognitively normal middle-aged APOE-ε4 homozygotes , 2018, Alzheimer's Research & Therapy.

[12]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[13]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[14]  Paul M. Thompson,et al.  Applying surface-based hippocampal morphometry to study APOE-E4 allele dose effects in cognitively unimpaired subjects , 2019, NeuroImage: Clinical.

[15]  Daoqiang Zhang,et al.  Multi-modal multi-task learning for joint prediction of multiple regression and classification variables in Alzheimer's disease , 2012, NeuroImage.

[16]  Jiayu Zhou,et al.  Modeling disease progression via multi-task learning , 2013, NeuroImage.

[17]  K. Davis,et al.  A new rating scale for Alzheimer's disease. , 1984, The American journal of psychiatry.

[18]  Kathryn Ziegler-Graham,et al.  Forecasting the global burden of Alzheimer’s disease , 2007, Alzheimer's & Dementia.

[19]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[20]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[21]  Paul M. Thompson,et al.  Hyperbolic Space Sparse Coding with Its Application on Prediction of Alzheimer's Disease in Mild Cognitive Impairment , 2016, MICCAI.

[22]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[23]  Jie Zhang,et al.  Multi-task sparse screening for predicting future clinical scores using longitudinal cortical thickness measures , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[24]  Qingyang Li,et al.  Stochastic Coordinate Coding and Its Application for Drosophila Gene Expression Pattern Annotation , 2014, ArXiv.

[25]  Paul M. Thompson,et al.  Mapping hippocampal and ventricular change in Alzheimer disease , 2004, NeuroImage.

[26]  Tong Zhang,et al.  Solving large scale linear prediction problems using stochastic gradient descent algorithms , 2004, ICML.

[27]  Jieping Ye,et al.  Deep Model Based Transfer and Multi-Task Learning for Biological Image Analysis , 2015, IEEE Transactions on Big Data.

[28]  Mark E. Schmidt,et al.  The Alzheimer’s Disease Neuroimaging Initiative: A review of papers published since its inception , 2012, Alzheimer's & Dementia.

[29]  D. Louis Collins,et al.  Relating one-year cognitive change in mild cognitive impairment to baseline MRI features , 2009, NeuroImage.

[30]  Stephen M. Smith,et al.  A Bayesian model of shape and appearance for subcortical brain segmentation , 2011, NeuroImage.

[31]  Paul M. Thompson,et al.  Multivariate Tensor-Based Brain Anatomical Surface Morphometry via Holomorphic One-Forms , 2009, MICCAI.

[32]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Moo K. Chung,et al.  Unified Statistical Approach to Cortical Thickness Analysis , 2005, IPMI.

[34]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[35]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[36]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[37]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[38]  Gang Wang,et al.  A Tetrahedron-Based Heat Flux Signature for Cortical Thickness Morphometry Analysis , 2018, MICCAI.

[39]  Jian Zhang Deep Transfer Learning via Restricted Boltzmann Machine for Document Classification , 2011, 2011 10th International Conference on Machine Learning and Applications and Workshops.

[40]  Nick C Fox,et al.  The clinical use of structural MRI in Alzheimer disease , 2010, Nature Reviews Neurology.

[41]  Paul M. Thompson,et al.  Applying sparse coding to surface multivariate tensor-based morphometry to predict future cognitive decline , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[42]  Alan C. Evans,et al.  Early brain development in infants at high risk for autism spectrum disorder , 2017, Nature.

[43]  Yang Song,et al.  Surface-based Tbm Boosts Power to Detect Disease Effects on the Brain: an N = 804 Adni Study ☆ and the Alzheimer's Disease Neuroimaging Initiative , 2022 .

[44]  Xiao Han,et al.  A Topology Preserving Level Set Method for Geometric Deformable Models , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  J. Molinuevo,et al.  Effects of APOE-ε4 allele load on brain morphology in a cohort of middle-aged healthy individuals with enriched genetic risk for Alzheimer's disease , 2018, Alzheimer's & Dementia.