CBIR system using Capsule Networks and 3D CNN for Alzheimer's disease diagnosis

Abstract Alzheimer's disease (AD) is an irreversible disorder of the brain related to loss of memory, commonly seen in the elderly and aging population. Implementation of revolutionary computer aided diagnosis techniques with Content Based Image Retrieval (CBIR) has created new potentials in Magnetic resonance imaging (MRI) in relevant image retrieval and training for detection of progression of AD in early stages. This paper proposed a CBIR system using 3D Capsule Network, 3D-Convolutional Neural Network and pre-trained 3D-autoencoder technology for early detection of Alzheimer's. A 3D-Capsule Networks (CapsNets) is capable of fast learning, even for small datasets and can effectively handle robust image rotations and transitions. It was observed that, an ensemble method using 3D-CapsNets and convolution neural network (CNN) with 3D-autoencoder, increased the detection performances comparing to Deep-CNN alone. CBIR using the proposed model was found to be up to 98.42% accurate in AD classification. Moreover, we argue that CapsNet seems to be a promising new technique for image classification, and further experiments using more robust computation resources and refined CapsNet architectures may produce better outcomes.

[1]  Javed Mostafa,et al.  Content-based image retrieval for Alzheimer's disease detection , 2011, 2011 9th International Workshop on Content-Based Multimedia Indexing (CBMI).

[2]  Daoqiang Zhang,et al.  Label-aligned multi-task feature learning for multimodal classification of Alzheimer’s disease and mild cognitive impairment , 2016, Brain Imaging and Behavior.

[3]  Dinggang Shen,et al.  Deep Learning-Based Feature Representation for AD/MCI Classification , 2013, MICCAI.

[4]  Stephan J. Garbin,et al.  Harmonic Networks: Deep Translation and Rotation Equivariance , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  K. Langa,et al.  Is the risk of Alzheimer’s disease and dementia declining? , 2015, Alzheimer's Research & Therapy.

[6]  Vipul Dalal,et al.  A machine learning based approach for detection of alzheimer's disease using analysis of hippocampus region from MRI scan , 2017, 2017 International Conference on Computing Methodologies and Communication (ICCMC).

[7]  Karl J. Friston,et al.  Voxel-Based Morphometry—The Methods , 2000, NeuroImage.

[8]  Sidong Liu,et al.  Early diagnosis of Alzheimer's disease with deep learning , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[9]  Seong-Whan Lee,et al.  Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis , 2014, NeuroImage.

[10]  John Bond,et al.  The worldwide economic impact of dementia 2010 , 2013, Alzheimer's & Dementia.

[11]  Hai Tao,et al.  Review of deep convolution neural network in image classification , 2017, 2017 International Conference on Radar, Antenna, Microwave, Electronics, and Telecommunications (ICRAMET).

[12]  Hayit Greenspan,et al.  Content-Based Image Retrieval in Radiology: Current Status and Future Directions , 2010, Journal of Digital Imaging.

[13]  Faouzi Benzarti,et al.  Diagnosis of Alzheimer Diseases in Early Step Using SVM (Support Vector Machine) , 2016, 2016 13th International Conference on Computer Graphics, Imaging and Visualization (CGiV).

[14]  Javed Mostafa,et al.  Image Retrieval for Alzheimer's Disease Detection , 2009, MCBR-CDS.

[15]  J. Gee,et al.  What's in a name: voxel-based morphometric analyses of MRI and naming difficulty in Alzheimer's disease, frontotemporal dementia and corticobasal degeneration. , 2003, Brain : a journal of neurology.

[16]  Marie Chupin,et al.  Multidimensional classification of hippocampal shape features discriminates Alzheimer's disease and mild cognitive impairment from normal aging , 2009, NeuroImage.

[17]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[18]  A. Simmons,et al.  Combination analysis of neuropsychological tests and structural MRI measures in differentiating AD, MCI and control groups—The AddNeuroMed study , 2011, Neurobiology of Aging.

[19]  Saad Rehman,et al.  A deep CNN based multi-class classification of Alzheimer's disease using MRI , 2017, 2017 IEEE International Conference on Imaging Systems and Techniques (IST).

[20]  Fabio A. González,et al.  Bag of Features for Automatic Classification of Alzheimer's Disease in Magnetic Resonance Images , 2012, CIARP.

[21]  J. Weuve,et al.  Alzheimer disease in the United States (2010–2050) estimated using the 2010 census , 2013, Neurology.

[22]  Akshay Pai,et al.  Classification of Alzheimer and MCI Phenotypes on MRI Data Using SVM , 2017, SIRS.

[23]  Shadi Albarqouni,et al.  Capsule Networks against Medical Imaging Data Challenges , 2018, CVII-STENT/LABELS@MICCAI.

[24]  Marie Chupin,et al.  Automatic classi fi cation of patients with Alzheimer ' s disease from structural MRI : A comparison of ten methods using the ADNI database , 2010 .

[25]  Ayman El-Baz,et al.  Alzheimer's disease diagnostics by adaptation of 3D convolutional network , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[26]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Jian Zhou,et al.  Deep Supervised and Convolutional Generative Stochastic Network for Protein Secondary Structure Prediction , 2014, ICML.

[28]  Michael Unser,et al.  Convolutional Neural Networks for Inverse Problems in Imaging: A Review , 2017, IEEE Signal Processing Magazine.

[29]  Xiaofeng Zhu,et al.  A novel matrix-similarity based loss function for joint regression and classification in AD diagnosis , 2014, NeuroImage.

[30]  Olivier Salvado,et al.  Detecting global and local hippocampal shape changes in Alzheimer's disease using statistical shape models , 2012, NeuroImage.

[31]  Logan Engstrom,et al.  Query-Efficient Black-box Adversarial Examples , 2017, ArXiv.

[32]  Kwang Gi Kim,et al.  Book Review: Deep Learning , 2016, Healthcare Informatics Research.

[33]  Yi Pan,et al.  Improving Alzheimer's Disease Classification by Combining Multiple Measures , 2018, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[34]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[35]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[36]  Konstantinos N. Plataniotis,et al.  Brain Tumor Type Classification via Capsule Networks , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[37]  Yang Jin,et al.  Capsule Network Performance on Complex Data , 2017, ArXiv.

[38]  Bin Hu,et al.  Alzheimer’s Disease Classification Based on Individual Hierarchical Networks Constructed With 3-D Texture Features , 2017, IEEE Transactions on NanoBioscience.

[39]  Michèle Allard,et al.  Feature-based brain MRI retrieval for Alzheimer disease diagnosis , 2012, 2012 19th IEEE International Conference on Image Processing.

[40]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[41]  Geoffrey E. Hinton,et al.  Matrix capsules with EM routing , 2018, ICLR.

[42]  Seong-Whan Lee,et al.  Latent feature representation with stacked auto-encoder for AD/MCI diagnosis , 2013, Brain Structure and Function.

[43]  Rinat Mukhometzianov,et al.  CapsNet comparative performance evaluation for image classification , 2018, ArXiv.

[44]  Joani Mitro.  Content-based image retrieval tutorial , 2016, ArXiv.

[45]  Yaozong Gao,et al.  Detecting Anatomical Landmarks for Fast Alzheimer’s Disease Diagnosis , 2016, IEEE Transactions on Medical Imaging.

[46]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  R. Petersen,et al.  Cerebrospinal fluid biomarker signature in Alzheimer's disease neuroimaging initiative subjects , 2009, Annals of neurology.