Detecting Alzheimer's disease Based on 4D fMRI: An exploration under deep learning framework

Abstract Applying machine learning methods to various modality medical images and clinical data for early diagnosis of Alzheimer's disease (AD) and its prodromal stage has many significant results. So far, the image data input to classifier mainly focus on 2D or 3D images. Although some functional imaging technologies, such as functional magnetic resonance imaging (fMRI), generate 4D data which contain both spatial and time-varying information of the brain, for the lack of suitable 4D image processing algorithm, these 4D data were always used by transforming them into functional connectivity or slicing them into 2D/3D pictures which causing apparent information loss. In this paper, we present a 4D deep learning model (C3d-LSTM) for AD discrimination, which is able to utilize the spatial and time-varying information simultaneously by dealing with 4D fMRI data directly. The proposed C3d-LSTM combines a series of 3D convolutional neural networks (CNNs) to extract spatial features from each volume of 3D static image in fMRI image sequence. Then the feature maps obtained were put into the long short-term memory (LSTM) network to capture the time-varying information contained in the data. Because of the design of structure, C3d-LSTM became an end-to-end data-driven model, which was more convenient for processing 4D fMRI data. The model proposed conducted on the AD Neuroimaging Initiative dataset for algorithm evaluation compared with controlled experiments. Results showed that using 4D fMRI data directly with the proposed method did make a far better result for AD detection than the methods using functional connectivity, 2D, or 3D fMRI data. It demonstrated our assumption that making the most of the natural spatial and temporal information preserved in 4D fMRI data is significant for AD detection and can increase the performance of the classifier. Meanwhile the result implied that the C3d-LSTM model proposed is a suitable model for processing 4D fMRI data and extracting the spatio-temporal property of fMRI data fully for diagnosis of AD.

[1]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[2]  Xiangyu Wang,et al.  Ensemble of 3D densely connected convolutional network for diagnosis of mild cognitive impairment and Alzheimer's disease , 2019, Neurocomputing.

[3]  Daoqiang Zhang,et al.  Identification of MCI individuals using structural and functional connectivity networks , 2012, NeuroImage.

[4]  Yufeng Zang,et al.  DPARSF: A MATLAB Toolbox for “Pipeline” Data Analysis of Resting-State fMRI , 2010 .

[5]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[6]  Hui Liu,et al.  MMAN: Multi-modality aggregation network for brain segmentation from MR images , 2019, Neurocomputing.

[7]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[8]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[9]  Gang Li,et al.  High‐order resting‐state functional connectivity network for MCI classification , 2016, Human brain mapping.

[10]  Hao Chen,et al.  VoxResNet: Deep voxelwise residual networks for brain segmentation from 3D MR images , 2017, NeuroImage.

[11]  Dinggang Shen,et al.  A Novel Deep Learning Framework on Brain Functional Networks for Early MCI Diagnosis , 2018, MICCAI.

[12]  S. Rombouts,et al.  Loss of ‘Small-World’ Networks in Alzheimer's Disease: Graph Analysis of fMRI Resting-State Functional Connectivity , 2010, PloS one.

[13]  Zhiyuan Wu,et al.  Disrupted Structural Brain Network in AD and aMCI: A Finding of Long Fiber Degeneration. , 2015, Current Alzheimer research.

[14]  Emily L. Dennis,et al.  Functional Brain Connectivity Using fMRI in Aging and Alzheimer’s Disease , 2014, Neuropsychology Review.

[15]  Xi-Nian Zuo,et al.  REST: A Toolkit for Resting-State Functional Magnetic Resonance Imaging Data Processing , 2011, PloS one.

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[18]  Dinggang Shen,et al.  Deep Chronnectome Learning via Full Bidirectional Long Short-Term Memory Networks for MCI Diagnosis , 2018, MICCAI.

[19]  Shie Mannor,et al.  A Tutorial on the Cross-Entropy Method , 2005, Ann. Oper. Res..

[20]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Lutz Prechelt,et al.  Automatic early stopping using cross validation: quantifying the criteria , 1998, Neural Networks.

[22]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Lianwen Jin,et al.  A Hybrid Network for ERP Detection and Analysis Based on Restricted Boltzmann Machine , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Ghassem Tofighi,et al.  Deep Learning-based Pipeline to Recognize Alzheimer’s Disease using fMRI Data , 2016, bioRxiv.

[25]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.