Enriched Representation Learning in Resting-State fMRI for Early MCI Diagnosis

In recent studies, we have witnessed the applicability of deep learning methods on resting-state functional Magnetic Resonance Image (rs-fMRI) analysis and on its use for brain disease diagnosis, e.g., early Mild Cognitive Impairment (eMCI) identification. However, to our best knowledge, many of the existing methods are generally limited from improving the performance in a target task, e.g., eMCI diagnosis, by the unexpected information loss in transforming an input into hierarchical or compressed representations. In this paper, we propose a novel network architecture that discovers enriched representations of the spatio-temporal patterns in rs-fMRI such that the most compressed or latent representations include the maximal amount of information to recover the original input, but are decomposed into diagnosis-relevant and diagnosis-irrelevant features. In order to learn those favourable representations, we utilize a self-attention mechanism to explore spatially more informative patterns over time and information-oriented techniques to maintain the enriched but decomposed representations. In our experiments over the ADNI dataset, we validated the effectiveness of the proposed network architecture by comparing its performance with that of the counterpart methods as well as the competing methods in the literature.

[1]  Gaël Varoquaux,et al.  Benchmarking functional connectome-based predictive models for resting-state fMRI , 2019, NeuroImage.

[2]  Yufeng Zang,et al.  DPABI: Data Processing & Analysis for (Resting-State) Brain Imaging , 2016, Neuroinformatics.

[3]  Yoshua Bengio,et al.  Learning deep representations by mutual information estimation and maximization , 2018, ICLR.

[4]  S. Varadhan,et al.  Asymptotic evaluation of certain Markov process expectations for large time , 1975 .

[5]  Seong-Whan Lee,et al.  Multiple functional networks modeling for autism spectrum disorder diagnosis , 2017, Human brain mapping.

[6]  Gang Sun,et al.  Squeeze-and-Excitation Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[7]  Heung-Il Suk,et al.  Probabilistic Source Separation on Resting-State fMRI and Its Use for Early MCI Identification , 2018, International Conference on Medical Image Computing and Computer-Assisted Intervention.

[8]  Vince D. Calhoun,et al.  Prediction of Progression to Alzheimer's disease with Deep InfoMax , 2019, 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[9]  Marisa O. Hollinshead,et al.  The organization of the human cerebral cortex estimated by intrinsic functional connectivity. , 2011, Journal of neurophysiology.

[10]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[11]  Vince D. Calhoun,et al.  Restricted Boltzmann machines for neuroimaging: An application in identifying intrinsic networks , 2014, NeuroImage.

[12]  Yoshua Bengio,et al.  Mutual Information Neural Estimation , 2018, ICML.

[13]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[14]  Dinggang Shen,et al.  State-space model with deep learning for functional dynamics estimation in resting-state fMRI , 2016, NeuroImage.

[15]  Juntang Zhuang,et al.  Jointly Discriminative and Generative Recurrent Neural Networks for Learning from fMRI , 2019, MLMI@MICCAI.

[16]  Bo Peng,et al.  Latent source mining in FMRI via restricted Boltzmann machine , 2018, Human brain mapping.

[17]  V. Calhoun,et al.  The Chronnectome: Time-Varying Connectivity Networks as the Next Frontier in fMRI Data Discovery , 2014, Neuron.

[18]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[19]  Naftali Tishby,et al.  Deep learning and the information bottleneck principle , 2015, 2015 IEEE Information Theory Workshop (ITW).