Fast and Scalable Distributed Deep Convolutional Autoencoder for fMRI Big Data Analytics

In recent years, analyzing task-based fMRI (tfMRI) data has become an essential tool for understanding brain function and networks. However, due to the sheer size of tfMRI data, its intrinsic complex structure, and lack of ground truth of underlying neural activities, modeling tfMRI data is hard and challenging. Previously proposed data modeling methods including Independent Component Analysis (ICA) and Sparse Dictionary Learning only provided shallow models based on blind source separation under the strong assumption that original fMRI signals could be linearly decomposed into time series components with corresponding spatial maps. Given the Convolutional Neural Network (CNN) successes in learning hierarchical abstractions from low-level data such as tfMRI time series, in this work we propose a novel scalable distributed deep CNN autoencoder model and apply it for fMRI big data analysis. This model aims to both learn the complex hierarchical structures of the tfMRI big data and to leverage the processing power of multiple GPUs in a distributed fashion. To deploy such a model, we have created an enhanced processing pipeline on the top of Apache Spark and Tensorflow, leveraging from a large cluster of GPU nodes over cloud. Experimental results from applying the model on the Human Connectome Project (HCP) data show that the proposed model is efficient and scalable toward tfMRI big data modeling and analytics, thus enabling data-driven extraction of hierarchical neuroscientific information from massive fMRI big data.

[1]  Joseph F. Murray,et al.  Convolutional Networks Can Learn to Generate Affinity Graphs for Image Segmentation , 2010, Neural Computation.

[2]  Xia Zhu,et al.  A Convolutional Autoencoder for Multi-Subject fMRI Data Aggregation , 2016, ArXiv.

[3]  Jieping Ye,et al.  Scalable Fast Rank-1 Dictionary Learning for fMRI Big Data Analysis , 2016, KDD.

[4]  I Kanno,et al.  Statistical methods for detecting activated regions in functional MRI of the brain. , 1998, Magnetic resonance imaging.

[5]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[6]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Yu Zhao,et al.  HAFNI-enabled largescale platform for neuroimaging informatics (HELPNI) , 2015, Brain Informatics.

[8]  Yu Zhao,et al.  3-D functional brain network classification using Convolutional Neural Networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[9]  Saeid Sanei,et al.  Fast and incoherent dictionary learning algorithms with application to fMRI , 2015, Signal Image Video Process..

[10]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[11]  Zhe Gan,et al.  Variational Autoencoder for Deep Learning of Images, Labels and Captions , 2016, NIPS.

[12]  Yizhen Zhang,et al.  Neural Encoding and Decoding with Deep Learning for Dynamic Natural Vision , 2016, Cerebral cortex.

[13]  Jian Sun,et al.  Deep ADMM-Net for Compressive Sensing MRI , 2016, NIPS.

[14]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[15]  Honglak Lee,et al.  An Analysis of Single-Layer Networks in Unsupervised Feature Learning , 2011, AISTATS.

[16]  Michelle L. McGowan,et al.  Big data, open science and the brain: lessons learned from genomics , 2014, Front. Hum. Neurosci..

[17]  Bharat B. Biswal,et al.  Making data sharing work: The FCP/INDI experience , 2013, NeuroImage.

[18]  S. Rombouts,et al.  Hierarchical functional modularity in the resting‐state human brain , 2009, Human brain mapping.

[19]  Oluwasanmi Koyejo,et al.  Toward open sharing of task-based fMRI data: the OpenfMRI project , 2013, Front. Neuroinform..

[20]  Mark E. Schmidt,et al.  The Alzheimer’s Disease Neuroimaging Initiative: A review of papers published since its inception , 2012, Alzheimer's & Dementia.

[21]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  Dinggang Shen,et al.  State-space model with deep learning for functional dynamics estimation in resting-state fMRI , 2016, NeuroImage.

[24]  Edward T. Bullmore,et al.  Neuroinformatics Original Research Article , 2022 .

[25]  Abraham Z. Snyder,et al.  Function in the human connectome: Task-fMRI and individual differences in behavior , 2013, NeuroImage.

[26]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[27]  Quoc V. Le,et al.  On optimization methods for deep learning , 2011, ICML.

[28]  Yu Zhao,et al.  Modeling Task fMRI Data via Deep Convolutional Autoencoder , 2017, IPMI.

[29]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[30]  Michael J. Franklin,et al.  Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing , 2012, NSDI.

[31]  Hong Zhang,et al.  Facial expression recognition via learning deep sparse autoencoders , 2018, Neurocomputing.

[32]  E C Wong,et al.  Processing strategies for time‐course data sets in functional mri of the human brain , 1993, Magnetic resonance in medicine.

[33]  Yu Zhao,et al.  Modeling Task fMRI Data Via Deep Convolutional Autoencoder , 2018, IEEE Transactions on Medical Imaging.

[34]  Yann LeCun,et al.  Deep learning with Elastic Averaging SGD , 2014, NIPS.

[35]  Luca Maria Gambardella,et al.  Deep Big Simple Neural Nets Excel on Handwritten Digit Recognition , 2010, ArXiv.

[36]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[37]  Marc'Aurelio Ranzato,et al.  Large Scale Distributed Deep Networks , 2012, NIPS.

[38]  Jieping Ye,et al.  Holistic Atlases of Functional Networks and Interactions Reveal Reciprocal Organizational Architecture of Cortical Function , 2015, IEEE Transactions on Biomedical Engineering.

[39]  T. Sejnowski,et al.  Human Brain Mapping 6:368–372(1998) � Independent Component Analysis of fMRI Data: Examining the Assumptions , 2022 .

[40]  Heng Huang,et al.  Latent source mining in FMRI data via deep neural network , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[41]  Karl J. Friston,et al.  Dynamic causal modelling , 2003, NeuroImage.

[42]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[43]  Fuad E. Alsaadi,et al.  Deep Belief Networks for Quantitative Analysis of a Gold Immunochromatographic Strip , 2016, Cognitive Computation.

[44]  Vince D. Calhoun,et al.  Deep learning for neuroimaging: a validation study , 2013, Front. Neurosci..

[45]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[46]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[47]  A. Andersen,et al.  Principal component analysis of the dynamic response measured by fMRI: a generalized linear systems framework. , 1999, Magnetic resonance imaging.