Ensemble learning with 3D convolutional neural networks for functional connectome-based prediction

The specificty and sensitivity of resting state functional MRI (rs-fMRI) measurements depend on pre-processing choices, such as the parcellation scheme used to define regions of interest (ROIs). In this study, we critically evaluate the effect of brain parcellations on machine learning models applied to rs-fMRI data. Our experiments reveal a remarkable trend: On average, models with stochastic parcellations consistently perform as well as models with widely used atlases at the same spatial scale. We thus propose an ensemble learning strategy to combine the predictions from models trained on connectivity data extracted using different (e.g., stochastic) parcellations. We further present an implementation of our ensemble learning strategy with a novel 3D Convolutional Neural Network (CNN) approach. The proposed CNN approach takes advantage of the full-resolution 3D spatial structure of rs-fMRI data and fits non-linear predictive models. Our ensemble CNN framework overcomes the limitations of traditional machine learning models for connectomes that often rely on region-based summary statistics and/or linear models. We showcase our approach on a classification (autism patients versus healthy controls) and a regression problem (prediction of subject's age), and report promising results.

[1]  Daniel Rueckert,et al.  Human brain mapping: A systematic comparison of parcellation methods for the human cerebral cortex , 2017, NeuroImage.

[2]  Vincent Frouin,et al.  Enhancing the Reproducibility of Group Analysis with Randomized Brain Parcellations , 2013, MICCAI.

[3]  N. Makris,et al.  Decreased volume of left and total anterior insular lobule in schizophrenia , 2006, Schizophrenia Research.

[4]  Daniel P. Kennedy,et al.  Enhancing studies of the connectome in autism using the autism brain imaging data exchange II , 2017, Scientific Data.

[5]  Michael P. Milham,et al.  Resting State Functional Connectivity Correlates of Inhibitory Control in Children with Attention-Deficit/Hyperactivity Disorder , 2012, Front. Psychiatry.

[6]  Vince D. Calhoun,et al.  Abnormal functional connectivity of default mode sub-networks in autism spectrum disorder patients , 2010, NeuroImage.

[7]  Mark W. Woolrich,et al.  Network modelling methods for FMRI , 2011, NeuroImage.

[8]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[9]  Jesper Andersson,et al.  A multi-modal parcellation of human cerebral cortex , 2016, Nature.

[10]  Alex Martin,et al.  Functional connectivity classification of autism identifies highly predictive brain features but falls short of biomarker standards , 2014, NeuroImage: Clinical.

[11]  Gaël Varoquaux,et al.  Multi-subject Dictionary Learning to Segment an Atlas of Brain Spontaneous Activity , 2011, IPMI.

[12]  M. Just,et al.  Functional connectivity in a baseline resting-state network in autism , 2006, Neuroreport.

[13]  Ben Glocker,et al.  Metric learning with spectral graph convolutions on brain connectivity networks , 2018, NeuroImage.

[14]  Khundrakpam Budhachandra,et al.  The Neuro Bureau Preprocessing Initiative: open sharing of preprocessed neuroimaging data and derivatives , 2013 .

[15]  Ghassan Hamarneh,et al.  BrainNetCNN: Convolutional neural networks for brain networks; towards predicting neurodevelopment , 2017, NeuroImage.

[16]  Amanda V. Utevsky,et al.  Precuneus Is a Functional Core of the Default-Mode Network , 2014, The Journal of Neuroscience.

[17]  Mark A. Elliott,et al.  Impact of in-scanner head motion on multiple measures of functional connectivity: Relevance for studies of neurodevelopment in youth , 2012, NeuroImage.

[18]  Robert Bridson,et al.  Fast Poisson disk sampling in arbitrary dimensions , 2007, SIGGRAPH '07.

[19]  Swathi P. Iyer,et al.  Distinct neural signatures detected for ADHD subtypes after controlling for micro-movements in resting state functional connectivity MRI data , 2012, Front. Syst. Neurosci..

[20]  Bin Hu,et al.  A review of structural and functional brain networks: small world and atlas , 2015, Brain Informatics.

[21]  J L Lancaster,et al.  Automated Talairach Atlas labels for functional brain mapping , 2000, Human brain mapping.

[22]  Marcel Adam Just,et al.  Functional connectivity in an fMRI working memory task in high-functioning autism , 2005, NeuroImage.

[23]  Dimitris Samaras,et al.  Deriving reproducible biomarkers from multi-site resting-state data: An Autism-based example , 2016, NeuroImage.

[24]  Jean-Baptiste Poline,et al.  Which fMRI clustering gives good brain parcellations? , 2014, Front. Neurosci..

[25]  Edward T. Bullmore,et al.  SYSTEMS NEUROSCIENCE Original Research Article , 2009 .

[26]  S. Rauch,et al.  Structural brain magnetic resonance imaging of limbic and thalamic volumes in pediatric bipolar disorder. , 2005, The American journal of psychiatry.

[27]  Mert R. Sabuncu,et al.  The influence of head motion on intrinsic functional connectivity MRI , 2012, NeuroImage.

[28]  Ramprasaath R. Selvaraju,et al.  Grad-CAM: Why did you say that? Visual Explanations from Deep Networks via Gradient-based Localization , 2016 .

[29]  A. Dale,et al.  Whole Brain Segmentation Automated Labeling of Neuroanatomical Structures in the Human Brain , 2002, Neuron.

[30]  Simon B. Eickhoff,et al.  A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data , 2005, NeuroImage.

[31]  Xi-Nian Zuo,et al.  Spatial Topography of Individual-Specific Cortical Networks Predicts Human Cognition, Personality, and Emotion. , 2019, Cerebral cortex.

[32]  Markus D. Schirmer,et al.  Developing brain connectivity : effects of parcellation scale on network analysis in neonates , 2015 .

[33]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[34]  Ghassan Hamarneh,et al.  Machine Learning on Human Connectome Data from MRI , 2016, ArXiv.

[35]  O. Sporns,et al.  Mapping the Structural Core of Human Cerebral Cortex , 2008, PLoS biology.

[36]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[37]  Marcus Kaiser,et al.  A tutorial in connectome analysis: Topological and spatial features of brain networks , 2011, NeuroImage.

[38]  Vinod Menon,et al.  Developmental pathways to functional brain networks: emerging principles , 2013, Trends in Cognitive Sciences.

[39]  Gaël Varoquaux,et al.  Detection of Brain Functional-Connectivity Difference in Post-stroke Patients Using Group-Level Covariance Modeling , 2010, MICCAI.

[40]  Osamu Abe,et al.  Diminished Medial Prefrontal Activity behind Autistic Social Judgments of Incongruent Information , 2012, PloS one.

[41]  Max Welling,et al.  Visualizing Deep Neural Network Decisions: Prediction Difference Analysis , 2017, ICLR.

[42]  Edward E. Smith,et al.  Age Differences in the Frontal Lateralization of Verbal and Spatial Working Memory Revealed by PET , 2000, Journal of Cognitive Neuroscience.

[43]  Scott Peltier,et al.  Abnormalities of intrinsic functional connectivity in autism spectrum disorders, , 2009, NeuroImage.

[44]  Marisa O. Hollinshead,et al.  The organization of the human cerebral cortex estimated by intrinsic functional connectivity. , 2011, Journal of neurophysiology.

[46]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[47]  Takeo Watanabe,et al.  A small number of abnormal brain connections predicts adult autism spectrum disorder , 2016, Nature Communications.

[48]  J. Rapoport,et al.  The anatomical distance of functional connections predicts brain network topology in health and schizophrenia. , 2013, Cerebral cortex.

[49]  Edward T. Bullmore,et al.  Whole-brain anatomical networks: Does the choice of nodes matter? , 2010, NeuroImage.

[50]  R Cameron Craddock,et al.  A whole brain fMRI atlas generated via spatially constrained spectral clustering , 2012, Human brain mapping.

[51]  G. Varoquaux,et al.  Connectivity‐based parcellation: Critique and implications , 2015, Human brain mapping.

[52]  Timothy O. Laumann,et al.  Methods to detect, characterize, and remove motion artifact in resting state fMRI , 2014, NeuroImage.

[53]  Ralph-Axel Müller,et al.  Diagnostic classification of intrinsic functional connectivity highlights somatosensory, default mode, and visual regions in autism , 2015, NeuroImage: Clinical.

[54]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[55]  Abraham Z. Snyder,et al.  Prediction of brain maturity in infants using machine-learning algorithms , 2016, NeuroImage.

[56]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[57]  M. Mallar Chakravarty,et al.  Quantitative comparison of 21 protocols for labeling hippocampal subfields and parahippocampal subregions in in vivo MRI: Towards a harmonized segmentation protocol , 2015, NeuroImage.