Ensemble of 3D CNN regressors with data fusion for fluid intelligence prediction

In this work, we aim at predicting children's fluid intelligence scores based on structural T1-weighted MR images from the largest long-term study of brain development and child health. The target variable was regressed on a data collection site, socio-demographic variables and brain volume, thus being independent to the potentially informative factors, which are not directly related to the brain functioning. We investigate both feature extraction and deep learning approaches as well as different deep CNN architectures and their ensembles. We propose an advanced architecture of VoxCNNs ensemble, which yield MSE (92.838) on blind test.

[1]  Evgeny Burnaev,et al.  Conformalized Kernel Ridge Regression , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).

[2]  Eugenio Culurciello,et al.  An Analysis of Deep Neural Network Models for Practical Applications , 2016, ArXiv.

[3]  Evgeny Burnaev,et al.  MRI-Based Diagnostics of Depression Concomitant with Epilepsy: In Search of the Potential Biomarkers , 2018, 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA).

[4]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[5]  Nico Karssemeijer,et al.  Transfer Learning for Domain Adaptation in MRI: Application in Brain Lesion Segmentation , 2017, MICCAI.

[6]  Arthur F. Kramer,et al.  Dissociable brain biomarkers of fluid intelligence , 2016, NeuroImage.

[7]  Evgeny Burnaev,et al.  Minimax Approach to Variable Fidelity Data Interpolation , 2017, AISTATS.

[8]  Evgeny Burnaev,et al.  Pattern Recognition Pipeline for Neuroimaging Data , 2018, ANNPR.

[9]  Paul M. Thompson,et al.  Robust Brain Extraction Across Datasets and Comparison With Publicly Available Methods , 2011, IEEE Transactions on Medical Imaging.

[10]  Yulia Dodonova,et al.  Residual and plain convolutional neural networks for 3D brain MRI classification , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[11]  Adolf Pfefferbaum,et al.  The SRI24 multichannel atlas of normal adult human brain structure , 2009, Human brain mapping.

[12]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[14]  Klaus H. Maier-Hein,et al.  DALSA: Domain Adaptation for Supervised Learning From Sparsely Annotated MR Images , 2024, IEEE Transactions on Medical Imaging.

[15]  Anders M. Dale,et al.  Image processing and analysis methods for the Adolescent Brain Cognitive Development Study , 2019, NeuroImage.

[16]  Evgeny Burnaev,et al.  Conformal prediction in manifold learning , 2018, COPA.

[17]  Evgeny Burnaev,et al.  Voxelwise 3D Convolutional and Recurrent Neural Networks for Epilepsy and Depression Diagnostics from Structural and Functional MRI Data , 2018, 2018 IEEE International Conference on Data Mining Workshops (ICDMW).

[18]  Adolf Pfefferbaum,et al.  Altered Brain Developmental Trajectories in Adolescents After Initiating Drinking. , 2017, The American journal of psychiatry.

[19]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[20]  Jonathan Tompson,et al.  Efficient object localization using Convolutional Networks , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Zhiguo Cao,et al.  When Unsupervised Domain Adaptation Meets Tensor Representations , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[22]  Konstantin Eckle,et al.  A comparison of deep networks with ReLU activation function and linear spline-type methods , 2018, Neural Networks.

[23]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[24]  Evgeny V. Burnaev,et al.  On a method for constructing ensembles of regression models , 2013, Autom. Remote. Control..

[25]  Michael W. L. Chee,et al.  Skull stripping using graph cuts , 2010, NeuroImage.

[26]  Michael C. Pyryt.  Human cognitive abilities: A survey of factor analytic studies , 1998 .

[27]  Hao Chen,et al.  VoxResNet: Deep voxelwise residual networks for brain segmentation from 3D MR images , 2017, NeuroImage.

[28]  Andrzej Cichocki,et al.  Learning Connectivity Patterns via Graph Kernels for fMRI-Based Depression Diagnostics , 2018, 2018 IEEE International Conference on Data Mining Workshops (ICDMW).

[29]  Evgeny Burnaev,et al.  Large scale variable fidelity surrogate modeling , 2017, Annals of Mathematics and Artificial Intelligence.

[30]  Evgeny Burnaev,et al.  Large-Scale Shape Retrieval with Sparse 3D Convolutional Neural Networks , 2017, AIST.

[31]  Evgeny Burnaev,et al.  The influence of parameter initialization on the training time and accuracy of a nonlinear regression model , 2016 .

[32]  Vladimir Vovk,et al.  Efficiency of conformalized ridge regression , 2014, COLT.

[33]  Ayman El-Baz,et al.  Alzheimer's Disease Diagnostics by a Deeply Supervised Adaptable 3D Convolutional Network , 2016, ArXiv.

[34]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Alexey Zaytsev,et al.  Surrogate modeling of multifidelity data for large samples , 2015 .

[36]  Brian B. Avants,et al.  An Open Source Multivariate Framework for n-Tissue Segmentation with Evaluation on Public Data , 2011, Neuroinformatics.

[37]  Patrick Dupont,et al.  Tensor decompositions and data fusion in epileptic electroencephalography and functional magnetic resonance imaging data , 2017, WIREs Data Mining Knowl. Discov..

[38]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Bing Liu,et al.  Prediction of General Fluid Intelligence Using Cortical Measurements and Underlying Genetic Mechanisms , 2018, IOP Conference Series: Materials Science and Engineering.

[40]  Torsten Rohlfing,et al.  The National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA): A Multisite Study of Adolescent Development and Substance Use. , 2015, Journal of studies on alcohol and drugs.