Multi-task prediction of infant cognitive scores from longitudinal incomplete neuroimaging data

&NA; Early postnatal brain undergoes a stunning period of development. Over the past few years, research on dynamic infant brain development has received increased attention, exhibiting how important the early stages of a child's life are in terms of brain development. To precisely chart the early brain developmental trajectories, longitudinal studies with data acquired over a long‐enough period of infants' early life is essential. However, in practice, missing data from different time point(s) during the data gathering procedure is often inevitable. This leads to incomplete set of longitudinal data, which poses a major challenge for such studies. In this paper, prediction of multiple future cognitive scores with incomplete longitudinal imaging data is modeled into a multi‐task machine learning framework. To efficiently learn this model, we account for selection of informative features (i.e., neuroimaging morphometric measurements for different time points), while preserving the structural information and the interrelation between these multiple cognitive scores. Several experiments are conducted on a carefully acquired in‐house dataset, and the results affirm that we can predict the cognitive scores measured at the age of four years old, using the imaging data of earlier time points, as early as 24 months of age, with a reasonable performance (i.e., root mean square error of 0.18). HighlightsPrediction of multiple future cognitive scores with incomplete longitudinal imaging data is modeled into a multi‐task machine learning framework.We account for selection of informative features while preserving the interrelation between multiple cognitive scores.Several experiments are conducted on a carefully acquired dataset.Results affirm that we can predict the cognitive scores measured at the age of 4 from the imaging data of 24 months of age.

[1]  Anil K. Jain,et al.  Small Sample Size Effects in Statistical Pattern Recognition: Recommendations for Practitioners , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Allan N. Schore,et al.  The effects of early relational trauma on right brain development, affect regulation, and infant mental health. , 2001 .

[3]  Junfeng Yang,et al.  Linearized augmented Lagrangian and alternating direction methods for nuclear norm minimization , 2012, Math. Comput..

[4]  Wei-Yin Loh,et al.  Variable Selection for Classification and Regression in Large p, Small n Problems , 2012 .

[5]  S. Bradley-Johnson Mullen Scales of Early Learning , 1997 .

[6]  Ehsan Adeli,et al.  Joint feature-sample selection and robust diagnosis of Parkinson's disease from MRI data , 2016, NeuroImage.

[7]  Ahmad Khodayari-Rostamabad,et al.  A machine learning approach for distinguishing age of infants using auditory evoked potentials , 2011, Clinical Neurophysiology.

[8]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[9]  David C. Alsop,et al.  Assessment of functional development in normal infant brain using arterial spin labeled perfusion MRI , 2008, NeuroImage.

[10]  Hugo Lagercrantz,et al.  Infant Brain Development , 2016 .

[11]  Massimiliano Pontil,et al.  Regularized multi--task learning , 2004, KDD.

[12]  A. Dale,et al.  Structural growth trajectories and rates of change in the first 3 months of infant brain development. , 2014, JAMA neurology.

[13]  H. Benali,et al.  Cognitive and neuroimaging features and brain β -amyloidosis in individuals at risk of Alzheimer’s disease (INSIGHT-preAD): a longitudinal observational study , 2019 .

[14]  Rich Caruana,et al.  Multitask Learning , 1997, Machine-mediated learning.

[15]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2009, Found. Comput. Math..

[16]  Rose Yu,et al.  Accelerated Online Low Rank Tensor Learning for Multivariate Spatiotemporal Streams , 2015, ICML.

[17]  A. Mitsudome,et al.  Development of the temporal lobe in infants and children: analysis by MR-based volumetry. , 1999, AJNR. American journal of neuroradiology.

[18]  Fabio Mosca,et al.  Emerging executive skills in very preterm children at 2 years corrected age: A composite assessment , 2014, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[19]  J. Gilmore,et al.  Structural and Maturational Covariance in Early Childhood Brain Development , 2016, Cerebral cortex.

[20]  Andrew Zisserman,et al.  Efficient Visual Search of Videos Cast as Text Retrieval , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Rose Yu,et al.  Learning from Multiway Data: Simple and Efficient Tensor Regression , 2016, ICML.

[22]  J. Gilmore,et al.  Spatial Patterns, Longitudinal Development, and Hemispheric Asymmetries of Cortical Thickness in Infants from Birth to 2 Years of Age , 2015, The Journal of Neuroscience.

[23]  Yaozong Gao,et al.  LINKS: Learning-based multi-source IntegratioN frameworK for Segmentation of infant brain images , 2014, NeuroImage.

[24]  D. Basak,et al.  Support Vector Regression , 2008 .

[25]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[26]  Yaozong Gao,et al.  LINKS: Learning-based multi-source IntegratioN frameworK for Segmentation of infant brain images , 2015, NeuroImage.

[27]  L. Cozolino,et al.  The Neuroscience of Psychotherapy: Healing the Social Brain , 2017 .

[28]  Kim-Han Thung,et al.  Robust Feature-Sample Linear Discriminant Analysis for Brain Disorders Diagnosis , 2015, NIPS.

[29]  John T. Bruer,et al.  The myth of the first three years : a new understanding of early brain development and lifelong learning , 1999 .

[30]  Stéphane Gaïffas,et al.  Sharp Oracle Inequalities for High-Dimensional Matrix Prediction , 2011, IEEE Transactions on Information Theory.

[31]  Paul M. Thompson,et al.  Multi-source feature learning for joint analysis of incomplete multiple heterogeneous neuroimaging data , 2012, NeuroImage.

[32]  Haiping Lu,et al.  Multilinear Regression for Embedded Feature Selection with Application to fMRI Analysis , 2017, AAAI.

[33]  Wei Gao,et al.  Development of Thalamocortical Connectivity during Infancy and Its Cognitive Correlations , 2014, The Journal of Neuroscience.

[34]  William M. Wells,et al.  A Feature-Based Developmental Model of the Infant Brain in Structural MRI , 2012, MICCAI.

[35]  Christopher N Martyn,et al.  The Influence of Head Growth in Fetal Life, Infancy, and Childhood on Intelligence at the Ages of 4 and 8 Years , 2006, Pediatrics.

[36]  Jonathan O'Muircheartaigh,et al.  Estimating the Age of Healthy Infants From Quantitative Myelin Water Fraction Maps , 2015, Human brain mapping.

[37]  Dinggang Shen,et al.  iBEAT: A Toolbox for Infant Brain Magnetic Resonance Image Processing , 2012, Neuroinformatics.

[38]  Gang Li,et al.  Learning‐based subject‐specific estimation of dynamic maps of cortical morphology at missing time points in longitudinal infant studies , 2016, Human brain mapping.

[39]  Dinggang Shen,et al.  Cerebral Cortex doi:10.1093/cercor/bhs043 Cerebral Cortex Advance Access published February 24, 2012 The Synchronization within and Interaction between the Default and Dorsal Attention Networks in Early Infancy , 2022 .

[40]  John H. Gilmore,et al.  Infant Gut Microbiome Associated With Cognitive Development , 2018, Biological Psychiatry.

[41]  K. Honma,et al.  Development of the human abducens nucleus: A morphometric study , 2012, Brain and Development.

[42]  Dinggang Shen,et al.  Measuring the dynamic longitudinal cortex development in infants by reconstruction of temporally consistent cortical surfaces , 2014, NeuroImage.

[43]  J. Gilmore,et al.  Mapping Longitudinal Development of Local Cortical Gyrification in Infants from Birth to 2 Years of Age , 2014, The Journal of Neuroscience.

[44]  R. Näätänen,et al.  Development of language-specific phoneme representations in the infant brain , 1998, Nature Neuroscience.

[45]  Thomas E. Nichols,et al.  Multiple comparison procedures for neuroimaging genomewide association studies. , 2014, Biostatistics.

[46]  Mohammad Mottahedi,et al.  On the development of multi-linear regression analysis to assess energy consumption in the early stages of building design , 2014 .

[47]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[48]  Daniel A. Newman Longitudinal Modeling with Randomly and Systematically Missing Data: A Simulation of Ad Hoc, Maximum Likelihood, and Multiple Imputation Techniques , 2003 .

[49]  Fei Wang,et al.  Accurate Anatomical Landmark Detection Based on Importance Sampling for Infant Brain MR Images , 2017 .

[50]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[51]  Massimiliano Pontil,et al.  Multilinear Multitask Learning , 2013, ICML.

[52]  Mahmood Fathy,et al.  Multi-label Discriminative Weakly-Supervised Human Activity Recognition and Localization , 2014, ACCV.

[53]  Dinggang Shen,et al.  Computational neuroanatomy of baby brains: A review , 2019, NeuroImage.

[54]  N. Makris,et al.  Regional infant brain development: an MRI-based morphometric analysis in 3 to 13 month olds. , 2013, Cerebral cortex.

[55]  Andrei Irimia,et al.  Clinical neuroimaging in the preterm infant: Diagnosis and prognosis , 2017, NeuroImage: Clinical.

[56]  A. E. Hoerl,et al.  Ridge regression: biased estimation for nonorthogonal problems , 2000 .

[57]  Mahmood Fathy,et al.  Non-negative matrix completion for action detection , 2015, Image Vis. Comput..

[58]  Feiping Nie,et al.  Efficient and Robust Feature Selection via Joint ℓ2, 1-Norms Minimization , 2010, NIPS.

[59]  Alan C. Evans,et al.  Brain development during childhood and adolescence: a longitudinal MRI study , 1999, Nature Neuroscience.

[60]  Jonathan Eckstein,et al.  Understanding the Convergence of the Alternating Direction Method of Multipliers: Theoretical and Computational Perspectives , 2015 .

[61]  Dinggang Shen,et al.  Joint Sparse and Low-Rank Regularized Multi-Task Multi-Linear Regression for Prediction of Infant Brain Development with Incomplete Data , 2017, MICCAI.

[62]  Alan C. Evans,et al.  Early brain development in infants at high risk for autism spectrum disorder , 2017, Nature.

[63]  Dinggang Shen,et al.  Construction of multi-region-multi-reference atlases for neonatal brain MRI segmentation , 2010, NeuroImage.

[64]  Stefanie E. Kuchinsky,et al.  Multiple imputation of missing fMRI data in whole brain analysis , 2012, NeuroImage.

[65]  George A. F. Seber,et al.  Linear regression analysis , 1977 .

[66]  Brian A. Nosek,et al.  Power failure: why small sample size undermines the reliability of neuroscience , 2013, Nature Reviews Neuroscience.

[67]  Dinggang Shen,et al.  Construction of 4D high-definition cortical surface atlases of infants: Methods and applications , 2015, Medical Image Anal..

[68]  Maria Luisa Gorno-Tempini,et al.  Early changes in brain structure correlate with language outcomes in children with neonatal encephalopathy , 2017, NeuroImage: Clinical.

[69]  Dinggang Shen,et al.  Longitudinal development of cortical thickness, folding, and fiber density networks in the first 2 years of life , 2014, Human brain mapping.

[70]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[71]  Mark H. Johnson Functional brain development in humans , 2001, Nature Reviews Neuroscience.

[72]  Guido Gerig,et al.  Increased Extra-axial Cerebrospinal Fluid in High-Risk Infants Who Later Develop Autism , 2017, Biological Psychiatry.

[73]  Dinggang Shen,et al.  Cortical thickness and surface area in neonates at high risk for schizophrenia , 2014, Brain Structure and Function.

[74]  Dinggang Shen,et al.  Spatial distribution and longitudinal development of deep cortical sulcal landmarks in infants , 2014, NeuroImage.

[75]  David A Boas,et al.  Assessment of Infant Brain Development With Frequency-Domain Near-Infrared Spectroscopy , 2007, Pediatric Research.