Individual variation underlying brain age estimates in typical development

Typical brain development follows a protracted trajectory throughout childhood and adolescence. Deviations from typical growth trajectories have been implicated in neurodevelopmental and psychiatric disorders. Recently, the use of machine learning algorithms to model age as a function of structural or functional brain properties has been used to examine advanced or delayed brain maturation in healthy and clinical populations. Termed 'brain age', this approach often relies on complex, nonlinear models that can be difficult to interpret. In this study, we use model explanation methods to examine the cortical features that contribute to brain age modelling on an individual basis. In a large cohort of n=768 typically-developing children (aged 3-21 years), we build models of brain development using three different machine learning approaches. We employ SHAP, a model-agnostic technique to identify sample-specific feature importance, to identify regional cortical metrics that explain errors in brain age prediction. We find that, on average, brain age prediction and the cortical features that explain model predictions are consistent across model types and reflect previously reported patterns of regions brain development. However, while several regions are found to contribute to brain age prediction error, we find little spatial correspondence between individual estimates of feature importance, even when matched for age, sex and brain age prediction error. We also find no association between brain age error and cognitive performance in this typically-developing sample. Overall, this study shows that, while brain age estimates based on cortical development are relatively robust and consistent across model types and preprocessing strategies, significant between-subject variation exists in the features that explain erroneous brain age predictions on an individual level.

[1]  Christos Davatzikos,et al.  Finding imaging patterns of structural covariance via Non-Negative Matrix Factorization , 2015, NeuroImage.

[2]  Erik Strumbelj,et al.  Explaining prediction models and individual predictions with feature contributions , 2014, Knowledge and Information Systems.

[3]  C. F. Beckmann,et al.  Tensorial extensions of independent component analysis for multisubject FMRI analysis , 2005, NeuroImage.

[4]  Giovanni Montana,et al.  Predicting brain age with deep learning from raw imaging data results in a reliable and heritable biomarker , 2016, NeuroImage.

[5]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[6]  Stuart J. Ritchie,et al.  Brain age predicts mortality , 2017, Molecular Psychiatry.

[7]  H. Stefánsson,et al.  Brain age prediction using deep learning uncovers associated sequence variants , 2019, Nature Communications.

[8]  Alan C. Evans,et al.  Longitudinal mapping of cortical thickness and clinical outcome in children and adolescents with attention-deficit/hyperactivity disorder. , 2006, Archives of general psychiatry.

[9]  Timothy O. Laumann,et al.  Towards Reproducible Brain-Wide Association Studies , 2020, bioRxiv.

[10]  Seong Joon Oh,et al.  Learning De-biased Representations with Biased Representations , 2019, ICML.

[11]  Seyed Abolfazl Valizadeh,et al.  Age prediction on the basis of brain anatomical measures , 2017, Human brain mapping.

[12]  Christos Davatzikos,et al.  Accelerated brain aging in schizophrenia and beyond: a neuroanatomical marker of psychiatric disorders. , 2014, Schizophrenia bulletin.

[13]  Danilo Bzdok,et al.  Inferring disease subtypes from clusters in explanation space , 2020, Scientific Reports.

[14]  S. Teipel,et al.  Multimodal analysis of functional and structural disconnection in Alzheimer's disease using multiple kernel SVM , 2015, Human brain mapping.

[15]  Stephen M. Smith,et al.  Estimation of brain age delta from brain imaging , 2019, NeuroImage.

[16]  Karla L Miller,et al.  Brain aging comprises many modes of structural and functional change with distinct genetic and biophysical associations , 2020, eLife.

[17]  Alan C. Evans,et al.  Prediction of brain maturity based on cortical thickness at different spatial resolutions , 2015, NeuroImage.

[18]  Nick C Fox,et al.  Automatic classification of MR scans in Alzheimer's disease. , 2008, Brain : a journal of neurology.

[19]  Karolinska Schizophrenia,et al.  Common brain disorders are associated with heritable patterns of apparent aging of the brain , 2019 .

[20]  Gareth Ball,et al.  Modelling neuroanatomical variation during childhood and adolescence with neighbourhood-preserving embedding , 2017, Scientific Reports.

[21]  Tal Kenet,et al.  The Pediatric Imaging, Neurocognition, and Genetics (PING) Data Repository , 2016, NeuroImage.

[22]  Kyung-Ah Sohn,et al.  Biological Brain Age Prediction Using Cortical Thickness Data: A Large Scale Cohort Study , 2018, Front. Aging Neurosci..

[23]  Christian Gaser,et al.  Ten Years of BrainAGE as a Neuroimaging Biomarker of Brain Aging: What Insights Have We Gained? , 2019, Front. Neurol..

[24]  Ben D. Fulcher,et al.  A practical guide to linking brain-wide gene expression and neuroimaging data , 2018, NeuroImage.

[25]  Christian Gaser,et al.  Changes of individual BrainAGE during the course of the menstrual cycle , 2015, NeuroImage.

[26]  Lars Kai Hansen,et al.  Model sparsity and brain pattern interpretation of classification models in neuroimaging , 2012, Pattern Recognit..

[27]  V. Calhoun,et al.  Source‐based morphometry: The use of independent component analysis to identify gray matter differences with application to schizophrenia , 2009, Human brain mapping.

[28]  Gareth Ball,et al.  Cortical remodelling in childhood is associated with genes enriched for neurodevelopmental disorders , 2019, NeuroImage.

[29]  Olaf Steinsträter,et al.  Brain aging in major depressive disorder: results from the ENIGMA major depressive disorder working group , 2019, bioRxiv.

[30]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[31]  Christos Davatzikos,et al.  Imaging patterns of brain development and their relationship to cognition. , 2015, Cerebral cortex.

[32]  Le Song,et al.  Learning to Explain: An Information-Theoretic Perspective on Model Interpretation , 2018, ICML.

[33]  Luca Baldassarre,et al.  Sparsity Is Better with Stability: Combining Accuracy and Stability for Model Selection in Brain Decoding , 2017, Front. Neurosci..

[34]  Danilo Bzdok,et al.  Different scaling of linear models and deep learning in UKBiobank brain images versus machine-learning datasets , 2020, Nature Communications.

[35]  Andrei G. Vlassenko,et al.  Persistent metabolic youth in the aging female brain , 2019, Proceedings of the National Academy of Sciences.

[36]  Daniel Rueckert,et al.  Multimodal surface matching with higher-order smoothness constraints , 2017, NeuroImage.

[37]  J. Schmitt,et al.  The Heritability of Cortical Folding: Evidence from the Human Connectome Project. , 2020, Cerebral cortex.

[38]  E. Anagnostou,et al.  A Comparison of Neuroimaging Findings in Childhood Onset Schizophrenia and Autism Spectrum Disorder: A Review of the Literature , 2013, Front. Psychiatry.

[39]  M. Mallar Chakravarty,et al.  Normative brain size variation and brain shape diversity in humans , 2018, Science.

[40]  A M Dale,et al.  Measuring the thickness of the human cerebral cortex from magnetic resonance images. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Håkon Grydeland,et al.  Organizing Principles of Human Cortical Development--Thickness and Area from 4 to 30 Years: Insights from Comparative Primate Neuroanatomy. , 2016, Cerebral cortex.

[42]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[43]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[44]  Hugh Chen,et al.  From local explanations to global understanding with explainable AI for trees , 2020, Nature Machine Intelligence.

[45]  Jesper Andersson,et al.  A multi-modal parcellation of human cerebral cortex , 2016, Nature.

[46]  V. Calhoun,et al.  Machine learning of brain gray matter differentiates sex in a large forensic sample , 2018, Human brain mapping.

[47]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[48]  Eileen Luders,et al.  Brain maturation: Predicting individual BrainAGE in children and adolescents using structural MRI , 2012, NeuroImage.

[49]  Alan C. Evans,et al.  Cortical and subcortical T 1 white / gray contrast , chronological age , and cognitive performance , 2022 .

[50]  Vijay K. Venkatraman,et al.  Neuroanatomical Assessment of Biological Maturity , 2012, Current Biology.

[51]  Thomas E. Nichols,et al.  Estimation of Brain Age Delta from Brain Imaging , 2019 .

[52]  L. Cocchi,et al.  Brain-predicted age associates with psychopathology dimensions in youth , 2020, bioRxiv.

[53]  D. Selkoe Alzheimer's disease. , 2011, Cold Spring Harbor perspectives in biology.

[54]  Eveline A. Crone,et al.  Structural brain development between childhood and adulthood: Convergence across four longitudinal samples , 2016, NeuroImage.

[55]  On stability of Canonical Correlation Analysis and Partial Least Squares with application to brain-behavior associations , 2020 .

[56]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.

[57]  J. Cole,et al.  Predicting Age Using Neuroimaging: Innovative Brain Ageing Biomarkers , 2017, Trends in Neurosciences.

[58]  Lloyd T. Elliott,et al.  Brain aging comprises many modes of structural and functional change with distinct genetic and biophysical associations , 2019, bioRxiv.

[59]  Christian Gaser,et al.  Longitudinal Changes in Individual BrainAGE in Healthy Aging, Mild Cognitive Impairment, and Alzheimer’s Disease , 2012 .

[60]  Mark Jenkinson,et al.  Learning patterns of the ageing brain in MRI using deep convolutional networks , 2020, NeuroImage.

[61]  Alan Y. Chiang,et al.  Generalized Additive Models: An Introduction With R , 2007, Technometrics.

[62]  The reliability and heritability of cortical folds and their genetic correlations across hemispheres , 2020, Communications biology.

[63]  Alan C. Evans,et al.  T1 white/gray contrast as a predictor of chronological age, and an index of cognitive performance , 2017, NeuroImage.

[64]  Olivier Potvin,et al.  Bias-adjustment in neuroimaging-based brain age frameworks: A robust scheme , 2019, NeuroImage: Clinical.

[65]  Alexander Binder,et al.  On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation , 2015, PloS one.

[66]  Mark W. Woolrich,et al.  Benefits of multi-modal fusion analysis on a large-scale dataset: Life-span patterns of inter-subject variability in cortical morphometry and white matter microstructure , 2012, NeuroImage.

[68]  Dinggang Shen,et al.  Developmental topography of cortical thickness during infancy , 2019, Proceedings of the National Academy of Sciences.

[69]  John D. Murray,et al.  Generative modeling of brain maps with spatial autocorrelation , 2020, NeuroImage.

[70]  Alan C. Evans,et al.  Trajectories of cortical thickness maturation in normal brain development — The importance of quality control procedures , 2016, NeuroImage.

[71]  Robert Leech,et al.  Prediction of brain age suggests accelerated atrophy after traumatic brain injury , 2015, Annals of neurology.

[72]  S. Eickhoff,et al.  Empirical examination of the replicability of associations between brain structure and psychological variables , 2018, bioRxiv.

[73]  Ricardo Nitrini,et al.  NeuroImage: Clinical , 2022 .

[74]  S. Blakemore,et al.  Development of the Cerebral Cortex across Adolescence: A Multisample Study of Inter-Related Longitudinal Changes in Cortical Volume, Surface Area, and Thickness , 2017, The Journal of Neuroscience.

[75]  M. L. Seal,et al.  Charting shared developmental trajectories of cortical thickness and structural connectivity in childhood and adolescence , 2019, bioRxiv.

[76]  Wojciech Samek,et al.  Methods for interpreting and understanding deep neural networks , 2017, Digit. Signal Process..

[77]  Andrea Vedaldi,et al.  Accurate brain age prediction with lightweight deep neural networks , 2019, bioRxiv.

[78]  Wesley K. Thompson,et al.  A Nonlinear Simulation Framework Supports Adjusting for Age When Analyzing BrainAGE , 2018, bioRxiv.

[79]  Vince D. Calhoun,et al.  Sparse models for correlative and integrative analysis of imaging and genetic data , 2014, Journal of Neuroscience Methods.

[80]  Janaina Mourão Miranda,et al.  Classifying brain states and determining the discriminating activation patterns: Support Vector Machine on functional MRI data , 2005, NeuroImage.

[81]  Vincent Frouin,et al.  Genetic Influence on the Sulcal Pits: On the Origin of the First Cortical Folds , 2018, Cerebral cortex.

[82]  R. Gur,et al.  Patterns of coordinated cortical remodeling during adolescence and their associations with functional specialization and evolutionary expansion , 2017, Proceedings of the National Academy of Sciences.

[83]  Daniel S. Margulies,et al.  Predicting brain-age from multimodal imaging data captures cognitive impairment , 2016, NeuroImage.

[84]  Joanne C. Beer,et al.  Incorporating prior information with fused sparse group lasso: Application to prediction of clinical measures from neuroimages , 2018, Biometrics.

[85]  N. Sebastián-Gallés,et al.  Brain structure is related to speech perception abilities in bilinguals , 2014, Brain Structure and Function.

[86]  Stefan Klöppel,et al.  Robust Detection of Impaired Resting State Functional Connectivity Networks in Alzheimer's Disease Using Elastic Net Regularized Regression , 2017, Frontiers in aging neuroscience.

[87]  J. Rapoport,et al.  Structural MRI of Pediatric Brain Development: What Have We Learned and Where Are We Going? , 2010, Neuron.

[88]  Leland McInnes,et al.  UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction , 2018, ArXiv.

[89]  Russell T. Shinohara,et al.  Statistical Pitfalls in Brain Age Analyses , 2020, bioRxiv.

[90]  Jacob A. Alappatt,et al.  Deviation from normative brain development is associated with symptom severity in autism spectrum disorder , 2019, Molecular Autism.

[91]  Emily J. Ward,et al.  Patterns in the human brain mosaic discriminate males from females , 2016, Proceedings of the National Academy of Sciences.

[92]  Trang T. Le,et al.  Effect of Ibuprofen on BrainAGE: A Randomized, Placebo-Controlled, Dose-Response Exploratory Study. , 2018, Biological psychiatry. Cognitive neuroscience and neuroimaging.

[93]  Jussi Tohka,et al.  Cortical and subcortical T1 white/gray contrast, chronological age, and cognitive performance , 2019, NeuroImage.

[94]  Mark Jenkinson,et al.  MSM: A new flexible framework for Multimodal Surface Matching , 2014, NeuroImage.

[95]  Stefan Klöppel,et al.  Estimating the age of healthy subjects from T1-weighted MRI scans using kernel methods: Exploring the influence of various parameters , 2010, NeuroImage.

[96]  Armin Raznahan,et al.  How Does Your Cortex Grow? , 2011, The Journal of Neuroscience.

[97]  Trevor Hastie,et al.  Assessing the significance of global and local correlations under spatial autocorrelation: A nonparametric approach , 2014, Biometrics.

[98]  Anders M. Dale,et al.  Common brain disorders are associated with heritable patterns of apparent aging of the brain , 2019, Nature Neuroscience.

[99]  Dick J. Veltman,et al.  Controlling for effects of confounding variables on machine learning predictions , 2020, bioRxiv.

[100]  Ke Li,et al.  Predicting Brain Age of Healthy Adults Based on Structural MRI Parcellation Using Convolutional Neural Networks , 2020, Frontiers in Neurology.

[101]  J. Gilmore,et al.  Dynamic Development of Regional Cortical Thickness and Surface Area in Early Childhood. , 2015, Cerebral cortex.

[102]  Avanti Shrikumar,et al.  Learning Important Features Through Propagating Activation Differences , 2017, ICML.

[103]  Linda Chang,et al.  The NIH Toolbox Cognition Battery: results from a large normative developmental sample (PING). , 2014, Neuropsychology.

[104]  John Kounios,et al.  Improved prediction of brain age using multimodal neuroimaging data , 2019, Human brain mapping.

[105]  Christos Davatzikos,et al.  Evaluation of non-negative matrix factorization of grey matter in age prediction , 2018, NeuroImage.

[106]  H. H. Hulshoff Pol,et al.  The Speed of Development of Adolescent Brain Age Depends on Sex and Is Genetically Determined , 2020, Cerebral cortex.

[108]  Lara M. Wierenga,et al.  Development of cortical thickness and surface area in autism spectrum disorder , 2016, NeuroImage: Clinical.

[109]  John D. Murray,et al.  Generative modeling of brain maps with spatial autocorrelation , 2020, NeuroImage.

[110]  Mark Jenkinson,et al.  Learning patterns of the ageing brain in MRI using deep convolutional networks , 2021, NeuroImage.

[111]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[112]  Mark E Bastin,et al.  Sex Differences in the Adult Human Brain: Evidence from 5216 UK Biobank Participants , 2017, bioRxiv.

[113]  Hualou Liang,et al.  Investigating systematic bias in brain age estimation with application to post‐traumatic stress disorders , 2019, Human brain mapping.

[114]  Peter J Hellyer,et al.  Human brain mapping , 2012, Nature Methods.

[115]  Kjersti Aas,et al.  Explaining individual predictions when features are dependent: More accurate approximations to Shapley values , 2019, Artif. Intell..

[116]  Mert R. Sabuncu,et al.  Deep neural networks and kernel regression achieve comparable accuracies for functional connectivity prediction of behavior and demographics , 2020, NeuroImage.

[117]  Russell T. Shinohara,et al.  Harmonization of cortical thickness measurements across scanners and sites , 2017, NeuroImage.

[118]  N. Jahanshad,et al.  The reliability and heritability of cortical folds and their genetic correlations across hemispheres , 2019, bioRxiv.

[119]  Alan C. Evans,et al.  Attention-deficit/hyperactivity disorder is characterized by a delay in cortical maturation , 2007, Proceedings of the National Academy of Sciences.

[120]  Efstathios D. Gennatas,et al.  Age-Related Effects and Sex Differences in Gray Matter Density, Volume, Mass, and Cortical Thickness from Childhood to Young Adulthood , 2017, The Journal of Neuroscience.

[121]  Ke Li,et al.  Predicting Brain Age Based on Spatial and Temporal Features of Human Brain Functional Networks , 2019, Front. Hum. Neurosci..