A Novel Supervised Contrastive Regression Framework for Prediction of Neurocognitive Measures Using Multi-Site Harmonized Diffusion MRI Tractography

—Neuroimaging-based prediction of neurocognitive measures is valuable for studying how the brain’s structure relates to cognitive function. However, the accuracy of prediction using popular linear regression models is relatively low. We propose Supervised Contrastive Regression (SCR), a simple yet effective method that allows full supervision for contrastive learning in regression tasks. SCR performs supervised contrastive representation learning by using the absolute difference between continuous regression labels (i.e. neurocognitive scores) to de- termine positive and negative pairs. We apply SCR to analyze a large-scale dataset including multi-site harmonized diffusion MRI and neurocognitive data from 8735 participants in the Adolescent Brain Cognitive Development (ABCD) Study. We extract white matter microstructural measures using a fine parcellation of white matter tractography into fiber clusters. We predict three scores related to domains of higher-order cognition (general cognitive ability, executive function, and learning/memory). To identify important fiber clusters for prediction of these neurocognitive scores, we propose a permutation feature importance method for high-dimensional data. We find that SCR improves the accuracy of neurocognitive score prediction compared to other state-of-the-art methods. We find that the most predictive fiber clusters are predominantly located within the superficial white matter and projection tracts, particularly the superficial frontal white matter and striato-frontal connections. Overall, our results demonstrate the utility of contrastive representation learning methods for regression, and in particular for improving neuroimaging-based prediction of higher-order cognitive abilities.

[1]  B. Yeo,et al.  Cross-cohort replicability and generalizability of connectivity-based psychometric prediction patterns , 2022, NeuroImage.

[2]  Linda G. Shapiro,et al.  Brain-Aware Replacements for Supervised Contrastive Learning in Detection of Alzheimer’s Disease , 2022 .

[3]  Yang Song,et al.  White Matter Tracts are Point Clouds: Neuropsychological Score Prediction and Critical Region Localization via Geometric Deep Learning , 2022, MICCAI.

[4]  Y. Ye,et al.  Fine-grained Correlation Loss for Regression , 2022, MICCAI.

[5]  Y. Rathi,et al.  Harmonization of Multi-Site Diffusion Magnetic Resonance Imaging Data From the Adolescent Brain Cognitive Development Study , 2022, Biological Psychiatry.

[6]  N. Shu,et al.  Methodological evaluation of individual cognitive prediction based on the brain white matter structural connectome , 2022, Human brain mapping.

[7]  V. Tomassini,et al.  A tractometry principal component analysis of white matter tract network structure and relationships with cognitive function in relapsing-remitting multiple sclerosis , 2022, NeuroImage: Clinical.

[8]  A. Holmes,et al.  Comparison of individualized behavioral predictions across anatomical, diffusion and functional connectivity MRI , 2022, NeuroImage.

[9]  M. Altaye,et al.  ConCeptCNN: A novel multi-filter convolutional neural network for the prediction of neurodevelopmental disorders using brain connectome. , 2022, Medical physics.

[10]  L. Oestreich,et al.  Cholinergic and hippocampal systems facilitate cross-domain cognitive recovery after stroke , 2022, Brain : a journal of neurology.

[11]  Steven D. Pieper,et al.  Model and Predict Age and Sex in Healthy Subjects Using Brain White Matter Features: A Deep Learning Approach , 2022, 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI).

[12]  N. Makris,et al.  Supwma: Consistent and Efficient Tractography Parcellation of Superficial White Matter with Deep Learning , 2022, 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI).

[13]  Kwang-Ting Cheng,et al.  Adaptive Contrast for Image Regression in Computer-Aided Disease Assessment , 2021, IEEE Transactions on Medical Imaging.

[14]  Alexandra J. Golby,et al.  White matter association tracts underlying language and theory of mind: An investigation of 809 brains from the Human Connectome Project , 2021, NeuroImage.

[15]  Yi Tay,et al.  SCARF: Self-Supervised Contrastive Learning using Random Feature Corruption , 2021, ICLR.

[16]  Yong He,et al.  Quantitative mapping of the brain’s structural connectivity using diffusion MRI tractography: A review , 2021, NeuroImage.

[17]  Gjergji Kasneci,et al.  Deep Neural Networks and Tabular Data: A Survey , 2021, ArXiv.

[18]  C. Beckmann,et al.  Supervised Phenotype Discovery from Multimodal Brain Imaging , 2021, bioRxiv.

[19]  Valentin Khrulkov,et al.  Revisiting Deep Learning Models for Tabular Data , 2021, NeurIPS.

[20]  Josif Grabocka,et al.  Well-tuned Simple Nets Excel on Tabular Datasets , 2021, NeurIPS.

[21]  Antoine Grigis,et al.  Contrastive Learning with Continuous Proxy Meta-Data for 3D MRI Classification , 2021, MICCAI.

[22]  E. Asano,et al.  Prediction of baseline expressive and receptive language function in children with focal epilepsy using diffusion tractography-based deep learning network , 2021, Epilepsy & Behavior.

[23]  Li Shen,et al.  A structural enriched functional network: An application to predict brain cognitive performance , 2021, Medical Image Anal..

[24]  Andrew Zalesky,et al.  High-resolution connectomic fingerprints: Mapping neural identity and behavior , 2021, NeuroImage.

[25]  Guotai Wang,et al.  Contrastive Learning of Relative Position Regression for One-Shot Object Localization in 3D Medical Images , 2020, MICCAI.

[26]  K. Amunts,et al.  Contrastive Representation Learning For Whole Brain Cytoarchitectonic Mapping In Histological Human Brain Sections , 2020, 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI).

[27]  Xinlei Chen,et al.  Exploring Simple Siamese Representation Learning , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  C. Lebel,et al.  Development of white matter microstructure and executive functions during childhood and adolescence: a review of diffusion MRI studies , 2020, Developmental Cognitive Neuroscience.

[29]  Stuart J. Ritchie,et al.  Aging-Sensitive Networks Within the Human Structural Connectome Are Implicated in Late-Life Cognitive Declines , 2020, Biological Psychiatry.

[30]  M. Thiebaut de Schotten,et al.  White matter variability, cognition, and disorders: a systematic review , 2020, Brain Structure and Function.

[31]  Sercan O. Arik,et al.  TabNet: Attentive Interpretable Tabular Learning , 2019, AAAI.

[32]  W. Yuan,et al.  Early Prediction of Cognitive Deficit in Very Preterm Infants Using Brain Structural Connectome With Transfer Learning Enhanced Deep Convolutional Neural Networks , 2020, Frontiers in Neuroscience.

[33]  Tingting Jiang,et al.  Norm-in-Norm Loss with Faster Convergence and Better Performance for Image Quality Assessment , 2020, ACM Multimedia.

[34]  Ce Liu,et al.  Supervised Contrastive Learning , 2020, NeurIPS.

[35]  N. Shu,et al.  Age-Related Decline in the Topological Efficiency of the Brain Structural Connectome and Cognitive Aging. , 2020, Cerebral cortex.

[36]  Stephen M. Smith,et al.  Phenotype discovery from population brain imaging , 2020, bioRxiv.

[37]  Carl-Fredrik Westin,et al.  SlicerDMRI: Diffusion MRI and Tractography Research Software for Brain Cancer Surgery Planning and Visualization , 2020, JCO clinical cancer informatics.

[38]  Geoffrey E. Hinton,et al.  A Simple Framework for Contrastive Learning of Visual Representations , 2020, ICML.

[39]  Andrew Zalesky,et al.  Network communication models improve the behavioral and functional predictive utility of the human structural connectome , 2020, bioRxiv.

[40]  Mihaela van der Schaar,et al.  VIME: Extending the Success of Self- and Semi-supervised Learning to Tabular Domain , 2020, NeurIPS.

[41]  Antoine Grigis,et al.  Quantifying performance of machine learning methods for neuroimaging data , 2019, NeuroImage.

[42]  C. Sripada,et al.  Prediction of neurocognition in youth from resting state fMRI , 2019, Molecular Psychiatry.

[43]  Ye Wu,et al.  Test–retest reproducibility of white matter parcellation using diffusion MRI tractography fiber clustering , 2019, Human brain mapping.

[44]  P. Pérez,et al.  SoDeep: A Sorting Deep Net to Learn Ranking Loss Surrogates , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  D. Barch,et al.  The structure of cognition in 9 and 10 year-old children and associations with problem behaviors: Findings from the ABCD study’s baseline neurocognitive battery , 2018, Developmental Cognitive Neuroscience.

[46]  Jonathan R. Walsh,et al.  Machine learning for comprehensive forecasting of Alzheimer’s Disease progression , 2018, Scientific Reports.

[47]  Yogesh Rathi,et al.  Retrospective harmonization of multi-site diffusion MRI data acquired with different acquisition parameters , 2019, NeuroImage.

[48]  Richard McKinley,et al.  Adolescent Brain Cognitive Development Neurocognitive Prediction: First Challenge, ABCD-NP 2019, Held in Conjunction with MICCAI 2019, Shenzhen, China, October 13, 2019, Proceedings , 2019, ABCD-NP@MICCAI.

[49]  Yogesh Rathi,et al.  An anatomically curated fiber clustering white matter atlas for consistent white matter tract parcellation across the lifespan , 2018, NeuroImage.

[50]  G. Gong,et al.  The effect of machine learning regression algorithms and sample size on individualized behavioral prediction with functional connectivity features , 2018, NeuroImage.

[51]  Kylie H. Alm,et al.  White matter pathways and social cognition , 2018, Neuroscience & Biobehavioral Reviews.

[52]  Paola Galdi,et al.  A distributed brain network predicts general intelligence from resting-state human neuroimaging data , 2018, bioRxiv.

[53]  Anders M. Dale,et al.  The Adolescent Brain Cognitive Development (ABCD) study: Imaging acquisition across 21 sites , 2018, Developmental Cognitive Neuroscience.

[54]  D. Barch,et al.  Adolescent neurocognitive development and impacts of substance use: Overview of the adolescent brain cognitive development (ABCD) baseline neurocognition battery , 2018, Developmental Cognitive Neuroscience.

[55]  N. Volkow,et al.  The conception of the ABCD study: From substance use to a broad NIH collaboration , 2017, Developmental Cognitive Neuroscience.

[56]  Anna Veronika Dorogush,et al.  CatBoost: unbiased boosting with categorical features , 2017, NeurIPS.

[57]  Carl-Fredrik Westin,et al.  SlicerDMRI: Open Source Diffusion MRI Software for Brain Cancer Research. , 2017, Cancer research.

[58]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[59]  Yogesh Rathi,et al.  Joint Multi-Fiber NODDI Parameter Estimation and Tractography Using the Unscented Information Filter , 2016, Front. Neurosci..

[60]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[61]  Robert K. Heaton,et al.  Demographically Corrected Normative Standards for the English Version of the NIH Toolbox Cognition Battery , 2015, Journal of the International Neuropsychological Society.

[62]  Hannah R. Snyder,et al.  Advancing understanding of executive function impairments and psychopathology: bridging the gap between clinical and cognitive approaches , 2015, Front. Psychol..

[63]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[64]  Martha Elizabeth Shenton,et al.  Filtered Multitensor Tractography , 2010, IEEE Transactions on Medical Imaging.

[65]  Gavin Brown,et al.  Ensemble Learning , 2010, Encyclopedia of Machine Learning and Data Mining.

[66]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[67]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[68]  P. Basser,et al.  In vivo fiber tractography using DT‐MRI data , 2000, Magnetic resonance in medicine.

[69]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .