Longitudinal Correlation Analysis for Decoding Multi-Modal Brain Development

Starting from childhood, the human brain restructures and rewires throughout life. Characterizing such complex brain development requires effective analysis of longitudinal and multi-modal neuroimaging data. Here, we propose such an analysis approach named Longitudinal Correlation Analysis (LCA). LCA couples the data of two modalities by first reducing the input from each modality to a latent representation based on autoencoders. A self-supervised strategy then relates the two latent spaces by jointly disentangling two directions, one in each space, such that the longitudinal changes in latent representations along those directions are maximally correlated between modalities. We applied LCA to analyze the longitudinal T1-weighted and diffusion-weighted MRIs of 679 youths from the National Consortium on Alcohol and Neurodevelopment in Adolescence. Unlike existing approaches that focus on either cross-sectional or single-modal modeling, LCA successfully unraveled coupled macrostructural and microstructural brain development from morphological and diffusivity features extracted from the data. A retesting of LCA on raw 3D image volumes of those subjects successfully replicated the findings from the feature-based analysis. Lastly, the developmental effects revealed by LCA were inline with the current understanding of maturational patterns of the adolescent brain.

[1]  Kaiming He,et al.  Momentum Contrast for Unsupervised Visual Representation Learning , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  J. Giedd.  Structural Magnetic Resonance Imaging of the Adolescent Brain , 2004, Annals of the New York Academy of Sciences.

[3]  Adolf Pfefferbaum,et al.  The SRI24 multichannel atlas of normal adult human brain structure , 2009, Human brain mapping.

[4]  Bernhard Schölkopf,et al.  Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representations , 2018, ICML.

[5]  Cheryl L. Grady,et al.  Trajectories of brain system maturation from childhood to older adulthood: Implications for lifespan cognitive functioning , 2017, NeuroImage.

[6]  Andrew Zisserman,et al.  Self-supervised Co-training for Video Representation Learning , 2020, NeurIPS.

[7]  Vaidehi S. Natu,et al.  Apparent thinning of human visual cortex during childhood is associated with myelination , 2019, Proceedings of the National Academy of Sciences.

[8]  Ruslan Salakhutdinov,et al.  Self-supervised Learning from a Multi-view Perspective , 2020, ICLR.

[9]  Jeff A. Bilmes,et al.  On Deep Multi-View Representation Learning , 2015, ICML.

[10]  Daniel Rueckert,et al.  Tract-based spatial statistics: Voxelwise analysis of multi-subject diffusion data , 2006, NeuroImage.

[11]  P. Szeszko,et al.  MRI atlas of human white matter , 2006 .

[12]  Kilian M. Pohl,et al.  Longitudinal self-supervised learning , 2021, Medical Image Anal..

[13]  Liang Chen,et al.  Self-supervised learning for medical image analysis using image context restoration , 2019, Medical Image Anal..

[14]  Kilian M. Pohl,et al.  Harmonizing DTI measurements across scanners to examine the development of white matter microstructure in 803 adolescents of the NCANDA study , 2016, NeuroImage.

[15]  Yuan Xie,et al.  Applications of Deep Learning to Neuro-Imaging Techniques , 2019, Front. Neurol..

[16]  Adolf Pfefferbaum,et al.  Altered Brain Developmental Trajectories in Adolescents After Initiating Drinking. , 2017, The American journal of psychiatry.

[17]  Beatriz Luna,et al.  Developmental stages and sex differences of white matter and behavioral development through adolescence: A longitudinal diffusion tensor imaging (DTI) study , 2014, NeuroImage.

[18]  Bruce Fischl,et al.  FreeSurfer , 2012, NeuroImage.

[19]  Jeff A. Bilmes,et al.  Deep Canonical Correlation Analysis , 2013, ICML.

[20]  John H. Gilmore,et al.  Towards analysis of growth trajectory through multimodal longitudinal MR imaging , 2010, Medical Imaging.

[21]  Alexander Leemans,et al.  Microstructural maturation of the human brain from childhood to adulthood , 2008, NeuroImage.

[22]  Daniel C. Alexander,et al.  Camino: Open-Source Diffusion-MRI Reconstruction and Processing , 2006 .

[23]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[24]  Ken Aho,et al.  Model selection for ecologists: the worldviews of AIC and BIC. , 2014, Ecology.

[25]  Xiaojing Liu,et al.  Association Between HLA Genotype and Cutaneous Adverse Reactions to Antiepileptic Drugs Among Epilepsy Patients in Northwest China , 2019, Front. Neurol..

[26]  Torsten Rohlfing,et al.  The National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA): A Multisite Study of Adolescent Development and Substance Use. , 2015, Journal of studies on alcohol and drugs.