Deep transfer learning of brain shape morphometry predicts Body Mass Index (BMI) in the UK Biobank

Prior studies show that obesity is associated with accelerated brain aging and specific patterns of brain atrophy. Finerscale mapping of the effects of obesity on the brain would help to understand how it promotes or interacts with disease effects, but so far, the influence of the obesity on finer-scale maps of anatomy remains unclear. In this study, we propose a deep transfer learning network based on Optimal Mass Transport (OMTNet) to classify individuals with normal versus overweight/obese body mass index (BMI) using vertex-wise brain shape metrics extracted from structural MRI scans from the UK Biobank study. First, an area-preserving mapping was used to project 3D brain surface meshes onto 2D planar meshes. Vertex-wise maps of brain metrics such as cortical thickness were mapped into 2D planar images for each brain surface extracted from each person’s MRI scan. Second, several popular networks pretrained on the ImageNet database, i.e., VGG19, ResNet152 and DenseNet201, were used for transfer learning of brain shape metrics. We combined all shape metrics and generated a metric ensemble classification, and then combined all three networks and generated a network ensemble classification. The results reveal that transfer learning always outperforms direct learning, and we obtained accuracies of 65.6±0.7% and 62.7±0.7% for transfer and direct learning in the network ensemble classification, respectively. Moreover, surface area and cortical thickness, especially in the left hemisphere, consistently achieved the highest classification accuracies, together with subcortical shape metrics. The findings suggest a significant and classifiable influence of obesity on brain shape. Our proposed OMTNet method may offer a powerful transfer learning framework that can be extended to other vertex-wise brain structural and functional imaging measures.

[1]  A. Mechelli,et al.  Using deep learning to investigate the neuroimaging correlates of psychiatric and neurological disorders: Methods and applications , 2017, Neuroscience & Biobehavioral Reviews.

[2]  P. Matthews,et al.  Multimodal population brain imaging in the UK Biobank prospective epidemiological study , 2016, Nature Neuroscience.

[3]  Russell T. Shinohara,et al.  Removal of Scanner Effects in Covariance Improves Multivariate Pattern Analysis in Neuroimaging Data , 2019, bioRxiv.

[4]  Sebastien Ourselin,et al.  Modeling longitudinal imaging biomarkers with parametric Bayesian multi-task learning , 2019 .

[5]  Paul M. Thompson,et al.  Shape matching with medial curves and 1-D group-wise registration , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[6]  V. Calhoun,et al.  Towards a brain‐based predictome of mental illness , 2020, Human brain mapping.

[7]  Xue Hua,et al.  The effects of physical activity, education, and body mass index on the aging brain , 2011, Human brain mapping.

[8]  Russell T. Shinohara,et al.  Harmonization of cortical thickness measurements across scanners and sites , 2017, NeuroImage.

[9]  Dmitry Isaev,et al.  Mapping Subcortical Brain Alterations in 22q11.2 Deletion Syndrome: Effects of Deletion Size and Convergence With Idiopathic Neuropsychiatric Illness. , 2020, The American journal of psychiatry.

[10]  John LaRocco,et al.  Optimizing Computer–Brain Interface Parameters for Non-invasive Brain-to-Brain Interface , 2020, Frontiers in Neuroinformatics.

[11]  Zoltán Vidnyánszky,et al.  Predicting Body Mass Index From Structural MRI Brain Images Using a Deep Convolutional Neural Network , 2020, Frontiers in Neuroinformatics.

[12]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[13]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[14]  Marisa O. Hollinshead,et al.  The organization of the human cerebral cortex estimated by intrinsic functional connectivity. , 2011, Journal of neurophysiology.

[15]  A. Toga,et al.  Brain Structure and Obesity , 2009, NeuroImage.

[16]  Dan J Stein,et al.  Subcortical shape alterations in major depressive disorder: Findings from the ENIGMA major depressive disorder working group , 2019, bioRxiv.

[17]  Paul M. Thompson,et al.  Medial demons registration localizes the degree of genetic influence over subcortical shape variability: An N= 1480 meta-analysis , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[18]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[19]  Mark Hamer,et al.  Association of body mass index and waist-to-hip ratio with brain structure , 2019, Neurology.

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[22]  Wei Zeng,et al.  Area Preserving Brain Mapping , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).