Uncertainty-Aware Body Composition Analysis with Deep Regression Ensembles on UK Biobank MRI

Along with rich health-related metadata, medical images have been acquired for over 40,000 male and female UK Biobank participants, aged 44-82, since 2014. Phenotypes derived from these images, such as measurements of body composition from MRI, can reveal new links between genetics, cardiovascular disease, and metabolic conditions. In this work, six measurements of body composition and adipose tissues were automatically estimated by image-based, deep regression with ResNet50 neural networks from neck-to-knee body MRI. Despite the potential for high speed and accuracy, these networks produce no output segmentations that could indicate the reliability of individual measurements. The presented experiments therefore examine uncertainty quantification with mean-variance regression and ensembling to estimate individual measurement errors and thereby identify potential outliers, anomalies, and other failure cases automatically. In 10-fold cross-validation on data of about 8500 subjects, mean-variance regression and ensembling showed complementary benefits, reducing the mean absolute error across all predictions by 12%. Both improved the calibration of uncertainties and their ability to identify high prediction errors. With intra-class correlation coefficients (ICC) above 0.97, all targets except the liver fat content yielded relative measurement errors below 5%. Testing on another 1000 subjects showed consistent performance, and the method was finally deployed for inference to 30,000 subjects with missing reference values. The results indicate that deep regression ensembles could ultimately provide automated, uncertainty-aware measurements of body composition for more than 120,000 UK Biobank neck-to-knee body MRI that are to be acquired within the coming years.

[1]  Charles Blundell,et al.  Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles , 2016, NIPS.

[2]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  Alex Kendall,et al.  What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? , 2017, NIPS.

[4]  F. Schick,et al.  Fully Automated and Standardized Segmentation of Adipose Tissue Compartments via Deep Learning in 3D Whole-Body MRI of Epidemiologic Cohort Studies. , 2020, Radiology. Artificial intelligence.

[5]  Nassir Navab,et al.  Bayesian QuickNAT: Model uncertainty in deep whole-brain segmentation for structure-wise quality control , 2018, NeuroImage.

[6]  Yi Liu,et al.  Automated Measurement of Pancreatic Fat and Iron Concentration Using Multi-Echo and T1-Weighted MRI Data , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[7]  Thomas Brox,et al.  Uncertainty Estimates and Multi-hypotheses Networks for Optical Flow , 2018, ECCV.

[8]  Kilian Q. Weinberger,et al.  On Calibration of Modern Neural Networks , 2017, ICML.

[9]  Petro M. Kostandy,et al.  Automated Abdominal Segmentation of CT Scans for Body Composition Analysis Using Deep Learning. , 2019, Radiology.

[10]  Alejandro F. Frangi,et al.  The UK Biobank imaging enhancement of 100,000 participants: rationale, data collection, management and future directions , 2020, Nature Communications.

[11]  Anders Forslund,et al.  Fully convolutional networks for automated segmentation of abdominal adipose tissue depots in multicenter water–fat MRI , 2018, Magnetic resonance in medicine.

[12]  Sebastian Nowozin,et al.  Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift , 2019, NeurIPS.

[13]  Johan Wikström,et al.  Identifying Morphological Indicators of Aging With Neural Networks on Large-Scale Whole-Body MRI , 2020, IEEE Transactions on Medical Imaging.

[14]  Ben Glocker,et al.  Automated cardiovascular magnetic resonance image analysis with fully convolutional networks , 2017, Journal of Cardiovascular Magnetic Resonance.

[15]  Thomas B. Schön,et al.  Evaluating Scalable Bayesian Deep Learning Methods for Robust Computer Vision , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[16]  Lüder A. Kahrs,et al.  Well-Calibrated Regression Uncertainty in Medical Imaging with Deep Learning , 2020, MIDL.

[17]  Balaji Lakshminarayanan,et al.  Deep Ensembles: A Loss Landscape Perspective , 2019, ArXiv.

[18]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal of chiropractic medicine.

[19]  Stuart J. Ritchie,et al.  Brain age predicts mortality , 2017, Molecular Psychiatry.

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  Yi Zhang,et al.  Fetal brain age estimation and anomaly detection using attention-based deep ensembles with uncertainty , 2020, NeuroImage.

[22]  A. Weigend,et al.  Estimating the mean and variance of the target probability distribution , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[23]  Zoubin Ghahramani,et al.  Probabilistic machine learning and artificial intelligence , 2015, Nature.

[24]  J. Kullberg,et al.  Large-scale inference of liver fat with neural networks on UK Biobank body MRI , 2020, International Conference on Medical Image Computing and Computer-Assisted Intervention.

[25]  Brandon Whitcher,et al.  Large-scale analysis of iliopsoas muscle volumes in the UK Biobank , 2020, Scientific reports.

[26]  Sergios Gatidis,et al.  Fully Automated and Standardized Segmentation of Adipose Tissue Compartments by Deep Learning in Three-dimensional Whole-body MRI of Epidemiological Cohort Studies , 2020, ArXiv.

[27]  Hong Liu,et al.  A two-step convolutional neural network based computer-aided detection scheme for automatically segmenting adipose tissue volume depicting on CT images , 2017, Comput. Methods Programs Biomed..

[28]  Magnus Borga,et al.  Validation of a fast method for quantification of intra‐abdominal and subcutaneous adipose tissue for large‐scale human studies , 2015, NMR in biomedicine.

[29]  M. Borga MRI adipose tissue and muscle composition analysis-a review of automation techniques. , 2018, The British journal of radiology.

[30]  Ran Lu,et al.  FatSegNet: A fully automated deep learning pipeline for adipose tissue segmentation on abdominal dixon MRI , 2019, Magnetic resonance in medicine.

[31]  Magnus Borga,et al.  Body Composition Profiling in the UK Biobank Imaging Study , 2018, Obesity.

[32]  Dmitry Vetrov,et al.  Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learning , 2020, ICLR.

[33]  Michael Brady,et al.  Deep Quantitative Liver Segmentation and Vessel Exclusion to Assist in Liver Assessment , 2017, MIUA.

[34]  Wufeng Xue,et al.  Direct Multitype Cardiac Indices Estimation via Joint Representation and Regression Learning , 2017, IEEE Transactions on Medical Imaging.

[35]  Michael Brady,et al.  Pancreas Segmentation-Derived Biomarkers: Volume and Shape Metrics in the UK Biobank Imaging Study , 2020, MIUA.

[36]  Michael V. McConnell,et al.  Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning , 2017, Nature Biomedical Engineering.

[37]  Stefan Neubauer,et al.  Characterisation of liver fat in the UK Biobank cohort , 2017, PloS one.

[38]  Andreas Wallin,et al.  Kidney segmentation in neck-to-knee body MRI of 40,000 UK Biobank participants , 2020, Scientific Reports.

[39]  Jimmy D Bell,et al.  Systematic quantification of health parameters from UK Biobank abdominal MRI , 2020, bioRxiv.

[40]  P. Elliott,et al.  UK Biobank: An Open Access Resource for Identifying the Causes of a Wide Range of Complex Diseases of Middle and Old Age , 2015, PLoS medicine.

[41]  Joel Kullberg,et al.  Large-scale biometry with interpretable neural network regression on UK Biobank body MRI , 2020, Scientific reports.

[42]  Abdul Ghapor Hussin,et al.  Computerized Medical Imaging and Graphics. , 2011 .

[43]  Martin Danelljan,et al.  Energy-Based Models for Deep Probabilistic Regression , 2020, ECCV.

[44]  Magnus Borga,et al.  Feasibility of MR-Based Body Composition Analysis in Large Scale Population Studies , 2016, PloS one.

[45]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[46]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  M. Cule,et al.  Genetic architecture of 11 organ traits derived from abdominal MRI using deep learning , 2021, eLife.

[48]  Göran Falkman,et al.  Evaluation of Uncertainty Quantification in Deep Learning , 2020, IPMU.