Fully Automated and Standardized Segmentation of Adipose Tissue Compartments by Deep Learning in Three-dimensional Whole-body MRI of Epidemiological Cohort Studies

Purpose: To enable fast and reliable assessment of subcutaneous and visceral adipose tissue compartments derived from whole-body MRI. Methods: Quantification and localization of different adipose tissue compartments from whole-body MR images is of high interest to examine metabolic conditions. For correct identification and phenotyping of individuals at increased risk for metabolic diseases, a reliable automatic segmentation of adipose tissue into subcutaneous and visceral adipose tissue is required. In this work we propose a 3D convolutional neural network (DCNet) to provide a robust and objective segmentation. In this retrospective study, we collected 1000 cases (66$\pm$ 13 years; 523 women) from the Tuebingen Family Study and from the German Center for Diabetes research (TUEF/DZD), as well as 300 cases (53$\pm$ 11 years; 152 women) from the German National Cohort (NAKO) database for model training, validation, and testing with a transfer learning between the cohorts. These datasets had variable imaging sequences, imaging contrasts, receiver coil arrangements, scanners and imaging field strengths. The proposed DCNet was compared against a comparable 3D UNet segmentation in terms of sensitivity, specificity, precision, accuracy, and Dice overlap. Results: Fast (5-7seconds) and reliable adipose tissue segmentation can be obtained with high Dice overlap (0.94), sensitivity (96.6%), specificity (95.1%), precision (92.1%) and accuracy (98.4%) from 3D whole-body MR datasets (field of view coverage 450x450x2000mm${}^3$). Segmentation masks and adipose tissue profiles are automatically reported back to the referring physician. Conclusion: Automatic adipose tissue segmentation is feasible in 3D whole-body MR data sets and is generalizable to different epidemiological cohort studies with the proposed DCNet.

[1]  Antonio Criminisi,et al.  Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning , 2012, Found. Trends Comput. Graph. Vis..

[2]  Yueting Zhuang,et al.  Deep Convolutional Neural Networks with Merge-and-Run Mappings , 2016, IJCAI.

[3]  Magnus Borga,et al.  Body Composition Profiling in the UK Biobank Imaging Study , 2018, Obesity.

[4]  C. Lavie,et al.  Impact of obesity on the risk of heart failure and its prognosis. , 2008, Journal of the cardiometabolic syndrome.

[5]  Charles A McKenzie,et al.  Validation of volumetric and single‐slice MRI adipose analysis using a novel fully automated segmentation method , 2015, Journal of magnetic resonance imaging : JMRI.

[6]  A. Kissebah,et al.  Relation of body fat distribution to metabolic complications of obesity. , 1982, The Journal of clinical endocrinology and metabolism.

[7]  Relationship between visceral fat accumulation and anti-lipolytic action of insulin in patients with type 2 diabetes mellitus. , 2002, Endocrine journal.

[8]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[9]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[10]  Mert R. Sabuncu,et al.  Multi-atlas segmentation of biomedical images: A survey , 2014, Medical Image Anal..

[11]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[12]  Nicholas Ayache,et al.  Medical Image Analysis: Progress over Two Decades and the Challenges Ahead , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[14]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[15]  S. Reeder,et al.  Proton density fat‐fraction: A standardized mr‐based biomarker of tissue fat concentration , 2012, Journal of magnetic resonance imaging : JMRI.

[16]  Anders Forslund,et al.  Fully convolutional networks for automated segmentation of abdominal adipose tissue depots in multicenter water–fat MRI , 2018, Magnetic resonance in medicine.

[17]  Chuan Zhou,et al.  Deep Learning in Medical Image Analysis. , 2017, Advances in experimental medicine and biology.

[18]  Fritz Schick,et al.  Follow-up whole-body assessment of adipose tissue compartments during a lifestyle intervention in a large cohort at increased risk for type 2 diabetes. , 2010, Radiology.

[19]  Fritz Schick,et al.  Topography mapping of whole body adipose tissue using A fully automated and standardized procedure , 2010, Journal of magnetic resonance imaging : JMRI.

[20]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[21]  Dimitris N. Metaxas,et al.  Automated anatomical landmark detection ondistal femur surface using convolutional neural network , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[22]  W. T. Dixon Simple proton spectroscopic imaging. , 1984, Radiology.

[23]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[24]  S. Reeder,et al.  Multiecho water‐fat separation and simultaneous R  2* estimation with multifrequency fat spectrum modeling , 2008, Magnetic resonance in medicine.

[25]  Max A. Viergever,et al.  2D image classification for 3D anatomy localization: employing deep convolutional neural networks , 2016, SPIE Medical Imaging.

[26]  Jia Gu,et al.  Superpixel-based and boundary-sensitive convolutional neural network for automated liver segmentation , 2018, Physics in medicine and biology.

[27]  F. Schick,et al.  Standardized assessment of whole body adipose tissue topography by MRI , 2005, Journal of magnetic resonance imaging : JMRI.

[28]  J. Linseisen,et al.  Whole-Body MR Imaging in the German National Cohort: Rationale, Design, and Technical Background. , 2015, Radiology.

[29]  Wei Shen,et al.  Segmentation and quantification of adipose tissue by magnetic resonance imaging , 2016, Magnetic Resonance Materials in Physics, Biology and Medicine.

[30]  Magnus Borga,et al.  Automatic and quantitative assessment of regional muscle volume by multi‐atlas segmentation using whole‐body water–fat MRI , 2015, Journal of magnetic resonance imaging : JMRI.

[31]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[32]  Ran Lu,et al.  FatSegNet: A fully automated deep learning pipeline for adipose tissue segmentation on abdominal dixon MRI , 2019, Magnetic resonance in medicine.

[33]  Bostjan Likar,et al.  A Review of Methods for Correction of Intensity Inhomogeneity in MRI , 2007, IEEE Transactions on Medical Imaging.

[34]  Ben Glocker,et al.  Automated cardiovascular magnetic resonance image analysis with fully convolutional networks , 2017, Journal of Cardiovascular Magnetic Resonance.

[35]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Horst Bischof,et al.  Regressing Heatmaps for Multiple Landmark Localization Using CNNs , 2016, MICCAI.

[37]  P. Björntorp,et al.  The Influence of Body Fat Distribution on the Incidence of Diabetes Mellitus: 13.5 Years of Follow-up of the Participants in the Study of Men Born in 1913 , 1985, Diabetes.

[38]  Magnus Borga,et al.  Advanced body composition assessment: from body mass index to body composition profiling , 2018, Journal of Investigative Medicine.

[39]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[40]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  L. Sjöström,et al.  Impact of obesity on metabolism in men and women. Importance of regional adipose tissue distribution. , 1983, The Journal of clinical investigation.

[42]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[43]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[44]  M. Borga MRI adipose tissue and muscle composition analysis-a review of automation techniques. , 2018, The British journal of radiology.

[45]  Mohammad Sohel Rahman,et al.  MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentation , 2019, Neural Networks.

[46]  J. Reynolds,et al.  Visceral obesity, metabolic syndrome, insulin resistance and cancer , 2011, Proceedings of the Nutrition Society.

[47]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[49]  M. Borga,et al.  Sub‐phenotyping Metabolic Disorders Using Body Composition: An Individualized, Nonparametric Approach Utilizing Large Data Sets , 2019, Obesity.