ABCNet: A New Efficient 3D Dense-Structure Network for Segmentation and Analysis of Body Tissue Composition on Body-Torso-Wide CT Images.

PURPOSE Quantification of body tissue composition is important for research and clinical purposes, given the association between presence and severity of several disease conditions, such as the incidence of cardiovascular and metabolic disorders, survival after chemotherapy, etc., with the quantity and quality of body tissue composition. In this work, we aim to automatically segment four key body tissues of interest, namely subcutaneous adipose tissue, visceral adipose tissue, skeletal muscle, and skeletal structures from body-torso-wide low-dose computed tomography (CT) images. METHOD Based on the idea of residual Encoder-Decoder architecture, a novel neural network design named ABCNet is proposed. The proposed system makes full use of multi-scale features from four resolution levels to improve the segmentation accuracy. This network is built on a uniform convolutional unit and its derived units, which makes the ABCNet easy to implement. Several parameter compression methods, including Bottleneck, linear increasing feature maps in Dense Blocks, and efficient memory techniques are employed to lighten the network while making it deeper. The strategy of dynamic soft Dice loss is introduced to optimize the network in two steps from coarse tuning to fine tuning. The proposed segmentation algorithm is accurate, robust, and very efficient in terms of both time and memory. RESULTS A data set composed of 38 low-dose unenhanced CT images, with 25 male and 13 female subjects in the age range 31-83 years and ranging from normal to overweight to obese, is utilized to evaluate ABCNet. We compare four state-of-the-art methods including DeepMedic, 3D U-Net, V-Net, Dense V-Net, against ABCNet on this data set. We employ a shuffle-split 5-fold cross-validation strategy: In each experimental group, 18, 5, and 15 CT images are randomly selected out of 38 CT image sets for training, validation, and testing, respectively. The commonly-used evaluation metrics - precision, recall, and F1-score (or Dice) - are employed to measure the segmentation quality. The results show that ABCNet achieves superior performance in accuracy of segmenting body tissues from body-torso-wide low-dose CT images compared to other state-of-the-art methods, reaching 92-98% in common accuracy metrics such as F1-score. ABCNet is also time-efficient and memory-efficient. It costs about 18 hours to train and an average of 12 seconds to segment four tissue components from a body-torso-wide CT image, on an ordinary desktop with a single ordinary GPU. CONCLUSIONS Motivated by applications in body tissue composition quantification on large population groups, our goal in this paper was to create an efficient and accurate body tissue segmentation method for use on body-torso-wide CT images. The proposed ABCNet achieves peak performance in both accuracy and efficiency that seems hard to improve any more. The experiments performed demonstrate that ABCNet can be run on an ordinary desktop with a single ordinary GPU, with practical times for both training and testing, and achieves superior accuracy compared to other state-of-the-art segmentation methods for the task of body tissue composition analysis from low-dose CT images.

[1]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[2]  Parashkev Nachev,et al.  Computer Methods and Programs in Biomedicine NiftyNet: a deep-learning platform for medical imaging , 2022 .

[3]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[4]  G. Steinberg,et al.  Adipose tissue as an endocrine organ , 2010, Molecular and Cellular Endocrinology.

[5]  Ulas Bagci,et al.  A Novel Extension to Fuzzy Connectivity for Body Composition Analysis: Applications in Thigh, Brain, and Whole Body Tissue Segmentation , 2018, IEEE Transactions on Biomedical Engineering.

[6]  Yubing Tong,et al.  Quantification of body‐torso‐wide tissue composition on low‐dose CT images via automatic anatomy recognition , 2019, Medical physics.

[7]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Ján Dupej,et al.  Body composition estimation from selected slices: equations computed from a new semi-automatic thresholding method developed on whole-body CT scans , 2017, PeerJ.

[9]  Li Xu,et al.  The optimal anatomic site for a single slice to estimate the total volume of visceral adipose tissue by using the quantitative computed tomography (QCT) in Chinese population , 2018, European Journal of Clinical Nutrition.

[10]  Gianluigi Mazzoccoli,et al.  Body composition: Where and when. , 2016, European Journal of Radiology.

[11]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[12]  Udo Hoffmann,et al.  Abdominal Visceral and Subcutaneous Adipose Tissue Compartments: Association With Metabolic Risk Factors in the Framingham Heart Study , 2007, Circulation.

[13]  Katherine P. Andriole,et al.  Fully-Automated Analysis of Body Composition from CT in Cancer Patients Using Convolutional Neural Networks , 2018, OR 2.0/CARE/CLIP/ISIC@MICCAI.

[14]  Zenon Nieckarz,et al.  Human Body Composition and Muscle Mass , 2019, Muscle and Exercise Physiology.

[15]  Dean C. Barratt,et al.  Automatic Multi-Organ Segmentation on Abdominal CT With Dense V-Networks , 2018, IEEE Transactions on Medical Imaging.

[16]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[17]  M. Mourtzakis,et al.  A critical evaluation of body composition modalities used to assess adipose and skeletal muscle tissue in cancer. , 2012, Applied physiology, nutrition, and metabolism = Physiologie appliquee, nutrition et metabolisme.

[18]  Young Jae Kim,et al.  Computerized Automated Quantification of Subcutaneous and Visceral Adipose Tissue From Computed Tomography Scans: Development and Validation Study , 2016, JMIR medical informatics.

[19]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Jayaram K. Udupa,et al.  MR Image Analytics to Characterize the Upper Airway Structure in Obese Children with Obstructive Sleep Apnea Syndrome , 2016, PloS one.

[21]  Najate Achamrah,et al.  Validity of Predictive Equations for Resting Energy Expenditure Developed for Obese Patients: Impact of Body Composition Method , 2018, Nutrients.

[22]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[23]  Robin Strand,et al.  Automated analysis of liver fat, muscle and adipose tissue distribution from CT suitable for large-scale studies , 2017, Scientific Reports.

[24]  Dewey Odhner,et al.  CAVASS: A Computer-Assisted Visualization and Analysis Software System , 2007, SPIE Medical Imaging.

[25]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[26]  Eddy S Yang,et al.  CT Measures of Bone Mineral Density and Muscle Mass Can Be Used to Predict Noncancer Death in Men with Prostate Cancer. , 2017, Radiology.

[27]  Synho Do,et al.  Quantifying the effect of slice thickness, intravenous contrast and tube current on muscle segmentation: Implications for body composition analysis , 2018, European Radiology.

[28]  D. Gallagher,et al.  Current body composition measurement techniques , 2017, Current opinion in endocrinology, diabetes, and obesity.

[29]  Yubing Tong,et al.  Optimization of abdominal fat quantification on CT imaging through use of standardized anatomic space: a novel approach. , 2014, Medical physics.

[30]  Vivienne Sze,et al.  Efficient Processing of Deep Neural Networks: A Tutorial and Survey , 2017, Proceedings of the IEEE.

[31]  Sébastien Ourselin,et al.  Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations , 2017, DLMIA/ML-CDS@MICCAI.

[32]  Kilian Q. Weinberger,et al.  Memory-Efficient Implementation of DenseNets , 2017, ArXiv.

[33]  R. Siervogel,et al.  Body Composition Methods: Comparisons and Interpretation , 2008, Journal of diabetes science and technology.

[34]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Jayaram K. Udupa,et al.  User-Steered Image Segmentation Paradigms: Live Wire and Live Lane , 1998, Graph. Model. Image Process..

[36]  Petro M. Kostandy,et al.  Automated Abdominal Segmentation of CT Scans for Body Composition Analysis Using Deep Learning. , 2019, Radiology.

[37]  Xinjian Chen,et al.  Automatic Segmentation and Quantification of White and Brown Adipose Tissues from PET/CT Scans , 2017, IEEE Transactions on Medical Imaging.

[38]  Georg Fuchs,et al.  Pixel-Level Deep Segmentation: Artificial Intelligence Quantifies Muscle on Computed Tomography for Body Morphometric Analysis , 2017, Journal of Digital Imaging.

[39]  Jayaram K. Udupa,et al.  A critical analysis of the methods of evaluating MRI brain segmentation algorithms , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[40]  Jason D. Christie,et al.  A nonlinear relationship between visceral adipose tissue and frailty in adult lung transplant candidates , 2019, American journal of transplantation : official journal of the American Society of Transplantation and the American Society of Transplant Surgeons.

[41]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[42]  Jan Kybic,et al.  Fully automated classification of bone marrow infiltration in low-dose CT of patients with multiple myeloma based on probabilistic density model and supervised learning , 2016, Comput. Biol. Medicine.

[43]  Harold I Feldman,et al.  Computed Tomography–Defined Abdominal Adiposity Is Associated With Acute Kidney Injury in Critically Ill Trauma Patients* , 2014, Critical care medicine.

[44]  Nadeem Sheikh,et al.  Role of immune cells in obesity induced low grade inflammation and insulin resistance. , 2017, Cellular immunology.

[45]  G. Ailhaud,et al.  Adipose tissue as an endocrine organ , 2000, International Journal of Obesity.

[46]  Yuhua Gu,et al.  Semiautomated Measure of Abdominal Adiposity Using Computed Tomography Scan Analysis. , 2019, The Journal of surgical research.

[47]  Shuang Zheng,et al.  Automated and accurate quantification of subcutaneous and visceral adipose tissue from magnetic resonance imaging based on machine learning. , 2019, Magnetic resonance imaging.

[48]  Tony Reiman,et al.  A practical and precise approach to quantification of body composition in cancer patients using computed tomography images acquired during routine care. , 2008, Applied physiology, nutrition, and metabolism = Physiologie appliquee, nutrition et metabolisme.

[49]  Frank Hutter,et al.  SGDR: Stochastic Gradient Descent with Warm Restarts , 2016, ICLR.

[50]  Martin Jägersand,et al.  Body Composition Assessment in Axial CT Images Using FEM-Based Automatic Segmentation of Skeletal Muscle , 2016, IEEE Transactions on Medical Imaging.

[51]  D. Lobo,et al.  A comparison of three methods to assess body composition. , 2018, Nutrition.

[52]  Yubing Tong,et al.  Adipose tissue quantification and primary graft dysfunction after lung transplantation: The Lung Transplant Body Composition study. , 2019, The Journal of heart and lung transplantation : the official publication of the International Society for Heart Transplantation.