Abdominal adipose tissues extraction using multi-scale deep neural network

Segmentation of abdominal adipose tissues (AAT) into subcutaneous adipose tissues (SAT) and visceral adipose tissues (VAT) is of crucial interest for managing the obesity. Previous methods with raw or hand-crafted features rarely work well on large-scale subject cohorts, because of the inhomogeneous image intensities, artifacts and the diverse distributions of VAT. In this paper, we propose a novel two-stage coarse-to-fine algorithm for AAT segmentation. In the first stage, we formulate the AAT segmentation task as a pixel-wise classification problem. First, three types of features, intensity, spatial and contextual features, are extracted. Second, a new type of deep neural network, named multi-scale deep neural network (MSDNN), is provided to extract high-level features. In the second stage, to improve the segmentation accuracy, we refine coarse segmentation results by determining the internal boundaries of SAT based on coarse segmentation results and the continuous of SAT internal boundaries. Finally, we demonstrate the efficacy of our algorithm for both 2D and 3D cases on a wide population range. Compared with other algorithms, our method is not only more suitable for large-scale dataset, but also achieves better segmentation results. Furthermore, our system takes about 2s to segment an abdominal image, which implies potential clinical applications.

[1]  Qi Peng,et al.  Novel segmentation method for abdominal fat quantification by MRI , 2011, Journal of magnetic resonance imaging : JMRI.

[2]  Dimitris N. Metaxas,et al.  Accurate thigh inter-muscular adipose quantification using a data-driven and sparsity-constrained deformable model , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[3]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[4]  Matti Pietikäinen,et al.  Dynamic texture and scene classification by transferring deep image features , 2015, Neurocomputing.

[5]  Y. Miyazaki,et al.  Visceral fat dominant distribution in male type 2 diabetic patients is closely related to hepatic insulin resistance, irrespective of body type , 2009, Cardiovascular diabetology.

[6]  Junzhou Huang,et al.  Towards robust and effective shape modeling: Sparse shape composition , 2012, Medical Image Anal..

[7]  Dimitris N. Metaxas,et al.  Deformable segmentation via sparse representation and dictionary learning , 2012, Medical Image Anal..

[8]  Suresh Anand Sadananthan,et al.  Automated segmentation of visceral and subcutaneous (deep and superficial) adipose tissues in normal and overweight men , 2015, Journal of magnetic resonance imaging : JMRI.

[9]  Xinbo Gao,et al.  A deep feature based framework for breast masses classification , 2016, Neurocomputing.

[10]  Mandy Eberhart,et al.  Decision Forests For Computer Vision And Medical Image Analysis , 2016 .

[11]  Cheng-Hao Tsai,et al.  Incremental and decremental training for linear classification , 2014, KDD.

[12]  Rasmus Larsen,et al.  Automatic Segmentation of Abdominal Adipose Tissue in MRI , 2011, SCIA.

[13]  Anant Madabhushi,et al.  A Deep Convolutional Neural Network for segmenting and classifying epithelial and stromal regions in histopathological images , 2016, Neurocomputing.

[14]  Thomas Kahn,et al.  Software for automated MRI‐based quantification of abdominal fat and preliminary evaluation in morbidly obese patients , 2013, Journal of magnetic resonance imaging : JMRI.

[15]  Antonio Criminisi,et al.  Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning , 2012, Found. Trends Comput. Graph. Vis..

[16]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[17]  Masahira Hattori,et al.  Obesity-induced gut microbial metabolite promotes liver cancer through senescence secretome , 2013, Nature.

[18]  Gustavo Carneiro,et al.  Deep Learning and Structured Prediction for the Segmentation of Mass in Mammograms , 2015, MICCAI.

[19]  J. Després,et al.  Abdominal obesity and metabolic syndrome , 2006, Nature.

[20]  Junzhou Huang,et al.  Deformable Segmentation via Sparse Shape Representation , 2011, MICCAI.

[21]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[22]  J. Kullberg,et al.  Automated and reproducible segmentation of visceral and subcutaneous adipose tissue from abdominal MRI , 2007, International Journal of Obesity.

[23]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[24]  Chao Chen,et al.  An efficient conditional random field approach for automatic and interactive neuron segmentation , 2016, Medical Image Anal..

[25]  Yoshihiko Takahashi,et al.  Associations of Visceral and Subcutaneous Fat Areas With the Prevalence of Metabolic Risk Factor Clustering in 6,292 Japanese Individuals , 2010, Diabetes Care.

[26]  Steve Horvath,et al.  Obesity accelerates epigenetic aging of human liver , 2014, Proceedings of the National Academy of Sciences.