Single slice thigh CT muscle group segmentation with domain adaptation and self-training

Objective: Thigh muscle group segmentation is important for assessment of muscle anatomy, metabolic disease and aging. Many efforts have been put into quantifying muscle tissues with magnetic resonance (MR) imaging including manual annotation of individual muscles. However, leveraging publicly available annotations in MR images to achieve muscle group segmentation on single slice computed tomography (CT) thigh images is challenging. Method: We propose an unsupervised domain adaptation pipeline with self-training to transfer labels from 3D MR to single CT slice. First, we transform the image appearance from MR to CT with CycleGAN and feed the synthesized CT images to a segmenter simultaneously. Single CT slices are divided into hard and easy cohorts based on the entropy of pseudo labels inferenced by the segmenter. After refining easy cohort pseudo labels based on anatomical assumption, self-training with easy and hard splits is applied to fine tune the segmenter. Results: On 152 withheld single CT thigh images, the proposed pipeline achieved a mean Dice of 0.888(0.041) across all muscle groups including sartorius, hamstrings, quadriceps femoris and gracilis. muscles Conclusion: To our best knowledge, this is the first pipeline to achieve thigh imaging domain adaptation from MR to CT. The proposed pipeline is effective and robust in extracting muscle groups on 2D single slice CT thigh images.The container is available for public use at https://github.com/MASILab/DA_CT_muscle_seg

[1]  Ho Hin Lee,et al.  Longitudinal variability analysis on low-dose abdominal CT with deep learning-based segmentation , 2022, Medical Imaging.

[2]  Leon Y. Cai,et al.  Reducing Positional Variance in Cross-sectional Abdominal CT Slices with Deep Conditional Generative Models , 2022, MICCAI.

[3]  Ho Hin Lee,et al.  Label efficient segmentation of single slice thigh CT with two-stage pseudo labels , 2022, Journal of medical imaging.

[4]  Ho Hin Lee,et al.  Quantification of muscle, bones, and fat on single slice thigh CT , 2022, Medical Imaging.

[5]  James S. Duncan,et al.  Anatomy-Constrained Contrastive Learning for Synthetic Segmentation without Ground-truth , 2021, MICCAI.

[6]  Hao Guan,et al.  Domain Adaptation for Medical Image Analysis: A Survey , 2021, IEEE Transactions on Biomedical Engineering.

[7]  In So Kweon,et al.  Unsupervised Intra-Domain Adaptation for Semantic Segmentation Through Self-Supervision , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Hao Chen,et al.  Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentation , 2020, IEEE Transactions on Medical Imaging.

[9]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[10]  Xiaofeng Liu,et al.  Confidence Regularized Self-Training , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[11]  Fan Zhang,et al.  Unsupervised Domain Adaptation via Disentangled Representations: Application to Cross-Modality Liver Segmentation , 2019, MICCAI.

[12]  Cheng Chen,et al.  PnP-AdaNet: Plug-and-Play Adversarial Domain Adaptation Network at Unpaired Cross-Modality Cardiac Segmentation , 2019, IEEE Access.

[13]  Wei-Lun Chang,et al.  All About Structure: Adapting Structural Information Across Domains for Boosting Semantic Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Diane J. Cook,et al.  A Survey of Unsupervised Deep Domain Adaptation , 2018, ACM Trans. Intell. Syst. Technol..

[15]  Patrick Pérez,et al.  ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Shunxing Bao,et al.  SynSeg-Net: Synthetic Segmentation Without Target Modality Ground Truth , 2018, IEEE Transactions on Medical Imaging.

[17]  Yang Zou,et al.  Domain Adaptation for Semantic Segmentation via Class-Balanced Self-Training , 2018, ArXiv.

[18]  R. Sarpong,et al.  Bio-inspired synthesis of xishacorenes A, B, and C, and a new congener from fuscol† †Electronic supplementary information (ESI) available. See DOI: 10.1039/c9sc02572c , 2019, Chemical science.

[19]  Thomas Baum,et al.  Thigh muscle segmentation of chemical shift encoding-based water-fat magnetic resonance images: The reference database MyoSegmenTUM , 2018, PloS one.

[20]  Takeshi Ogawa,et al.  Automated muscle segmentation from CT images of the hip and thigh using a hierarchical multi-atlas method , 2018, International Journal of Computer Assisted Radiology and Surgery.

[21]  Vanessa Sochat,et al.  Singularity: Scientific containers for mobility of compute , 2017, PloS one.

[22]  P. Jakeman,et al.  Measurement of muscle health in aging , 2017, Biogerontology.

[23]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[24]  David Reversat,et al.  Manual segmentation of individual muscles of the quadriceps femoris using MRI: A reappraisal , 2014, Journal of magnetic resonance imaging : JMRI.

[25]  Felix Eckstein,et al.  Effect of exercise intervention on thigh muscle volume and anatomical cross‐sectional areas—Quantitative assessment using MRI , 2010, Magnetic resonance in medicine.

[26]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[27]  D. Choi,et al.  The association between the ratio of visceral fat to thigh muscle area and metabolic syndrome: the Korean Sarcopenic Obesity Study (KSOS) , 2010, Clinical endocrinology.

[28]  L. Ferrucci The Baltimore Longitudinal Study of Aging (BLSA): a 50-year-long journey and plans for the future. , 2008, The journals of gerontology. Series A, Biological sciences and medical sciences.

[29]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[30]  D. Cunningham,et al.  Thigh composition in young and elderly men determined by computed tomography. , 1992, Clinical physiology.

[31]  N. Kanopoulos,et al.  Design of an image edge detection filter using the Sobel operator , 1988 .

[32]  Philip H. Ramsey Nonparametric Statistical Methods , 1974, Technometrics.

[33]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[34]  Nadia Hashem,et al.  "I" and "others" , 2013 .

[35]  W. Marsden I and J , 2012 .