CT Male Pelvic Organ Segmentation via Hybrid Loss Network With Incomplete Annotation

Sufficient data with complete annotation is essential for training deep models to perform automatic and accurate segmentation of CT male pelvic organs, especially when such data is with great challenges such as low contrast and large shape variation. However, manual annotation is expensive in terms of both finance and human effort, which usually results in insufficient completely annotated data in real applications. To this end, we propose a novel deep framework to segment male pelvic organs in CT images with incomplete annotation delineated in a very user-friendly manner. Specifically, we design a hybrid loss network derived from both voxel classification and boundary regression, to jointly improve the organ segmentation performance in an iterative way. Moreover, we introduce a label completion strategy to complete the labels of the rich unannotated voxels and then embed them into the training data to enhance the model capability. To reduce the computation complexity and improve segmentation performance, we locate the pelvic region based on salient bone structures to focus on the candidate segmentation organs. Experimental results on a large planning CT pelvic organ dataset show that our proposed method with incomplete annotation achieves comparable segmentation performance to the state-of-the-art methods with complete annotation. Moreover, our proposed method requires much less effort of manual contouring from medical professionals such that an institutional specific model can be more easily established.

[1]  Yaozong Gao,et al.  CT male pelvic organ segmentation using fully convolutional networks with boundary sensitive representation , 2019, Medical Image Anal..

[2]  Rongrong Guo,et al.  A combined learning algorithm for prostate segmentation on 3D CT images , 2017, Medical physics.

[3]  Huaici Zhao,et al.  Computer aided endoscope diagnosis via weakly labeled data mining , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[4]  Siqi Chen,et al.  Segmenting the prostate and rectum in CT imagery using anatomical constraints , 2011, Medical Image Anal..

[5]  Dinggang Shen,et al.  Automated Segmentation of 3D US Prostate Images Using Statistical Texture-Based Matching Method , 2003, MICCAI.

[6]  Raphael Sznitman,et al.  Iterative multi‐path tracking for video and volume segmentation with sparse point supervision , 2018, Medical Image Anal..

[7]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[8]  Yinghuan Shi,et al.  Pelvic Organ Segmentation Using Distinctive Curve Guided Fully Convolutional Networks , 2019, IEEE Transactions on Medical Imaging.

[9]  Klaus H. Maier-Hein,et al.  DALSA: Domain Adaptation for Supervised Learning From Sparsely Annotated MR Images , 2024, IEEE Transactions on Medical Imaging.

[10]  Xinjian Chen,et al.  Random Walk and Graph Cut for Co-Segmentation of Lung Tumor on PET-CT Images , 2015, IEEE Transactions on Image Processing.

[11]  Nathan Lay,et al.  Rapid Multi-organ Segmentation Using Context Integration and Discriminative Models , 2013, IPMI.

[12]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Daniel Rueckert,et al.  Recurrent neural networks for aortic image sequence segmentation with sparse annotations , 2018, MICCAI.

[15]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[16]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[17]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  S. Joshi,et al.  Automatic Segmentation of Intra-treatment CT Images for Adaptive Radiation Therapy of the Prostate , 2005, MICCAI.

[19]  Pascal Haigron,et al.  Segmentation of pelvic structures for planning CT using a geometrical shape model tuned by a multi-scale edge detector , 2014, Physics in medicine and biology.

[20]  A. Jemal,et al.  Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries , 2018, CA: a cancer journal for clinicians.

[21]  Kuo Men,et al.  Automatic segmentation of the clinical target volume and organs at risk in the planning CT for rectal cancer using deep dilated convolutional neural networks , 2017, Medical physics.

[22]  Yaozong Gao,et al.  Multiatlas-Based Segmentation Editing With Interaction-Guided Patch Selection and Label Fusion , 2016, IEEE Transactions on Biomedical Engineering.

[23]  Yaozong Gao,et al.  Locally-constrained boundary regression for segmentation of prostate and rectum in the planning CT images , 2015, Medical Image Anal..

[24]  Lubomir M. Hadjiiski,et al.  Urinary bladder segmentation in CT urography using deep-learning convolutional neural network and level sets. , 2016, Medical physics.

[25]  Yinghuan Shi,et al.  A learning-based CT prostate segmentation method via joint transductive feature selection and regression , 2016, Neurocomputing.

[26]  Yaozong Gao,et al.  Accurate Segmentation of CT Male Pelvic Organs via Regression-Based Deformable Models and Multi-Task Random Forests , 2016, IEEE Transactions on Medical Imaging.

[27]  Desire Sidibé,et al.  A survey of prostate segmentation methodologies in ultrasound, magnetic resonance and computed tomography images , 2012, Comput. Methods Programs Biomed..

[28]  Hervé Delingette,et al.  Automatic Segmentation of Bladder and Prostate Using Coupled 3D Deformable Models , 2007, MICCAI.

[29]  Yaozong Gao,et al.  Joint Learning of Image Regressor and Classifier for Deformable Segmentation of CT Pelvic Organs , 2015, MICCAI.

[30]  Yinghuan Shi,et al.  Prostate Segmentation in CT Images via Spatial-Constrained Transductive Lasso , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Steve B. Jiang,et al.  Fully automated organ segmentation in male pelvic CT images , 2018, Physics in medicine and biology.

[32]  Nassir Navab,et al.  Fully Automatic Segmentation of 3D Brain Ultrasound: Learning from Coarse Annotations , 2018, ArXiv.

[33]  Tao Zhao,et al.  Kid-Net: Convolution Networks for Kidney Vessels Segmentation from CT-Volumes , 2018, MICCAI.

[34]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[35]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[36]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[37]  Pascal Haigron,et al.  Multi-Atlas-Based Segmentation of Pelvic Structures from CT Scans for Planning in Prostate Cancer Radiotherapy , 2014 .

[38]  Chao Lu,et al.  Precise Segmentation of Multiple Organs in CT Volumes Using Learning-Based Approach and Information Theory , 2012, MICCAI.

[39]  Adam P. Harrison,et al.  3D Convolutional Neural Networks with Graph Refinement for Airway Segmentation Using Incomplete Data Labels , 2017, MLMI@MICCAI.

[40]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[41]  Yinghuan Shi,et al.  Does Manual Delineation only Provide the Side Information in CT Prostate Segmentation? , 2017, MICCAI.

[42]  Shu Liao,et al.  Sparse Patch-Based Label Propagation for Accurate Prostate Localization in CT Images , 2013, IEEE Transactions on Medical Imaging.

[43]  Dinggang Shen,et al.  Segmenting CT prostate images using population and patient-specific statistics for radiotherapy , 2010, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[44]  Andrew Zisserman,et al.  Flowing ConvNets for Human Pose Estimation in Videos , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).