CT male pelvic organ segmentation using fully convolutional networks with boundary sensitive representation

&NA; Accurate segmentation of the prostate and organs at risk (e.g., bladder and rectum) in CT images is a crucial step for radiation therapy in the treatment of prostate cancer. However, it is a very challenging task due to unclear boundaries, large intra‐ and inter‐patient shape variability, and uncertain existence of bowel gases and fiducial markers. In this paper, we propose a novel automatic segmentation framework using fully convolutional networks with boundary sensitive representation to address this challenging problem. Our novel segmentation framework contains three modules. First, an organ localization model is designed to focus on the candidate segmentation region of each organ for better performance. Then, a boundary sensitive representation model based on multi‐task learning is proposed to represent the semantic boundary information in a more robust and accurate manner. Finally, a multi‐label cross‐entropy loss function combining boundary sensitive representation is introduced to train a fully convolutional network for the organ segmentation. The proposed method is evaluated on a large and diverse planning CT dataset with 313 images from 313 prostate cancer patients. Experimental results show that the performance of our proposed method outperforms the baseline fully convolutional networks, as well as other state‐of‐the‐art methods in CT male pelvic organ segmentation.

[1]  Lubomir M. Hadjiiski,et al.  Segmentation of inner and outer bladder wall using deep-learning convolutional neural network in CT urography , 2017, Medical Imaging.

[2]  Shu Liao,et al.  Sparse Patch-Based Label Propagation for Accurate Prostate Localization in CT Images , 2013, IEEE Transactions on Medical Imaging.

[3]  Yaozong Gao,et al.  Locally-constrained boundary regression for segmentation of prostate and rectum in the planning CT images , 2015, Medical Image Anal..

[4]  B Haas,et al.  Automatic segmentation of thoracic and pelvic CT images for radiotherapy planning using implicit anatomic knowledge and organ-specific segmentation strategies , 2008, Physics in medicine and biology.

[5]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[6]  Dinggang Shen,et al.  Segmenting CT prostate images using population and patient-specific statistics for radiotherapy , 2010, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[7]  Yan Xu,et al.  Deep learning of feature representation with multiple instance learning for medical image analysis , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Yilong Yin,et al.  Multi-task Shape Regression for Medical Image Segmentation , 2016, MICCAI.

[9]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[10]  Heung-Il Suk,et al.  Deep Learning in Medical Image Analysis. , 2017, Annual review of biomedical engineering.

[11]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[12]  Gustavo Carneiro,et al.  The Segmentation of the Left Ventricle of the Heart From Ultrasound Data Using Deep Learning Architectures and Derivative-Based Search Methods , 2012, IEEE Transactions on Image Processing.

[13]  Tao Zhang,et al.  Model-based segmentation of medical imagery by matching distributions , 2005, IEEE Transactions on Medical Imaging.

[14]  Timothy F. Cootes,et al.  A benchmark for comparison of dental radiography analysis algorithms , 2016, Medical Image Anal..

[15]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[16]  Chao Lu,et al.  Precise Segmentation of Multiple Organs in CT Volumes Using Learning-Based Approach and Information Theory , 2012, MICCAI.

[17]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[18]  Yoshinobu Sato,et al.  Automated Segmentation of the Femur and Pelvis from 3D CT Data of Diseased Hip Using Hierarchical Statistical Shape Model of Joint Structure , 2009, MICCAI.

[19]  Yaozong Gao,et al.  Accurate Segmentation of CT Male Pelvic Organs via Regression-Based Deformable Models and Multi-Task Random Forests , 2016, IEEE Transactions on Medical Imaging.

[20]  Nathan Lay,et al.  Rapid Multi-organ Segmentation Using Context Integration and Discriminative Models , 2013, IPMI.

[21]  Rongrong Guo,et al.  A combined learning algorithm for prostate segmentation on 3D CT images , 2017, Medical physics.

[22]  Siqi Chen,et al.  Segmenting the prostate and rectum in CT imagery using anatomical constraints , 2011, Medical Image Anal..

[23]  Kuo Men,et al.  Automatic segmentation of the clinical target volume and organs at risk in the planning CT for rectal cancer using deep dilated convolutional neural networks , 2017, Medical physics.

[24]  Pascal Haigron,et al.  Segmentation of pelvic structures for planning CT using a geometrical shape model tuned by a multi-scale edge detector , 2014, Physics in medicine and biology.

[25]  Yaozong Gao,et al.  Hierarchical Vertex Regression-Based Segmentation of Head and Neck CT Images for Radiotherapy Planning , 2018, IEEE Transactions on Image Processing.

[26]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  S. Joshi,et al.  Automatic Segmentation of Intra-treatment CT Images for Adaptive Radiation Therapy of the Prostate , 2005, MICCAI.

[28]  Yaozong Gao,et al.  Deformable MR Prostate Segmentation via Deep Feature Learning and Sparse Patch Matching , 2016, IEEE Transactions on Medical Imaging.

[29]  Dimitris N. Metaxas,et al.  3D Meshless Prostate Segmentation and Registration in Image Guided Radiotherapy , 2009, MICCAI.

[30]  Matthew Lai,et al.  Deep Learning for Medical Image Segmentation , 2015, Deep Learning Applications in Medical Imaging.

[31]  Hervé Delingette,et al.  Automatic Segmentation of Bladder and Prostate Using Coupled 3D Deformable Models , 2007, MICCAI.

[32]  Yaozong Gao,et al.  Joint Learning of Image Regressor and Classifier for Deformable Segmentation of CT Pelvic Organs , 2015, MICCAI.

[33]  Geoffrey G. Zhang,et al.  Semi-automated CT segmentation using optic flow and Fourier interpolation techniques , 2006, Comput. Methods Programs Biomed..

[34]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[35]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[36]  Luc Van Gool,et al.  The 2005 PASCAL Visual Object Classes Challenge , 2005, MLCW.

[37]  Joachim M. Buhmann,et al.  Crowdsourcing the creation of image segmentation algorithms for connectomics , 2015, Front. Neuroanat..

[38]  Yinghuan Shi,et al.  Does Manual Delineation only Provide the Side Information in CT Prostate Segmentation? , 2017, MICCAI.

[39]  Shuo Li,et al.  Automated segmentation and area estimation of neural foramina with boundary regression model , 2017, Pattern Recognit..

[40]  Chao Lu,et al.  An integrated approach to segmentation and nonrigid registration for application in image-guided pelvic radiotherapy , 2011, Medical Image Anal..

[41]  Oscar Acosta,et al.  Multi-atlas-based segmentation of prostatic urethra from planning CT imaging to quantify dose distribution in prostate cancer radiotherapy. , 2017, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[42]  Dinggang Shen,et al.  Automated Segmentation of 3D US Prostate Images Using Statistical Texture-Based Matching Method , 2003, MICCAI.

[43]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.