Dual Shape Guided Segmentation Network for Organs-at-Risk in Head and Neck CT Images

The accurate segmentation of organs-at-risk (OARs) in head and neck CT images is a critical step for radiation therapy of head and neck cancer patients. However, manual delineation for numerous OARs is time-consuming and laborious, even for expert oncologists. Moreover, manual delineation results are susceptible to high intraand inter-variability. To this end, we propose a novel dual shape guided network (DSGnet) to automatically delineate nine important OARs in head and neck CT images. To deal with the large shape variation and unclear boundary of OARs in CT images, we represent the organ shape using an organ-specific unilateral inverse-distance map (UIDM) and guide the segmentation task from two different perspectives: direct shape guidance by following the segmentation prediction and across shape guidance by sharing the segmentation feature. In the direct shape guidance, the segmentation prediction is not only supervised by the true label mask, but also by the true UIDM, which is implemented through a simple yet effective encoder-decoder mapping from the label space to the distance space. In the across shape guidance, UIDM is used to facilitate the segmentation by optimizing the shared feature maps. For the experiments, we build a large head and neck CT dataset with a total of 699 images from different volunteers, and conduct comprehensive experiments and comparisons with other state-of-theart methods to justify the effectiveness and efficiency of our proposed method. The overall Dice Similarity Coefficient (DSC) value of 0.842 across the nine important OARs demonstrates great potential applications in improving the delineation quality and reducing the

[1]  Ronen Basri,et al.  Atlas Guided Identification of Brain Structures by Combining 3D Segmentation and SVM Classification , 2006, MICCAI.

[2]  Daoqiang Zhang,et al.  High-Order Feature Learning for Multi-Atlas Based Label Fusion: Application to Brain Segmentation With MRI , 2019, IEEE Transactions on Image Processing.

[3]  Yaozong Gao,et al.  CT male pelvic organ segmentation using fully convolutional networks with boundary sensitive representation , 2019, Medical Image Anal..

[4]  Yaozong Gao,et al.  Hierarchical Vertex Regression-Based Segmentation of Head and Neck CT Images for Radiotherapy Planning , 2018, IEEE Transactions on Image Processing.

[5]  Timo Kohlberger,et al.  Automatic Multi-organ Segmentation Using Learning-Based Segmentation and Level Set Optimization , 2011, MICCAI.

[6]  Mattias P. Heinrich,et al.  Multi-Atlas Based Pseudo-CT Synthesis Using Multimodal Image Registration and Local Atlas Fusion Strategies , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[7]  Hao Chen,et al.  DCAN: Deep Contour-Aware Networks for Accurate Gland Segmentation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Lequan Yu,et al.  MS-Net: Multi-Site Network for Improving Prostate Segmentation With Heterogeneous MRI Data , 2020, IEEE Transactions on Medical Imaging.

[9]  Mita Nasipuri,et al.  Segmentation of Breast-Region in Breast Thermogram Using Arc-Approximation and Triangular-Space Search , 2020, IEEE Transactions on Instrumentation and Measurement.

[10]  Frederic Cervenansky,et al.  Deep Learning for Segmentation Using an Open Large-Scale Dataset in 2D Echocardiography , 2019, IEEE Transactions on Medical Imaging.

[11]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[12]  Cancer Facts & Figures 2021 , 2010 .

[13]  Xiao Han,et al.  Atlas-Based Auto-segmentation of Head and Neck CT Images , 2008, MICCAI.

[14]  Mert R. Sabuncu,et al.  Multi-atlas segmentation of biomedical images: A survey , 2014, Medical Image Anal..

[15]  Mahmoud Neji,et al.  Feature selection based on hybrid optimization for magnetic resonance imaging brain tumor classification and segmentation , 2019 .

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  Qi Yang,et al.  Intracranial Vessel Wall Segmentation Using Convolutional Neural Networks , 2019, IEEE Transactions on Biomedical Engineering.

[18]  Levente Kovács,et al.  A Feature Ranking and Selection Algorithm for Brain Tumor Segmentation in Multi-Spectral Magnetic Resonance Image Data * , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[19]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[20]  Nuo Tong,et al.  Fully automatic multi‐organ segmentation for head and neck cancer radiotherapy using shape representation model constrained fully convolutional neural networks , 2018, Medical physics.

[21]  Daniel Rueckert,et al.  A Probabilistic Patch-Based Label Fusion Model for Multi-Atlas Segmentation With Registration Refinement: Application to Cardiac MR Images , 2013, IEEE Transactions on Medical Imaging.

[22]  Chunfeng Lian,et al.  Iterative Label Denoising Network: Segmenting Male Pelvic Organs in CT From 3D Bounding Box Annotations , 2020, IEEE Transactions on Biomedical Engineering.

[23]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[24]  Sébastien Ourselin,et al.  Interactive Medical Image Segmentation Using Deep Learning With Image-Specific Fine Tuning , 2017, IEEE Transactions on Medical Imaging.

[25]  Yuanyuan Chen,et al.  FocusNet: Imbalanced Large and Small Organ Segmentation with an End-to-End Deep Neural Network for Head and Neck CT Images , 2019, MICCAI.

[26]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Xiangjian He,et al.  Deep Learning Techniques for Medical Image Segmentation: Achievements and Challenges , 2019, Journal of Digital Imaging.

[28]  Tianwei Ni,et al.  Elastic Boundary Projection for 3D Medical Image Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[30]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[31]  Jiebo Luo,et al.  Deep sparse feature selection for computer aided endoscopy diagnosis , 2015, Pattern Recognit..

[32]  Sébastien Ourselin,et al.  DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Dinggang Shen,et al.  Automatic brain labeling via multi‐atlas guided fully convolutional networks☆ , 2019, Medical Image Anal..

[34]  Yinghuan Shi,et al.  A learning-based CT prostate segmentation method via joint transductive feature selection and regression , 2016, Neurocomputing.

[35]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  C. Davatzikos,et al.  Multi-Atlas Segmentation of the Prostate: A Zooming Process with Robust Registration and Atlas Selection , 2012 .

[38]  Paul A. Yushkevich,et al.  Multi-Atlas Segmentation with Joint Label Fusion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[40]  Christos Davatzikos,et al.  MUSE: MUlti-atlas region Segmentation utilizing Ensembles of registration algorithms and parameters, and locally optimal atlas selection , 2016, NeuroImage.

[41]  Daguang Xu,et al.  Generalizing Deep Learning for Medical Image Segmentation to Unseen Domains via Deep Stacked Transformation , 2020, IEEE Transactions on Medical Imaging.

[42]  Nima Tajbakhsh,et al.  Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentation , 2019, Medical Image Anal..

[43]  Bennett A Landman,et al.  Non-local statistical label fusion for multi-atlas segmentation , 2013, Medical Image Anal..

[44]  J. Deasy,et al.  Dynamic Multi-Atlas Selection Based Consensus Segmentation of Head and Neck Structures from CT Images. , 2019, Medical physics.

[45]  Loïc Le Folgoc,et al.  Attention U-Net: Learning Where to Look for the Pancreas , 2018, ArXiv.

[46]  Yong Yin,et al.  Shape-Aware Organ Segmentation by Predicting Signed Distance Maps , 2019, AAAI.

[47]  Shuai Wang,et al.  CT Male Pelvic Organ Segmentation via Hybrid Loss Network With Incomplete Annotation , 2020, IEEE Transactions on Medical Imaging.

[48]  Dwarikanath Mahapatra,et al.  Semi-supervised learning and graph cuts for consensus based medical image segmentation , 2016, Pattern Recognit..

[49]  A. Paccagnella,et al.  Randomized phase III trial of neoadjuvant chemotherapy in head and neck cancer: 10-year follow-up. , 2004, Journal of the National Cancer Institute.

[50]  Peng Yuan,et al.  Context-guided fully convolutional networks for joint craniomaxillofacial bone segmentation and landmark digitization , 2019, Medical Image Anal..

[51]  Vasant Kearney,et al.  A convolutional neural network algorithm for automatic segmentation of head and neck organs at risk using deep lifelong learning. , 2019, Medical physics.

[52]  Bulat Ibragimov,et al.  Segmentation of organs‐at‐risks in head and neck CT images using convolutional neural networks , 2017, Medical physics.

[53]  Dinggang Shen,et al.  Iterative multi-atlas-based multi-image segmentation with tree-based registration , 2012, NeuroImage.

[54]  Viktor Larsson,et al.  Shape-aware label fusion for multi-atlas frameworks , 2019, Pattern Recognit. Lett..

[55]  Stephen J. McKenna,et al.  Boundary-Aware Fully Convolutional Network for Brain Tumor Segmentation , 2017, MICCAI.