Cascaded SE-ResUnet for segmentation of thoracic organs at risk

Abstract Computed Tomography (CT) has been widely used in the planning of radiation therapy, which is one of the most effective clinical lung cancer treatment options. Accurate segmentation of organs at risk (OARs) in thoracic CT images is a key step for radiotherapy planning to prevent healthy organs from getting over irradiation. However, known automatic image segmentation methods can hardly yield desired OAR delineation results, while manual delineation tends to take long time and tedious effort. In this paper, we propose a novel deep learning network, called cascaded SE-ResUnet, for automatic segmentation of thoracic organs including left lung, right lung, heart, esophagus, trachea, and spinal cord. Specifically, we first use a coarse segmentation network to identify the regions of interest (ROIs), and then a fine segmentation network is applied to achieve refined segmentation results, organ by organ. Finally, different configured models are ensembled to obtain the final segmentation results. In the StructSeg 2019 Challenge, we showed the capability of our new framework and won the 1st place at the test phase. Our code is available open-source at https://github.com/zjuybh/StructSeg2019.

[1]  Jun Ma,et al.  Hierarchical segmentation and identification of thoracic vertebra using learning-based edge detection and coarse-to-fine deformable model , 2010, Comput. Vis. Image Underst..

[2]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Max A. Viergever,et al.  Deep Learning for Multi-Task Medical Image Segmentation in Multiple Modalities , 2016, MICCAI.

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Youbao Tang,et al.  CT-Realistic Lung Nodule Simulation from 3D Conditional Generative Adversarial Networks for Robust Lung Segmentation , 2018, MICCAI.

[7]  James A Purdy,et al.  DOSE TO NORMAL TISSUES OUTSIDE THE RADIATION THERAPY PATIENT’S TREATED VOLUME: A REVIEW OF DIFFERENT RADIATION THERAPY TECHNIQUES , 2008, Health physics.

[8]  Raghav Mehta,et al.  M-net: A Convolutional Neural Network for deep brain structure segmentation , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[9]  Luc Van Gool,et al.  One-Shot Video Object Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Ulas Bagci,et al.  A review on segmentation of positron emission tomography images , 2014, Comput. Biol. Medicine.

[11]  Suhuai Luo,et al.  Review on the methods of automatic liver segmentation from abdominal images , 2014 .

[12]  Brahim Ait Skourt,et al.  Lung CT Image Segmentation Using Deep Neural Networks , 2018 .

[13]  Xiaohui Xie,et al.  AnatomyNet: Deep learning for fast and fully automated whole‐volume segmentation of head and neck anatomy , 2018, Medical physics.

[14]  David Beymer,et al.  Automated volumetric lung segmentation of thoracic CT images using fully convolutional neural network , 2018, Medical Imaging.

[15]  Jamshid Dehmeshki,et al.  Segmentation of Pulmonary Nodules in Thoracic CT Scans: A Region Growing Approach , 2008, IEEE Transactions on Medical Imaging.

[16]  Sebastien Ourselin,et al.  Automatic Segmentation of Vestibular Schwannoma from T2-Weighted MRI by Deep Spatial Attention with Hardness-Weighted Loss , 2019, MICCAI.

[17]  Xiao Han,et al.  MR‐based synthetic CT generation using a deep convolutional neural network method , 2017, Medical physics.

[18]  Ling Shao,et al.  Video Salient Object Detection via Fully Convolutional Networks , 2017, IEEE Transactions on Image Processing.

[19]  B. Ginneken,et al.  Automatic segmentation of the airway tree from thoracic CT scans using a multi-threshold approach , 2009 .

[20]  A. Sevastopolsky,et al.  Optic disc and cup segmentation methods for glaucoma detection with modification of U-Net convolutional neural network , 2017, Pattern Recognition and Image Analysis.

[21]  Berkman Sahiner,et al.  3D convolutional neural network for automatic detection of lung nodules in chest CT , 2017, Medical Imaging.

[22]  C Flores-Mir,et al.  Three-dimensional segmentation of the upper airway using cone beam CT: a systematic review. , 2012, Dento maxillo facial radiology.

[23]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[24]  Dinggang Shen,et al.  Segmentation of Organs at Risk in thoracic CT images using a SharpMask architecture and Conditional Random Fields , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[25]  Thomas Brox,et al.  U-Net: deep learning for cell counting, detection, and morphometry , 2018, Nature Methods.