Esophageal Tumor Segmentation in CT Images Using a Dilated Dense Attention Unet (DDAUnet)

Manual or automatic delineation of the esophageal tumor in CT images is known to be very challenging. This is due to the low contrast between the tumor and adjacent tissues, the anatomical variation of the esophagus, as well as the occasional presence of foreign bodies (e.g. feeding tubes). Physicians therefore usually exploit additional knowledge such as endoscopic findings, clinical history, additional imaging modalities like PET scans. Achieving his additional information is time-consuming, while the results are error-prone and might lead to non-deterministic results. In this paper we aim to investigate if and to what extent a simplified clinical workflow based on CT alone, allows one to automatically segment the esophageal tumor with sufficient quality. For this purpose, we present a fully automatic end-to-end esophageal tumor segmentation method based on convolutional neural networks (CNNs). The proposed network, called Dilated Dense Attention Unet (DDAUnet), leverages spatial and channel attention gates in each dense block to selectively concentrate on determinant feature maps and regions. Dilated convolutional layers are used to manage GPU memory and increase the network receptive field. We collected a dataset of 792 scans from 288 distinct patients including varying anatomies with air pockets, feeding tubes and proximal tumors. Repeatability and reproducibility studies were conducted for three distinct splits of training and validation sets. The proposed network achieved a DSC value of 0.79 ± 0.20, a mean surface distance of 5.4 ± 20.2mm and 95% Hausdorff distance of 14.7 ± 25.0mm for 287 test scans, demonstrating promising results with a simplified clinical workflow based on CT alone. Our code is publicly available via https://github.com/yousefis/DenseUnet_Esophagus_Segmentation.

[1]  C. Mathers,et al.  Cancer incidence and mortality worldwide: Sources, methods and major patterns in GLOBOCAN 2012 , 2015, International journal of cancer.

[2]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[3]  Ying Liang,et al.  Auto-segmentation of pancreatic tumor in multi-parametric MRI using deep convolutional neural networks. , 2020, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[4]  Dorin Comaniciu,et al.  A Probabilistic Model for Automatic Segmentation of the Esophagus in 3-D CT Scans , 2011, IEEE Transactions on Medical Imaging.

[5]  Frank Deinzer,et al.  Automatic Detection of Air Holes Inside the Esophagus in CT Images , 2008, Bildverarbeitung für die Medizin.

[6]  Claudia Iriondo,et al.  Distance Map Loss Penalty Term for Semantic Segmentation , 2019, ArXiv.

[7]  Jose Dolz,et al.  Boundary loss for highly unbalanced segmentation , 2018, MIDL.

[8]  Peter D Siersema,et al.  Esophageal cancer. , 2008, Gastroenterology clinics of North America.

[9]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Mohammad T. Manzuri Shalmani,et al.  Esophageal Gross Tumor Volume Segmentation Using a 3D Convolutional Neural Network , 2018, MICCAI.

[11]  Ying Bai,et al.  Probabilistic minimal path for automated esophagus segmentation , 2006, SPIE Medical Imaging.

[12]  S. Heijmink,et al.  Gross tumour delineation on computed tomography and positron emission tomography-computed tomography in oesophageal cancer: A nationwide study , 2018, Clinical and translational radiation oncology.

[13]  M. Moerland,et al.  Quantification of esophageal tumor motion on cine-magnetic resonance imaging. , 2014, International journal of radiation oncology, biology, physics.

[14]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Dorin Comaniciu,et al.  Fast Automatic Segmentation of the Esophagus from 3D CT Data Using a Probabilistic Model , 2009, MICCAI.

[16]  Jinzhong Yang,et al.  Atlas ranking and selection for automatic segmentation of the esophagus from CT scans , 2017, Physics in medicine and biology.

[17]  Marius Staring,et al.  Robust contour propagation using deep learning and image registration for online adaptive proton therapy of prostate cancer , 2019, Medical physics.

[18]  D. Marshall Esophageal Cancer: Principles and Practice , 2009 .

[19]  Pei Wang,et al.  Focal Dice Loss and Image Dilation for Brain Tumor Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[20]  Geoffrey G. Zhang,et al.  Semi-automated CT segmentation using optic flow and Fourier interpolation techniques , 2006, Comput. Methods Programs Biomed..

[21]  Dorin Comaniciu,et al.  Model-Based Esophagus Segmentation from CT Scans Using a Spatial Probability Map , 2010, MICCAI.

[22]  Rong Zhang,et al.  Fully convolutional networks with double-label for esophageal cancer image segmentation by self-transfer learning , 2017, International Conference on Digital Image Processing.

[23]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[24]  Dimos Baltas,et al.  A 3D fully convolutional neural network and a random walker to segment the esophagus in CT , 2017, ArXiv.

[25]  Dinggang Shen,et al.  Fully automated esophagus segmentation with a hierarchical deep learning approach , 2017, 2017 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[26]  Deniz Erdogmus,et al.  Centerline extraction with principal curve tracing to improve 3D level set esophagus segmentation in CT images , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Marius Staring,et al.  Fast Dynamic Perfusion and Angiography Reconstruction using an end-to-end 3D Convolutional Neural Network , 2019, MLMIR@MICCAI.

[28]  Mariya Doneva,et al.  An Adaptive Intelligence Algorithm for Undersampled Knee MRI Reconstruction , 2020, IEEE Access.

[29]  Harvey Mamon,et al.  FDG-PET/CT Tumor Segmentation-Derived Indices of Metabolic Activity to Assess Response to Neoadjuvant Therapy and Progression-Free Survival in Esophageal Cancer: Correlation With Histopathology Results , 2007, American journal of clinical oncology.

[30]  Jennifer G. Dy,et al.  Locally Deformable Shape Model to Improve 3D Level Set Based Esophagus Segmentation , 2010, 2010 20th International Conference on Pattern Recognition.

[31]  Jiwei Liu,et al.  Esophagus Tumor Segmentation Using Fully Convolutional Neural Network and Graph Cut , 2017 .

[32]  Adam P. Harrison,et al.  Accurate Esophageal Gross Tumor Volume Segmentation in PET/CT using Two-Stream Chained 3D Deep Network Fusion , 2019, MICCAI.

[33]  Adam P. Harrison,et al.  Deep Esophageal Clinical Target Volume Delineation using Encoded 3D Spatial Context of Tumors, Lymph Nodes, and Organs At Risk , 2019, MICCAI.