Automatic Segmentation Using a Hybrid Dense Network Integrated With an 3D-Atrous Spatial Pyramid Pooling Module for Computed Tomography (CT) Imaging

Computed tomography (CT) with a contrast-enhanced imaging technique is extensively proposed for the assessment and segmentation of multiple organs, especially organs at risk. It is an important factor involved in the decision making in clinical applications. Automatic segmentation and extraction of abdominal organs, such as thoracic organs at risk, from CT images are challenging tasks due to the low contrast of pixel values surrounding other organs. Various deep learning models based on 2D and 3D convolutional neural networks have been proposed for the segmentation of medical images because of their automatic feature extraction capability based on large labeled datasets. In this paper, we proposed a 3D-atrous spatial pyramid pooling (ASPP) module integrated with a proposed 3D DensNet encoder–decoder network for volumetric segmentation to segment abdominal organs from CT. The proposed network used a 3D-ASPP block to capture spatial information in multiscale input feature maps from the decoder side. We also proposed a 3D-ASPP block with a 3D DensNet network for automatically processing 3D medical volumetric images. The proposed hybrid network was named 3D-ASPPDN for volumetric segmentation via CT medical imaging. We tested our proposed approach on a public dataset, Thoracic Organs at Risk (SegTHOR) 2019. The proposed solution showed excellent performance in comparison with other existing state-of-the-art DL methods. The proposed method achieved Dice scores 97.89% on the SegTHOR dataset. Results presented that 3D-ASPPDN exhibited enhanced performance in volumetric biomedical segmentation. The proposed model could be used for volumetric segmentation in clinical applications to diagnose problems in multi class organs.

[1]  Fang Lu,et al.  Automatic 3D liver location and segmentation via convolutional neural network and graph cut , 2016, International Journal of Computer Assisted Radiology and Surgery.

[2]  Loïc Le Folgoc,et al.  Attention U-Net: Learning Where to Look for the Pancreas , 2018, ArXiv.

[3]  Yeonggul Jang,et al.  A Cascaded Two-step Approach For Segmentation of Thoracic Organs , 2019, SegTHOR@ISBI.

[4]  Yurong Liu,et al.  A survey of deep neural network architectures and their applications , 2017, Neurocomputing.

[5]  Purang Abolmaesumi,et al.  Augmenting Detection of Prostate Cancer in Transrectal Ultrasound Images Using SVM and RF Time Series , 2009, IEEE Transactions on Biomedical Engineering.

[6]  Toan Duc Bui,et al.  3D Densely Convolutional Networks for Volumetric Segmentation , 2017, ArXiv.

[7]  Mikhail Belyaev,et al.  Segthor: Segmentation of Thoracic Organs at Risk in CT Images , 2019, SegTHOR@ISBI.

[8]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jie Cai,et al.  Renal tumor contact surface area: a novel parameter for predicting complexity and outcomes of partial nephrectomy. , 2014, European urology.

[10]  Andreas K. Maier,et al.  A 2D dilated residual U-Net for multi-organ segmentation in thoracic CT , 2019, SegTHOR@ISBI.

[11]  Xiangyu Zhang,et al.  Large Kernel Matters — Improve Semantic Segmentation by Global Convolutional Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Arno Klein,et al.  Towards a deep learning approach to brain parcellation , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[13]  Zhang Yi,et al.  Multi-task Learning for the Segmentation of Thoracic Organs at Risk in CT images , 2019, SegTHOR@ISBI.

[14]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[15]  Seyed-Ahmad Ahmadi,et al.  Hough-CNN: Deep learning for segmentation of deep brain regions in MRI and ultrasound , 2016, Comput. Vis. Image Underst..

[16]  P. Cattin,et al.  Multi-dimensional Gated Recurrent Units for the Segmentation of Biomedical 3D-Data , 2016, LABELS/DLMIA@MICCAI.

[17]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[18]  Yaozong Gao,et al.  Segmentation of CT Thoracic Organs by Multi-resolution VB-nets , 2019, SegTHOR@ISBI.

[19]  Yoram Singer,et al.  Logistic Regression, AdaBoost and Bregman Distances , 2000, Machine Learning.

[20]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Li Zhang,et al.  Segmentation of Thoracic Organs at Risk in CT Images Combining Coarse and Fine Network , 2019, SegTHOR@ISBI.

[22]  Nassir Navab,et al.  Multimodal image-guided prostate fusion biopsy based on automatic deformable registration , 2015, International Journal of Computer Assisted Radiology and Surgery.

[23]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[24]  Jose Dolz,et al.  3D fully convolutional networks for subcortical segmentation in MRI: A large-scale study , 2016, NeuroImage.

[25]  Chi-Wing Fu,et al.  H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes , 2018, IEEE Transactions on Medical Imaging.

[26]  Nello Cristianini,et al.  Support vector machine classification and validation of cancer tissue samples using microarray expression data , 2000, Bioinform..

[27]  Lubomir M. Hadjiiski,et al.  Urinary bladder segmentation in CT urography using deep-learning convolutional neural network and level sets. , 2016, Medical physics.

[28]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[29]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[30]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[31]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[32]  Sebastian J. Schlecht,et al.  Automatic Liver and Tumor Segmentation of CT and MRI Volumes using Cascaded Fully Convolutional Neural Networks , 2017, ArXiv.

[33]  Chen Wang,et al.  Standardized Evaluation System for Left Ventricular Segmentation Algorithms in 3D Echocardiography , 2016, IEEE Transactions on Medical Imaging.

[34]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Fucang Jia,et al.  Automatic Segmentation of Liver Tumor in CT Images with Deep Convolutional Neural Networks , 2015 .

[36]  Yin Wang,et al.  Multi-organ Segmentation using Simplified Dense V-net with Post-processing , 2019, SegTHOR@ISBI.

[37]  Gangning Liang,et al.  Quantitative Contour Analysis as an Image-based Discriminator Between Benign and Malignant Renal Tumors. , 2018, Urology.

[38]  Iasonas Kokkinos,et al.  Sub-cortical brain structure segmentation using F-CNN'S , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[39]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[40]  Hao Chen,et al.  3D Deeply Supervised Network for Automatic Liver Segmentation from CT Volumes , 2016, MICCAI.

[41]  David Dagan Feng,et al.  Automatic Liver Lesion Detection using Cascaded Deep Residual Networks , 2017, ArXiv.

[42]  E. Crawford,et al.  Combining artificial neural networks and transrectal ultrasound in the diagnosis of prostate cancer. , 2003, Oncology.

[43]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[44]  Mireille Garreau,et al.  Evaluation of Cardiac Structure Segmentation in Cine Magnetic Resonance Imaging , 2015 .

[45]  Ganapathy Krishnamurthi,et al.  2D-Densely Connected Convolution Neural Networks for automatic Liver and Tumor Segmentation , 2018, ArXiv.

[46]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).