A deep learning approach to segmentation of nasopharyngeal carcinoma using computed tomography

Abstract Automated segmentation of Nasopharyngeal carcinoma (NPC) plays a critical role in the radiotherapy or chemo-radiotherapy for this cancer. Despite their improved performance, most deep learning models designed for this segmentation task use either magnetic resonance imaging (MRI) or multimodality data as input. In this paper, we propose a deep learning based algorithm called NPC-Seg for the segmentation of NPC using computed tomography (CT), which is less expensive and more available than MRI. This algorithm uses the location-to-segmentation framework. In the location step, it fine-tunes the pre-trained ResNeXt-50 U-Net with a newly proposed recall preserved loss to roughly segment the gross tumor volume (GTV) of each NPC. In the segmentation step, it fine-tunes the ResNeXt-50 U-Net again, but using the Dice loss, to segment the bounding box region detected in the location step on a patch-by-patch basis. We have evaluated the proposed NPC-Seg algorithm on the StructSeg-NPC dataset. Our algorithm achieves the Dice similarity coefficient (DSC) of 62.88 ± 8.12 % on 50 training data in the ten-fold cross-validation, substantially outperforming three existing deep learning methods, and also achieves an average DSC of 61.81% on the testing dataset in the online validation.

[1]  Chaosu Hu,et al.  Omission of Chemotherapy in Early Stage Nasopharyngeal Carcinoma Treated with IMRT , 2015, Medicine.

[2]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Weerayuth Chanapai,et al.  Nasopharyngeal carcinoma segmentation using a region growing technique , 2012, International Journal of Computer Assisted Radiology and Surgery.

[4]  Tao Zhang,et al.  Deep Deconvolutional Neural Network for Target Segmentation of Nasopharyngeal Cancer in Planning Computed Tomography Images , 2017, Front. Oncol..

[5]  Chi-Wing Fu,et al.  H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes , 2018, IEEE Transactions on Medical Imaging.

[6]  Hao Chen,et al.  Automatic 3D Cardiovascular MR Segmentation with Densely-Connected Volumetric ConvNets , 2017, MICCAI.

[7]  Jun Ma,et al.  Nasopharyngeal carcinoma , 2019, The Lancet.

[8]  Pheng-Ann Heng,et al.  Deep Learning for Automated Contouring of Primary Tumor Volumes by MRI for Nasopharyngeal Carcinoma. , 2019, Radiology.

[9]  Raymond Y Huang,et al.  Artificial intelligence in cancer imaging: Clinical challenges and applications , 2019, CA: a cancer journal for clinicians.

[10]  Xin Yang,et al.  Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved? , 2018, IEEE Transactions on Medical Imaging.

[11]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[12]  Hao Chen,et al.  3D Deeply Supervised Network for Automatic Liver Segmentation from CT Volumes , 2016, MICCAI.

[13]  Yong Yin,et al.  MMFNet: A Multi-modality MRI Fusion Network for Segmentation of Nasopharyngeal Carcinoma , 2018, Neurocomputing.

[14]  Sébastien Ourselin,et al.  Automatic Brain Tumor Segmentation Using Cascaded Anisotropic Convolutional Neural Networks , 2017, BrainLes@MICCAI.

[15]  Yang Song,et al.  3D APA-Net: 3D Adversarial Pyramid Anisotropic Convolutional Network for Prostate Segmentation in MR Images , 2020, IEEE Transactions on Medical Imaging.

[16]  Jiliu Zhou,et al.  Automatic nasopharyngeal carcinoma segmentation in MR images with convolutional neural networks , 2017, 2017 International Conference on the Frontiers and Advances in Data Science (FADS).

[17]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Ryo Kurazume,et al.  3D segmentation of nasopharyngeal carcinoma from CT images using cascade deep learning , 2019, Comput. Medical Imaging Graph..

[19]  Chunhua Shen,et al.  A Mutual Bootstrapping Model for Automated Skin Lesion Segmentation and Classification , 2020, IEEE Transactions on Medical Imaging.

[20]  Jie Wei,et al.  M3Net: A multi-model, multi-size, and multi-view deep neural network for brain magnetic resonance image segmentation , 2019, Pattern Recognit..

[21]  Huan Wang,et al.  CSAF-CNN: Cross-Layer Spatial Attention Map Fusion Network for Organ-at-Risk Segmentation in Head and Neck CT Images , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[22]  Yong Xia,et al.  Deep Reinforcement Learning for Weakly-Supervised Lymph Node Segmentation in CT Images , 2020, IEEE Journal of Biomedical and Health Informatics.

[23]  Zhipeng Yang,et al.  A discriminative learning based approach for automated nasopharyngeal carcinoma segmentation leveraging multi-modality similarity metric learning , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[24]  Ziv Yaniv,et al.  SimpleITK Image-Analysis Notebooks: a Collaborative Environment for Education and Reproducible Research , 2017, Journal of Digital Imaging.

[25]  Martin Styner,et al.  Comparison and Evaluation of Methods for Liver Segmentation From CT Datasets , 2009, IEEE Transactions on Medical Imaging.

[26]  Seyed-Ahmad Ahmadi,et al.  Automatic Liver and Lesion Segmentation in CT Using Cascaded Fully Convolutional Neural Networks and 3D Conditional Random Fields , 2016, MICCAI.

[27]  Yong Luo,et al.  Tumor segmentation via multi-modality joint dictionary learning , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[28]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[29]  Panrasee Ritthipravat,et al.  Automatic segmentation of nasopharyngeal carcinoma from CT images: Region growing based technique , 2010, 2010 2nd International Conference on Signal Processing Systems.

[30]  Liu Chen,et al.  Nasopharyngeal carcinoma segmentation via HMRF-EM with maximum entropy , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[31]  Pelayo Vilar,et al.  Nasopharyngeal Carcinoma , 1966 .

[32]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[33]  R. Steenbakkers,et al.  Semi-automatic delineation using weighted CT-MRI registered images for radiotherapy of nasopharyngeal cancer. , 2011, Medical physics.

[34]  Yassine Ruichek,et al.  Survey on semantic segmentation using deep learning techniques , 2019, Neurocomputing.

[35]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[36]  Jing Huang,et al.  A Texture Combined Multispectral Magnetic Resonance Imaging Segmentation for Nasopharyngeal Carcinoma , 2003 .

[37]  Sébastien Ourselin,et al.  Automatic Brain Tumor Segmentation Based on Cascaded Convolutional Neural Networks With Uncertainty Estimation , 2019, Front. Comput. Neurosci..