Automatic Nasopharyngeal Carcinoma Segmentation Using Fully Convolutional Networks with Auxiliary Paths on Dual-Modality PET-CT Images

Nasopharyngeal carcinoma (NPC) is prevalent in certain areas, such as South China, Southeast Asia, and the Middle East. Radiation therapy is the most efficient means to treat this malignant tumor. Positron emission tomography–computed tomography (PET-CT) is a suitable imaging technique to assess this disease. However, the large amount of data produced by numerous patients causes traditional manual delineation of tumor contour, a basic step for radiotherapy, to become time-consuming and labor-intensive. Thus, the demand for automatic and credible segmentation methods to alleviate the workload of radiologists is increasing. This paper presents a method that uses fully convolutional networks with auxiliary paths to achieve automatic segmentation of NPC on PET-CT images. This work is the first to segment NPC using dual-modality PET-CT images. This technique is identical to what is used in clinical practice and offers considerable convenience for subsequent radiotherapy. The deep supervision introduced by auxiliary paths can explicitly guide the training of lower layers, thus enabling these layers to learn more representative features and improve the discriminative capability of the model. Results of threefold cross-validation with a mean dice score of 87.47% demonstrate the efficiency and robustness of the proposed method. The method remarkably outperforms state-of-the-art methods in NPC segmentation. We also validated by experiments that the registration process among different subjects and the auxiliary paths strategy are considerably useful techniques for learning discriminative features and improving segmentation performance.

[1]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Xinjian Chen,et al.  Random Walk and Graph Cut for Co-Segmentation of Lung Tumor on PET-CT Images , 2015, IEEE Transactions on Image Processing.

[3]  Guang Yang,et al.  Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks , 2017, MIUA.

[4]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[5]  Sebastian J. Schlecht,et al.  Automatic Liver and Tumor Segmentation of CT and MRI Volumes using Cascaded Fully Convolutional Neural Networks , 2017, ArXiv.

[6]  J. Buatti,et al.  Globally Optimal Tumor Segmentation in PET-CT Images: A Graph-Based Co-segmentation Method , 2011, IPMI.

[7]  Quanshi Wang,et al.  Preliminary Study of 11C-Choline PET/CT for T Staging of Locally Advanced Nasopharyngeal Carcinoma: Comparison with 18F-FDG PET/CT , 2011, The Journal of Nuclear Medicine.

[8]  Tao Chan,et al.  Automatic detection and classification of nasopharyngeal carcinoma on PET/CT with support vector machine , 2012, International Journal of Computer Assisted Radiology and Surgery.

[9]  Hugues Talbot,et al.  Automated 3D lymphoma lesion segmentation from PET/CT characteristics , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[10]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[11]  Mazin Abed Mohammed,et al.  Artificial neural networks for automatic segmentation and identification of nasopharyngeal carcinoma , 2017, J. Comput. Sci..

[12]  Kuan-Lun Tseng,et al.  Joint Sequence Learning and Cross-Modality Convolution for 3D Biomedical Segmentation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  R. Steenbakkers,et al.  Semi-automatic delineation using weighted CT-MRI registered images for radiotherapy of nasopharyngeal cancer. , 2011, Medical physics.

[14]  Tao Zhang,et al.  Deep Deconvolutional Neural Network for Target Segmentation of Nasopharyngeal Cancer in Planning Computed Tomography Images , 2017, Front. Oncol..

[15]  Wei Huang,et al.  Region-Based Nasopharyngeal Carcinoma Lesion Segmentation from MRI Using Clustering- and Classification-Based Methods with Learning , 2013, Journal of Digital Imaging.

[16]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[17]  Aapo Hyvärinen,et al.  The Fixed-Point Algorithm and Maximum Likelihood Estimation for Independent Component Analysis , 1999, Neural Processing Letters.

[18]  Hao Chen,et al.  3D deeply supervised network for automated segmentation of volumetric medical images , 2017, Medical Image Anal..

[19]  Liu Chen,et al.  Nasopharyngeal carcinoma segmentation via HMRF-EM with maximum entropy , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[20]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[21]  Weerayuth Chanapai,et al.  Nasopharyngeal carcinoma segmentation using a region growing technique , 2012, International Journal of Computer Assisted Radiology and Surgery.

[22]  Panrasee Ritthipravat,et al.  Automatic segmentation of nasopharyngeal carcinoma from CT images: Region growing based technique , 2010, 2010 2nd International Conference on Signal Processing Systems.

[23]  M. Mohammed Thaha,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2019, Journal of Medical Systems.

[24]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[25]  Lisa Tang,et al.  Deep 3D Convolutional Encoder Networks With Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation , 2016, IEEE Transactions on Medical Imaging.

[26]  Yong Luo,et al.  Automatic Tumor Segmentation with Deep Convolutional Neural Networks for Radiotherapy Applications , 2017, Neural Processing Letters.

[27]  W. Xue,et al.  Global trends in incidence and mortality of nasopharyngeal carcinoma. , 2016, Cancer letters.

[28]  Junjie Bai,et al.  Optimal Co-Segmentation of Tumor in PET-CT Images With Context Information , 2013, IEEE Transactions on Medical Imaging.