Automatic Segmentation of Head and Neck Tumors and Nodal Metastases in PET-CT scans

Radiomics, the prediction of disease characteristics using quantitative image biomarkers from medical images, relies on expensive manual annotations of Regions of Interest (ROI) to focus the analysis. In this paper, we propose an automatic segmentation of Head and Neck (H&N) tumors and nodal metastases from FDG-PET and CT images. A fully-convolutional network (2D and 3D V-Net) is trained on PET-CT images using ground truth ROIs that were manually delineated by radiation oncologists for 202 patients. The results show the complementarity of the two modalities with a statistically significant improvement from 48.7% and 58.2% Dice Score Coefficients (DSC) with CTand PET-only segmentation respectively, to 60.6% with a bimodal late fusion approach. We also note that, on this task, a 2D implementation slightly outperforms a similar 3D design (60.6% vs 59.7% for the best results respectively). The data is publicly available and the code will be shared on our GitHub repository.

[1]  R. Steenbakkers,et al.  The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping. , 2020, Radiology.

[2]  T. Gupta,et al.  Interobserver Variability in the Delineation of Gross Tumour Volume and Specified Organs-at-risk During IMRT for Head and Neck Cancers and the Impact of FDG-PET/CT on Such Variability at the Primary Site. , 2017, Journal of medical imaging and radiation sciences.

[3]  Yu Zhao,et al.  Automated Whole-Body Bone Lesion Detection for Multiple Myeloma on 68Ga-Pentixafor PET/CT Imaging Using Deep Learning Methods , 2018, Contrast media & molecular imaging.

[4]  B. O'Sullivan,et al.  Overview of the 8th Edition TNM Classification for Head and Neck Cancer , 2017, Current Treatment Options in Oncology.

[5]  Jayaram K. Udupa,et al.  New variants of a method of MRI scale standardization , 2000, IEEE Transactions on Medical Imaging.

[6]  J. Manens,et al.  Salivary gland-sparing other than parotid-sparing in definitive head-and-neck intensity-modulated radiotherapy does not seem to jeopardize local control , 2013, Radiation Oncology.

[7]  John O. Prior,et al.  Automatic lesion detection and segmentation of 18F-FET PET in gliomas: A full 3D U-Net convolutional neural network study , 2018, PloS one.

[8]  Jordi Giralt,et al.  Radiotherapy plus cetuximab for locoregionally advanced head and neck cancer: 5-year survival data from a phase 3 randomised trial, and relation between cetuximab-induced rash and survival. , 2010, The Lancet. Oncology.

[9]  Wei Lu,et al.  Deep learning for variational multimodality tumor segmentation in PET/CT , 2020, Neurocomputing.

[10]  J Castelli,et al.  A PET-based nomogram for oropharyngeal cancers. , 2017, European journal of cancer.

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  Oliver Tomic,et al.  Deep learning for automatic tumour segmentation in PET/CT images of patients with head and neck cancers , 2019, 1908.00841.

[13]  Matthias Guckenberger,et al.  Comparison of PET and CT radiomics for prediction of local tumor control in head and neck squamous cell carcinoma , 2017, Acta oncologica.

[14]  Patrick Granton,et al.  Radiomics: extracting more information from medical images using advanced feature analysis. , 2012, European journal of cancer.

[15]  J. Ferlay,et al.  Global Cancer Statistics, 2002 , 2005, CA: a cancer journal for clinicians.

[16]  Wei Lu,et al.  Tumor co-segmentation in PET/CT using multi-modality fully convolutional neural network , 2018, Physics in medicine and biology.

[17]  Parashkev Nachev,et al.  Computer Methods and Programs in Biomedicine NiftyNet: a deep-learning platform for medical imaging , 2022 .

[18]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[19]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[20]  Xiaodong Wu,et al.  3D fully convolutional networks for co-segmentation of tumors on PET-CT images , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[21]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[22]  A. Jemal,et al.  Global cancer statistics , 2011, CA: a cancer journal for clinicians.

[23]  David Dagan Feng,et al.  Co-Learning Feature Fusion Maps From PET-CT Images of Lung Cancer , 2018, IEEE Transactions on Medical Imaging.

[24]  Klaus H. Maier-Hein,et al.  nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentation , 2018, Bildverarbeitung für die Medizin.

[25]  Junjie Bai,et al.  Optimal Co-Segmentation of Tumor in PET-CT Images With Context Information , 2013, IEEE Transactions on Medical Imaging.

[26]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[27]  Michael R Hamblin,et al.  CA : A Cancer Journal for Clinicians , 2011 .

[28]  Su Ruan,et al.  A review: Deep learning for medical image segmentation using multi-modality fusion , 2019, Array.

[29]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[30]  Issam El-Naqa,et al.  Radiomics strategies for risk assessment of tumour failure in head-and-neck cancer , 2017, Scientific Reports.