Deep Learning for Automated Elective Lymph Node Level Segmentation for Head and Neck Cancer Radiotherapy

Simple Summary When treating patients with head-and-neck cancer (HNC), in addition to the primary tumour, commonly involved lymph node (LN) levels are often electively irradiated. This requires the definition of the elective LN target volume. Because the LN levels that will be included in the target depend on the clinical situation, and because manual contouring is a laborious task that can also introduce inter- and intra-observer variation, being able to automate the segmentation of individual LN levels would reduce the clinical burden and would allow use of contours regardless of the primary tumor location. We trained and evaluated three patch- and/or voxel-based deep learning frameworks to segment elective LN levels. Our results suggest that accurate segmentations can be obtained using an ensemble of patch-based UNets and that this result can be further refined by sequentially applying a 2.5D, multi-view voxel classification network. Abstract Depending on the clinical situation, different combinations of lymph node (LN) levels define the elective LN target volume in head-and-neck cancer (HNC) radiotherapy. The accurate auto-contouring of individual LN levels could reduce the burden and variability of manual segmentation and be used regardless of the primary tumor location. We evaluated three deep learning approaches for the segmenting individual LN levels I–V, which were manually contoured on CT scans from 70 HNC patients. The networks were trained and evaluated using five-fold cross-validation and ensemble learning for 60 patients with (1) 3D patch-based UNets, (2) multi-view (MV) voxel classification networks and (3) sequential UNet+MV. The performances were evaluated using Dice similarity coefficients (DSC) for automated and manual segmentations for individual levels, and the planning target volumes were extrapolated from the combined levels I–V and II–IV, both for the cross-validation and for an independent test set of 10 patients. The median DSC were 0.80, 0.66 and 0.82 for UNet, MV and UNet+MV, respectively. Overall, UNet+MV significantly (p < 0.0001) outperformed other arrangements and yielded DSC = 0.87, 0.85, 0.86, 0.82, 0.77, 0.77 for the combined and individual level I–V structures, respectively. Both PTVs were also significantly (p < 0.0001) more accurate with UNet+MV, with DSC = 0.91 and 0.90, respectively. The accurate segmentation of individual LN levels I–V can be achieved using an ensemble of UNets. UNet+MV can further refine this result.

[1]  Stefan Fischer,et al.  Deep learning for automatic head and neck lymph node level delineation provides expert-level accuracy , 2022, Frontiers in Oncology.

[2]  R. Hardie,et al.  IMNets: Deep Learning Using an Incremental Modular Network Synthesis Approach for Medical Imaging Applications , 2022, Applied Sciences.

[3]  Daisuke Kawahara,et al.  Stepwise deep neural network (stepwise-net) for head and neck auto-segmentation on CT images , 2022, Comput. Biol. Medicine.

[4]  M. Steenwijk,et al.  Automatic segmentation of head and neck primary tumors on MRI using a multi-view CNN , 2022, Cancer Imaging.

[5]  Ping Wang,et al.  Deep Learning-Augmented Head and Neck Organs at Risk Segmentation From CT Volumes , 2021, Frontiers in Physics.

[6]  A. Moll,et al.  Multi-view convolutional neural networks for automated ocular structure and tumor segmentation in retinoblastoma , 2021, Scientific Reports.

[7]  S. Korreman,et al.  Comparing different CT, PET and MRI multi-modality image combinations for deep learning-based head and neck tumor segmentation , 2021, Acta oncologica.

[8]  J. Geurts,et al.  Artificial double inversion recovery images for (juxta)cortical lesion visualization in multiple sclerosis , 2021, Multiple sclerosis.

[9]  W. Verbakel,et al.  Using Spatial Probability Maps to Highlight Potential Inaccuracies in Deep Learning-Based Contours: Facilitating Online Adaptive Radiation Therapy , 2021, Advances in radiation oncology.

[10]  W. Verbakel,et al.  Strategies to improve deep learning-based salivary gland segmentation , 2020, Radiation oncology.

[11]  W. Verbakel,et al.  Strategies to improve deep learning-based salivary gland segmentation , 2020, Radiation Oncology.

[12]  Skylar S. Gay,et al.  Generating High-Quality Lymph Node Clinical Target Volumes for Head and Neck Cancer Radiation Therapy Using a Fully Automated Deep Learning-Based Approach , 2020, International journal of radiation oncology, biology, physics.

[13]  F. Maes,et al.  Deep learning for elective neck delineation: more consistent and time efficient. , 2020, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[14]  Akos Gulyban,et al.  Interobserver variability in delineation of target volumes in head and neck cancer. , 2019, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[15]  Max Dahele,et al.  Deep Learning-Based Delineation of Head and Neck Organs at Risk: Geometric and Dosimetric Evaluation. , 2019, International journal of radiation oncology, biology, physics.

[16]  Maria Assunta Rocca,et al.  Multi-branch convolutional neural network for multiple sclerosis lesion segmentation , 2018, NeuroImage.

[17]  Quanzheng Li,et al.  Computationally Efficient Cascaded Training for Deep Unrolled Network in CT Imaging , 2018, Medical physics.

[18]  Xiaohui Xie,et al.  AnatomyNet: Deep learning for fast and fully automated whole‐volume segmentation of head and neck anatomy , 2018, Medical physics.

[19]  Tao Zhang,et al.  Deep Deconvolutional Neural Network for Target Segmentation of Nasopharyngeal Cancer in Planning Computed Tomography Images , 2017, Front. Oncol..

[20]  Hayit Greenspan,et al.  Multi-view longitudinal CNN for multiple sclerosis lesion segmentation , 2017, Eng. Appl. Artif. Intell..

[21]  Ronald M. Summers,et al.  Automatic Lymph Node Cluster Segmentation Using Holistically-Nested Neural Networks and Structured Optimization in CT Images , 2016, MICCAI.

[22]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[23]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[24]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[27]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[28]  Ronald M. Summers,et al.  A New 2.5D Representation for Lymph Node Detection Using Random Sets of Deep Convolutional Neural Network Observations , 2014, MICCAI.

[29]  Quynh-Thu Le,et al.  Delineation of the neck node levels for head and neck tumors: a 2013 update. DAHANCA, EORTC, HKNPCSG, NCIC CTG, NCRI, RTOG, TROG consensus guidelines. , 2014, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[30]  Robert Zivadinov,et al.  Improved assessment of multiple sclerosis lesion segmentation agreement via detection and outline error estimates , 2012, BMC Medical Imaging.

[31]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[32]  Benoit M Dawant,et al.  Combining registration and active shape models for the automatic segmentation of the lymph node regions in head and neck CT images. , 2010, Medical physics.

[33]  Joshua D. Lawson,et al.  Evaluation of automatic atlas-based lymph node segmentation for head-and-neck cancer. , 2010, International journal of radiation oncology, biology, physics.

[34]  R. D'Agostino An omnibus test of normality for moderate and large size samples , 1971 .