Comparison of the automatic segmentation of multiple organs at risk in CT images of lung cancer between deep convolutional neural network-based and atlas-based techniques

Abstract Background: In this study, a deep convolutional neural network (CNN)-based automatic segmentation technique was applied to multiple organs at risk (OARs) depicted in computed tomography (CT) images of lung cancer patients, and the results were compared with those generated through atlas-based automatic segmentation. Materials and methods: An encoder-decoder U-Net neural network was produced. The trained deep CNN performed the automatic segmentation of CT images for 36 cases of lung cancer. The Dice similarity coefficient (DSC), the mean surface distance (MSD) and the 95% Hausdorff distance (95% HD) were calculated, with manual segmentation results used as the standard, and were compared with the results obtained through atlas-based segmentation. Results: For the heart, lungs and liver, both the deep CNN-based and atlas-based techniques performed satisfactorily (average values: 0.87 < DSC < 0.95, 1.8 mm < MSD < 3.8 mm, 7.9 mm < 95% HD <11 mm). For the spinal cord and the oesophagus, the two methods had statistically significant differences. For the atlas-based technique, the average values were 0.54 < DSC < 0.71, 2.6 mm < MSD < 3.1 mm and 9.4 mm < 95% HD <12 mm. For the deep CNN-based technique, the average values were 0.71 < DSC < 0.79, 1.2 mm < MSD <2.2 mm and 4.0 mm < 95% HD < 7.9 mm. Conclusion: Our results showed that automatic segmentation based on a deep convolutional neural network enabled us to complete automatic segmentation tasks rapidly. Deep convolutional neural networks can be satisfactorily adapted to segment OARs during radiation treatment planning for lung cancer patients.

[1]  Grégoire Malandain,et al.  Evaluation of an atlas-based automatic segmentation software for the delineation of brain organs at risk in a radiation therapy clinical context. , 2008, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[2]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[3]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[4]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[5]  M. Salvatore,et al.  Automated delineation of brain structures in patients undergoing radiotherapy for primary brain tumors: from atlas to dose-volume histograms. , 2014, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[6]  A. Lomax,et al.  Systematic evaluation of three different commercial software solutions for automatic segmentation for adaptive therapy in head-and-neck, prostate and pleural cancer , 2012, Radiation oncology.

[7]  Cameron S. Carter,et al.  Optimum template selection for atlas-based segmentation , 2007, NeuroImage.

[8]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[9]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[10]  Benoit M. Dawant,et al.  Morphometric analysis of white matter lesions in MR images: method and validation , 1994, IEEE Trans. Medical Imaging.

[11]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[12]  J. Bartko Measurement and reliability: statistical thinking considerations. , 1991, Schizophrenia bulletin.

[13]  Paul Aljabar,et al.  Autosegmentation for thoracic radiation treatment planning: A grand challenge at AAPM 2017 , 2018, Medical physics.

[14]  M Vermandel,et al.  Interactive contour delineation of organs at risk in radiotherapy: Clinical evaluation on NSCLC patients. , 2016, Medical physics.

[15]  William M. Wells,et al.  Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation , 2004, IEEE Transactions on Medical Imaging.

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Lubomir M. Hadjiiski,et al.  Bladder Cancer Segmentation in CT for Treatment Response Assessment: Application of Deep-Learning Convolution Neural Network—A Pilot Study , 2016, Tomography.

[19]  Paolo Zaffino,et al.  Atlas-based segmentation in breast cancer radiotherapy: Evaluation of specific and generic-purpose atlases. , 2017, Breast.

[20]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[21]  O. Commowick,et al.  A pre-clinical assessment of an atlas-based automatic segmentation tool for the head and neck. , 2009, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[22]  J. Sonke,et al.  Dose to heart substructures is associated with non-cancer death after SBRT in stage I-II NSCLC patients. , 2017, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[23]  B. van Ginneken,et al.  Automatic lung segmentation from thoracic computed tomography scans using a hybrid approach with error detection. , 2009, Medical physics.

[24]  Dimos Baltas,et al.  Esophagus segmentation in CT via 3D fully convolutional neural network and random walk , 2017, Medical physics.

[25]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[26]  Paul J Keall,et al.  MLC tracking for lung SABR reduces planning target volumes and dose to organs at risk. , 2017, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[27]  S. Senan,et al.  Outcomes of Stereotactic Ablative Radiotherapy for Centrally Located Early-Stage Lung Cancer , 2011, Journal of thoracic oncology : official publication of the International Association for the Study of Lung Cancer.

[28]  M. Leech,et al.  Use of auto-segmentation in the delineation of target volumes and organs at risk in head and neck , 2016, Acta oncologica.

[29]  N. Dubrawsky Cancer statistics , 1989, CA: a cancer journal for clinicians.

[30]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[31]  Jose Dolz,et al.  3D fully convolutional networks for subcortical segmentation in MRI: A large-scale study , 2016, NeuroImage.

[32]  Suresh Senan,et al.  Outcomes of stereotactic ablative radiotherapy in patients with potentially operable stage I non-small cell lung cancer. , 2012, International journal of radiation oncology, biology, physics.

[33]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[34]  Mert R. Sabuncu,et al.  A Generative Model for Image Segmentation Based on Label Fusion , 2010, IEEE Transactions on Medical Imaging.

[35]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[36]  J. Jett,et al.  Treatment of non-small cell lung cancer, stage IIIB: ACCP evidence-based clinical practice guidelines (2nd edition). , 2007, Chest.

[37]  Jose Belderbos,et al.  Meta-analysis of concomitant versus sequential radiochemotherapy in locally advanced non-small-cell lung cancer. , 2010, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[38]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[39]  Polina Golland,et al.  Contour-Driven Atlas-Based Segmentation. , 2015, IEEE transactions on medical imaging.

[40]  Peter Balter,et al.  Clinical outcome and predictors of survival and pneumonitis after stereotactic ablative radiotherapy for stage I non-small cell lung cancer , 2012, Radiation oncology.

[41]  Bulat Ibragimov,et al.  Segmentation of organs‐at‐risks in head and neck CT images using convolutional neural networks , 2017, Medical physics.

[42]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[43]  Stewart Gaede,et al.  An evaluation of an automated 4D-CT contour propagation tool to define an internal gross tumour volume for lung cancer radiotherapy. , 2011, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[44]  Paul Aljabar,et al.  Clinical evaluation of atlas and deep learning based automatic contouring for lung cancer. , 2017, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[45]  G. Sharp,et al.  Vision 20/20: perspectives on automated image segmentation for radiotherapy. , 2014, Medical physics.

[46]  A. Jemal,et al.  Cancer statistics, 2017 , 2017, CA: a cancer journal for clinicians.