Fully automatic and robust segmentation of the clinical target volume for radiotherapy of breast cancer using big data and deep learning.

PURPOSE To train and evaluate a very deep dilated residual network (DD-ResNet) for fast and consistent auto-segmentation of the clinical target volume (CTV) for breast cancer (BC) radiotherapy with big data. METHODS DD-ResNet was an end-to-end model enabling fast training and testing. We used big data comprising 800 patients who underwent breast-conserving therapy for evaluation. The CTV were validated by experienced radiation oncologists. We performed a fivefold cross-validation to test the performance of the model. The segmentation accuracy was quantified by the Dice similarity coefficient (DSC) and the Hausdorff distance (HD). The performance of the proposed model was evaluated against two different deep learning models: deep dilated convolutional neural network (DDCNN) and deep deconvolutional neural network (DDNN). RESULTS Mean DSC values of DD-ResNet (0.91 and 0.91) were higher than the other two networks (DDCNN: 0.85 and 0.85; DDNN: 0.88 and 0.87) for both right-sided and left-sided BC. It also has smaller mean HD values of 10.5 mm and 10.7 mm compared with DDCNN (15.1 mm and 15.6 mm) and DDNN (13.5 mm and 14.1 mm). Mean segmentation time was 4 s, 21 s and 15 s per patient with DDCNN, DDNN and DD-ResNet, respectively. The DD-ResNet was also superior with regard to results in the literature. CONCLUSIONS The proposed method could segment the CTV accurately with acceptable time consumption. It was invariant to the body size and shape of patients and could improve the consistency of target delineation and streamline radiotherapy workflows.

[1]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Feng Chen,et al.  Automatic abdominal multi-organ segmentation using deep convolutional neural network and time-implicit level sets , 2016, International Journal of Computer Assisted Radiology and Surgery.

[4]  Chris McIntosh,et al.  Voxel-based dose prediction with multi-patient atlas selection for automated radiotherapy treatment planning , 2016, Physics in medicine and biology.

[5]  C. Raaijmakers,et al.  Interobserver variability of clinical target volume delineation of glandular breast tissue and of boost volume in tangential breast irradiation. , 2005, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[6]  Jasper Nijkamp,et al.  Target volume delineation in breast conserving radiotherapy: are co-registered CT and MR images of added value? , 2014, Radiation oncology.

[7]  W. Woodward,et al.  Variability of target and normal structure delineation for breast cancer radiotherapy: an RTOG Multi-Institutional and Multiobserver Study. , 2007, International journal of radiation oncology, biology, physics.

[8]  L. Holloway,et al.  Interobserver variability in clinical target volume delineation in tangential breast irradiation: a comparison between radiation oncologists and radiation therapists. , 2011, Clinical oncology (Royal College of Radiologists (Great Britain)).

[9]  Bulat Ibragimov,et al.  Segmentation of organs‐at‐risks in head and neck CT images using convolutional neural networks , 2017, Medical physics.

[10]  Tao Zhang,et al.  Deep Deconvolutional Neural Network for Target Segmentation of Nasopharyngeal Cancer in Planning Computed Tomography Images , 2017, Front. Oncol..

[11]  Jeremiah Hwee,et al.  Creation of RTOG compliant patient CT-atlases for automated atlas based contouring of local regional breast and high-risk prostate cancers , 2013, Radiation oncology.

[12]  Tomas M Janssen,et al.  Target volume delineation in external beam partial breast irradiation: less inter-observer variation with preoperative- compared to postoperative delineation. , 2014, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[13]  Corine van Vliet-Vroegindeweij,et al.  Multiinstitutional study on target volume delineation variation in breast radiotherapy in the presence of guidelines. , 2010, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[14]  Pascal Haigron,et al.  Evaluation of multi-atlas-based segmentation of CT scans in prostate cancer radiotherapy , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[15]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[17]  Frederik Wenz,et al.  Performance of an atlas-based autosegmentation software for delineation of target volumes for radiotherapy of breast and anorectal cancer. , 2012, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[20]  Lubomir M. Hadjiiski,et al.  Urinary bladder segmentation in CT urography using deep-learning convolutional neural network and level sets. , 2016, Medical physics.

[21]  Dany Simard,et al.  Magnetic resonance imaging for prostate bed radiotherapy planning: An inter‐ and intra‐observer variability study , 2016, Journal of medical imaging and radiation oncology.

[22]  Vibhav Vineet,et al.  Conditional Random Fields as Recurrent Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[23]  G. Sharp,et al.  Vision 20/20: perspectives on automated image segmentation for radiotherapy. , 2014, Medical physics.

[24]  Xiao Han,et al.  MR‐based synthetic CT generation using a deep convolutional neural network method , 2017, Medical physics.

[25]  A. Burgun,et al.  Big Data and machine learning in radiation oncology: State of the art and future prospects. , 2016, Cancer letters.

[26]  B J Mijnheer,et al.  Variability in target volume delineation on CT scans of the breast. , 2001, International journal of radiation oncology, biology, physics.

[27]  B. Yaremko,et al.  Inter-observer and intra-observer reliability for lung cancer target volume delineation in the 4D-CT era. , 2009, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[28]  Mechthild Krause,et al.  Internal and external validation of an ESTRO delineation guideline - dependent automated segmentation tool for loco-regional radiation therapy of early breast cancer. , 2016, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[29]  Kuo Men,et al.  Automatic segmentation of the clinical target volume and organs at risk in the planning CT for rectal cancer using deep dilated convolutional neural networks , 2017, Medical physics.

[30]  Paolo Zaffino,et al.  Atlas-based segmentation in breast cancer radiotherapy: Evaluation of specific and generic-purpose atlases. , 2017, Breast.

[31]  M. Stock,et al.  Assessment of accuracy and efficiency of atlas-based autosegmentation for prostate radiotherapy in a variety of clinical conditions , 2012, Strahlentherapie und Onkologie.