Robust contour propagation using deep learning and image registration for online adaptive proton therapy of prostate cancer

PURPOSE To develop and validate a robust and accurate registration pipeline for automatic contour propagation for online adaptive Intensity-Modulated Proton Therapy (IMPT) of prostate cancer using elastix software and deep learning. METHODS A 3D Convolutional Neural Network was trained for automatic bladder segmentation of the CT scans. The automatic bladder segmentation alongside the CT scan are jointly optimized to add explicit knowledge about the underlying anatomy to the registration algorithm. We included three datasets from different institutes and CT manufacturers. The first was used for training and testing the ConvNet, where the second and the third were used for evaluation of the proposed pipeline. The system performance was quantified geometrically using the Dice Similarity Coefficient (DSC), the Mean Surface Distance (MSD), and the 95% Hausdorff Distance (HD). The propagated contours were validated clinically through generating the associated IMPT plans and compare it with the IMPT plans based on the manual delineations. Propagated contours were considered clinically acceptable if their treatment plans met the dosimetric coverage constraints on the manual contours. RESULTS The bladder segmentation network achieved a DSC of 88% and 82% on the test datasets. The proposed registration pipeline achieved a MSD of 1:29±0:39, 1:48±1:16, and 1:49±0:44 mm for the prostate, seminal vesicles, and lymph nodes, respectively on the second dataset and a MSD of 2:31 ± 1:92 and 1:76 ± 1:39 mm for the prostate and seminal vesicles on the third dataset. The automatically propagated contours met the dose coverage constraints in 86%, 91%, and 99% of the cases for the prostate, seminal vesicles, and lymph nodes, respectively. A Conservative Success Rate (CSR) of 80% was obtained, compared to 65% when only using intensity-based registration. CONCLUSION The proposed registration pipeline obtained highly promising results for generating treatment plans adapted to the daily anatomy. With 80% of the automatically generated treatment plans directly usable without manual correction, a substantial improvement in system robustness was reached compared to a previous approach. The proposed method therefore facilitates more precise proton therapy of prostate cancer, potentially leading to fewer treatment related adverse side effects. This article is protected by copyright. All rights reserved.

[1]  Ludvig Paul Muren,et al.  Propagation of target and organ at risk contours in radiotherapy of prostate cancer using deformable image registration , 2010, Acta oncologica.

[2]  Tim Leiner,et al.  Dilated Convolutional Neural Networks for Cardiovascular MR Segmentation in Congenital Heart Disease , 2016, RAMBO+HVSMR@MICCAI.

[3]  Eugene Wong,et al.  Dynamic contrast enhanced CT aiding gross tumor volume delineation of liver tumors: an interobserver variability study. , 2014, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[4]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[5]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[6]  O. Odland,et al.  Intensity-modulated radiotherapy of pelvic lymph nodes in locally advanced prostate cancer: planning procedures and early experiences. , 2008, International journal of radiation oncology, biology, physics.

[7]  Bradley R Pieters,et al.  ESTRO ACROP consensus guideline on CT- and MRI-based target volume delineation for primary radiation therapy of localized prostate cancer. , 2018, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[8]  J. Petersen,et al.  Plan robustness of simultaneous integrated boost radiotherapy of prostate and lymph nodes for different image-guidance and delivery techniques , 2011, Acta oncologica.

[9]  Su Ruan,et al.  Medical Image Synthesis with Context-Aware Generative Adversarial Networks , 2016, MICCAI.

[10]  Sarang Joshi,et al.  Large deformation three-dimensional image registration in image-guided radiation therapy , 2005, Physics in medicine and biology.

[11]  Luca Incrocci,et al.  Deformation of prostate and seminal vesicles relative to intraprostatic fiducial markers. , 2008, International journal of radiation oncology, biology, physics.

[12]  T R Mackie,et al.  Introducing an on-line adaptive procedure for prostate image guided intensity modulate proton therapy , 2011, Physics in medicine and biology.

[13]  B C Stoel,et al.  Towards local progression estimation of pulmonary emphysema using CT. , 2014, Medical physics.

[14]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[15]  Dinu Coltuc,et al.  Exact histogram specification , 2006, IEEE Transactions on Image Processing.

[16]  Kuo Men,et al.  Automatic segmentation of the clinical target volume and organs at risk in the planning CT for rectal cancer using deep dilated convolutional neural networks , 2017, Medical physics.

[17]  E. J. Gómez,et al.  Methodology for registration of distended rectums in pelvic CT studies. , 2012, Medical physics.

[18]  Hanne M Kooy,et al.  Shortening delivery times of intensity modulated proton therapy by reducing proton energy layers during treatment plan optimization. , 2015, International journal of radiation oncology, biology, physics.

[19]  Boudewijn P. F. Lelieveldt,et al.  Fast Automatic Step Size Estimation for Gradient Descent Optimization of Image Registration , 2016, IEEE Transactions on Medical Imaging.

[20]  Tao Xu,et al.  SegAN: Adversarial Network with Multi-scale L1 Loss for Medical Image Segmentation , 2017, Neuroinformatics.

[21]  D. Dearnaley,et al.  Prostate Radiotherapy: Evaluating the Effect of Bladder and Rectal Changes on Prostate Movement - A CT Study , 2006 .

[22]  Murat Surucu,et al.  Evaluation of Deformable Image Registration-Based Contour Propagation From Planning CT to Cone-Beam CT , 2017, Technology in cancer research & treatment.

[23]  Michel Bolla,et al.  Guidelines for primary radiotherapy of patients with prostate cancer. , 2006, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[24]  A. Lomax,et al.  Intensity modulated proton therapy and its sensitivity to treatment uncertainties 1: the potential effects of calculational uncertainties , 2008, Physics in medicine and biology.

[25]  Yuchuan Qiao,et al.  Fast optimization methods for image registration in adaptive radiation therapy , 2017 .

[26]  Ben J M Heijmen,et al.  iCycle: Integrated, multicriterial beam angle, and profile optimization for generation of coplanar and noncoplanar IMRT plans. , 2012, Medical physics.

[27]  Stefan Klein,et al.  Fast Multidimensional B-spline Interpolation Using Template Metaprogramming , 2014, WBIR.

[28]  Joos V Lebesque,et al.  Strategies to reduce the systematic error due to tumor and rectum motion in radiotherapy of prostate cancer. , 2005, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[29]  Marius Staring,et al.  Evaluation of Multi-metric Registration for Online Adaptive Proton Therapy of Prostate Cancer , 2018, WBIR.

[30]  Maria Thor,et al.  Deformable image registration for contour propagation from CT to cone-beam CT scans in radiotherapy of prostate cancer , 2011, Acta oncologica.

[31]  Thomas S. Huang,et al.  Generative Image Inpainting with Contextual Attention , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[32]  Ping Xia,et al.  Repeat CT imaging and replanning during the course of IMRT for head-and-neck cancer. , 2006, International journal of radiation oncology, biology, physics.

[33]  Song Wang,et al.  Three-Dimensional CT Image Segmentation by Combining 2D Fully Convolutional Network with 3D Majority Voting , 2016, LABELS/DLMIA@MICCAI.

[34]  P. Storchi,et al.  The equivalence of multi-criteria methods for radiotherapy plan optimization , 2009, Physics in medicine and biology.

[35]  H M Kooy,et al.  Intensity modulated proton therapy. , 2015, British Journal of Radiology.

[36]  Lubomir M. Hadjiiski,et al.  Urinary bladder segmentation in CT urography using deep-learning convolutional neural network and level sets. , 2016, Medical physics.

[37]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[38]  Timothy Solberg,et al.  Multi-institutional clinical experience with the Calypso System in localization and continuous, real-time monitoring of the prostate gland during external radiotherapy. , 2007, International journal of radiation oncology, biology, physics.

[39]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[40]  Thyrza Jagt,et al.  An automated planning strategy for near real-time adaptive proton therapy in prostate cancer , 2018, Physics in medicine and biology.

[41]  S van de Water,et al.  Improved efficiency of multi-criteria IMPT treatment planning using iterative resampling of randomly placed pencil beams , 2013, Physics in medicine and biology.

[42]  Louis Potters,et al.  Deformable image registration and interobserver variation in contour propagation for radiation therapy planning , 2016, Journal of applied clinical medical physics.

[43]  Radhe Mohan,et al.  A deformable image registration method to handle distended rectums in prostate cancer radiotherapy. , 2006, Medical physics.

[44]  P. Levendag,et al.  Toward fully automated multicriterial plan generation: a prospective clinical study. , 2013, International journal of radiation oncology, biology, physics.

[45]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[46]  Hiroshi Ishikawa,et al.  Globally and locally consistent image completion , 2017, ACM Trans. Graph..

[47]  Dean C. Barratt,et al.  Adversarial Deformation Regularization for Training Image Registration Neural Networks , 2018, MICCAI.

[48]  Frank Van den Heuvel,et al.  Clinical application of a repositioning scheme, using gold markers and electronic portal imaging. , 2006, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.