Cone-beam CT to Planning CT synthesis using generative adversarial networks

Cone-beam computed tomography (CBCT) offers advantages over conventional fan-beam CT in that it requires a shorter time and less exposure to obtain images. CBCT has found a wide variety of applications in patient positioning for image-guided radiation therapy, extracting radiomic information for designing patient-specific treatment, and computing fractional dose distributions for adaptive radiation therapy. However, CBCT images suffer from low soft-tissue contrast, noise, and artifacts compared to conventional fan-beam CT images. Therefore, it is essential to improve the image quality of CBCT. In this paper, we propose a synthetic approach to translate CBCT images with deep neural networks. Our method requires only unpaired and unaligned CBCT images and planning fan-beam CT (PlanCT) images for training. Once trained, 3D reconstructed CBCT images can be directly translated to high-quality PlanCT-like images. We demonstrate the effectiveness of our method with images obtained from 20 prostate patients, and we provide a statistical and visual comparison. The image quality of the translated images shows substantial improvement in voxel values, spatial uniformity, and artifact suppression compared to those of the original CBCT. The anatomical structures of the original CBCT images were also well preserved in the translated images. Our method enables more accurate adaptive radiation therapy, and opens up new applications for CBCT that hinge on high-quality images.

[1]  L ADLER Treatment of Cervical Cancer , 1947, Acta radiologica.

[2]  Mateusz Buda,et al.  Deep learning in radiology: An overview of the concepts and a survey of the state of the art with focus on MRI , 2018, Journal of magnetic resonance imaging : JMRI.

[3]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Lin Yang,et al.  Translating and Segmenting Multimodal Medical Volumes with Cycle- and Shape-Consistency Generative Adversarial Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[6]  John Wong,et al.  Assessment of residual error for online cone-beam CT-guided treatment of prostate cancer patients. , 2004, International journal of radiation oncology, biology, physics.

[7]  Kenta Oono,et al.  Chainer : a Next-Generation Open Source Framework for Deep Learning , 2015 .

[8]  Lei Zhu,et al.  Fast shading correction for cone beam CT in radiation therapy via sparse sampling on planning CT , 2017, Medical physics.

[9]  Alexei A. Efros,et al.  Colorful Image Colorization , 2016, ECCV.

[10]  Peter Balter,et al.  Can radiomics features be reproducibly measured from CBCT images for patients with non-small cell lung cancer? , 2015, Medical physics.

[11]  Lei Xing,et al.  Multiscale registration of planning CT and daily cone beam CT images for adaptive radiation therapy. , 2009, Medical physics.

[12]  Christopher Kurz,et al.  Investigating deformable image registration and scatter correction for CBCT-based dose calculation in adaptive IMPT. , 2016, Medical physics.

[13]  Jason W Sohn,et al.  Spatially weighted mutual information image registration for image guided radiation therapy. , 2010, Medical physics.

[14]  Wolfgang Birkfellner,et al.  Image quality and stability of image-guided radiotherapy (IGRT) devices: A comparative study. , 2009, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[15]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  Takeshi Takata,et al.  Image quality improvement in cone-beam CT using the super-resolution technique , 2018, Journal of radiation research.

[18]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[19]  Xianliang Wang,et al.  Image guided radiation therapy boost in combination with high-dose-rate intracavitary brachytherapy for the treatment of cervical cancer , 2016, Journal of contemporary brachytherapy.

[20]  Kanabu Nawa,et al.  Cone Beam Computed Tomography Image Quality Improvement Using a Deep Convolutional Neural Network , 2018, Cureus.

[21]  Halima Saadia Kidar,et al.  Assessing the impact of choosing different deformable registration algorithms on cone-beam CT enhancement by histogram matching , 2018, Radiation Oncology.

[22]  Jelmer M. Wolterink,et al.  Deep MR to CT Synthesis Using Unpaired Data , 2017, SASHIMI@MICCAI.

[23]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[24]  Matthias Guckenberger,et al.  Magnitude and clinical relevance of translational and rotational patient setup errors: a cone-beam CT study. , 2006, International journal of radiation oncology, biology, physics.

[25]  Philippe Lambin,et al.  Feature selection methodology for longitudinal cone-beam CT radiomics , 2017, Acta oncologica.

[26]  Andrea Vedaldi,et al.  Instance Normalization: The Missing Ingredient for Fast Stylization , 2016, ArXiv.

[27]  A. Sisniega,et al.  Monte Carlo study of the effects of system geometry and antiscatter grids on cone-beam CT scatter distributions. , 2013, Medical physics.

[28]  J. Star-Lack,et al.  Improved scatter correction using adaptive scatter kernel superposition , 2010, Physics in medicine and biology.

[29]  Yuko Nakamura,et al.  Improvement of image quality at CT and MRI using deep learning , 2018, Japanese Journal of Radiology.

[30]  J. Wong,et al.  Flat-panel cone-beam computed tomography for image-guided radiation therapy. , 2002, International journal of radiation oncology, biology, physics.

[31]  Irwin Sobel,et al.  An Isotropic 3×3 image gradient operator , 1990 .

[32]  Ehsan Samei,et al.  Kilovoltage cone-beam CT: comparative dose and image quality evaluations in partial and full-angle scan protocols. , 2010, Medical physics.