Pseudo-CT Generation for Mri-only Radiotherapy: Comparative Study Between A Generative Adversarial Network, A U-Net Network, A Patch-Based, and an Atlas Based Methods

As new radiotherapy treatment systems using MRI (rather than traditional CT) are being developed, the accurate calculation of dose maps from MR imaging has become an increasing concern. MRI provides good soft-tissue but, unlike CT, lacks the electron density information necessary for dose calculation. In this paper, we proposed a generative adversarial network (GAN) using a perceptual loss to generate pseudo-CTs for prostate MRI dose calculation. This network was evaluated and compared to a U-Net network, a patch-based (PBM) and an atlas-based methods (ABM). Influence of the perceptual loss was assessed by comparing this network to a GAN using a L2 loss. GANs and U-Nets are rather similar with slightly better results for GANs. The proposed GAN outperformed the PBM by 9% and the ABM by 13% in term of MAE in whole pelvis. This method could be used for online dose calculation in MRI-only radiotherapy.

[1]  Olivier Salvado,et al.  MRI-guided prostate radiation therapy planning: Investigation of dosimetric accuracy of MRI-based dose planning. , 2011, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[2]  Jelmer M. Wolterink,et al.  MR-Only Brain Radiation Therapy: Dosimetric Evaluation of Synthetic CTs Generated by a Dilated Convolutional Neural Network. , 2018, International journal of radiation oncology, biology, physics.

[3]  John H. Lewis,et al.  Male pelvic synthetic CT generation from T1-weighted MRI using 2D and 3D convolutional neural networks , 2018, 1803.00131.

[4]  Jonathan J Wyatt,et al.  Systematic Review of Synthetic Computed Tomography Generation Methodologies for Use in Magnetic Resonance Imaging-Only Radiation Therapy. , 2018, International journal of radiation oncology, biology, physics.

[5]  Peter R Seevinck,et al.  Dose evaluation of fast synthetic-CT generation using a generative adversarial network for general pelvis MR-only radiotherapy , 2018, Physics in medicine and biology.

[6]  Caroline Lafond,et al.  Pseudo-CT Generation for MRI-Only Radiation Therapy Treatment Planning: Comparison Among Patch-Based, Atlas-Based, and Bulk Density Methods. , 2019, International journal of radiation oncology, biology, physics.

[7]  Peter B. Greer,et al.  Structure-Guided Nonrigid Registration of CT-MR Pelvis Scans with Large Deformations in MR-Based Image Guided Radiation Therapy , 2013, CLIP.

[8]  Jason Dowling,et al.  Pseudo-CT generation by conditional inference random forest for MRI-based radiotherapy treatment planning , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[9]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[10]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[11]  Jelmer M. Wolterink,et al.  Deep MR to CT Synthesis Using Unpaired Data , 2017, SASHIMI@MICCAI.

[12]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[13]  Jan J W Lagendijk,et al.  MRI/linac integration. , 2008, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[14]  Koen Van Leemput,et al.  A patch-based pseudo-CT approach for MRI-only radiotherapy in the pelvis. , 2016, Medical physics.

[15]  Jurgen Fripp,et al.  Automatic Substitute Computed Tomography Generation and Contouring for Magnetic Resonance Imaging (MRI)-Alone External Beam Radiation Therapy From Standard MRI Sequences. , 2015, International journal of radiation oncology, biology, physics.

[16]  Ninon Burgos,et al.  Robust CT Synthesis for Radiotherapy Planning: Application to the Head and Neck Region , 2015, MICCAI.

[17]  Yaozong Gao,et al.  Estimating CT Image From MRI Data Using Structured Random Forest and Auto-Context Model , 2016, IEEE Transactions on Medical Imaging.

[18]  Su Ruan,et al.  Medical Image Synthesis with Context-Aware Generative Adversarial Networks , 2016, MICCAI.

[19]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[20]  T. Torfeh,et al.  Generation of synthetic CT using multi-scale and dual-contrast patches for brain MRI-only external beam radiotherapy. , 2017, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[21]  Xiao Han,et al.  MR‐based synthetic CT generation using a deep convolutional neural network method , 2017, Medical physics.

[22]  Richard Hans Robert Hahnloser,et al.  Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit , 2000, Nature.

[23]  Jurgen Fripp,et al.  Robust inverse-consistent affine CT-MR registration in MRI-assisted and MRI-alone prostate radiation therapy , 2015, Medical Image Anal..