Projection-domain scatter correction for cone beam computed tomography using a residual convolutional neural network.

PURPOSE Scatter is a major factor degrading the image quality of cone beam computed tomography (CBCT). Conventional scatter correction strategies require handcrafted analytical models with ad hoc assumptions, which often leads to less accurate scatter removal. This study aims to develop an effective scatter correction method using a residual convolutional neural network (CNN). METHODS A U-net based 25-layer CNN was constructed for CBCT scatter correction. The establishment of the model consists of three steps: model training, validation, and testing. For model training, a total of 1800 pairs of x-ray projection and the corresponding scatter-only distribution in nonanthropomorphic phantoms taken in full-fan scan were generated using Monte Carlo simulation of a CBCT scanner installed with a proton therapy system. An end-to-end CNN training was implemented with two major loss functions for 100 epochs with a mini-batch size of 10. Image rotations and flips were randomly applied to augment the training datasets during training. For validation, 200 projections of a digital head phantom were collected. The proposed CNN-based method was compared to a conventional projection-domain scatter correction method named fast adaptive scatter kernel superposition (fASKS) method using 360 projections of an anthropomorphic head phantom. Two different loss functions were applied for the same CNN to evaluate the impact of loss functions on the final results. Furthermore, the CNN model trained with full-fan projections was fine-tuned for scatter correction in half-fan scan by using transfer learning with additional 360 half-fan projection pairs of nonanthropomorphic phantoms. The tuned-CNN model for half-fan scan was compared with the fASKS method as well as the CNN-based method without the fine-tuning using additional lung phantom projections. RESULTS The CNN-based method provides projections with significantly reduced scatter and CBCT images with more accurate Hounsfield Units (HUs) than that of the fASKS-based method. Root mean squared error of the CNN-corrected projections was improved to 0.0862 compared to 0.278 for uncorrected projections or 0.117 for the fASKS-corrected projections. The CNN-corrected reconstruction provided better HU quantification, especially in regions near the air or bone interfaces. All four image quality measures, which include mean absolute error (MAE), mean squared error (MSE), peak signal-to-noise ratio (PSNR), and structural similarity (SSIM), indicated that the CNN-corrected images were significantly better than that of the fASKS-corrected images. Moreover, the proposed transfer learning technique made it possible for the CNN model trained with full-fan projections to be applicable to remove scatters in half-fan projections after fine-tuning with only a small number of additional half-fan training datasets. SSIM value of the tuned-CNN-corrected images was 0.9993 compared to 0.9984 for the non-tuned-CNN-corrected images or 0.9990 for the fASKS-corrected images. Finally, the CNN-based method is computationally efficient - the correction time for the 360 projections only took less than 5 s in the reported experiments on a PC (4.20 GHz Intel Core-i7 CPU) with a single NVIDIA GTX 1070 GPU. CONCLUSIONS The proposed deep learning-based method provides an effective tool for CBCT scatter correction and holds significant value for quantitative imaging and image-guided radiation therapy.

[1]  Florence Parent,et al.  Automated PET segmentation for lung tumors: Can deep learning reach optimized expert-based performance? , 2018 .

[2]  Ping Tan,et al.  DualGAN: Unsupervised Dual Learning for Image-to-Image Translation , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  Bulat Ibragimov,et al.  Segmentation of organs‐at‐risks in head and neck CT images using convolutional neural networks , 2017, Medical physics.

[4]  Alexander Binder,et al.  Evaluating the Visualization of What a Deep Neural Network Has Learned , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Christopher Kurz,et al.  ScatterNet: A convolutional neural network for cone‐beam CT intensity correction , 2018, Medical physics.

[6]  Abhinav K. Jha,et al.  A deep-learning-based fully automated segmentation approach to delineate tumors in FDG-PET images of patients with lung cancer , 2018 .

[7]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[8]  Mannudeep K. Kalra,et al.  Low-Dose CT with a Residual Encoder-Decoder Convolutional Neural Network (RED-CNN) , 2017, ArXiv.

[9]  Hao Chen,et al.  3D deeply supervised network for automated segmentation of volumetric medical images , 2017, Medical Image Anal..

[10]  Ruola Ning,et al.  X-ray scatter correction algorithm for cone beam CT imaging. , 2004, Medical physics.

[11]  Dávid Papp,et al.  Shared data for intensity modulated radiation therapy (IMRT) optimization research: the CORT dataset , 2014, GigaScience.

[12]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[13]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[14]  Alexander Binder,et al.  On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation , 2015, PloS one.

[15]  Ronald M. Summers,et al.  An analysis of robust cost functions for CNN in computer-aided diagnosis , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[16]  D Lazos,et al.  Impact of flat panel-imager veiling glare on scatter-estimation accuracy and image quality of a commercial on-board cone-beam CT imaging system. , 2012, Medical physics.

[17]  Xiao Han,et al.  MR‐based synthetic CT generation using a deep convolutional neural network method , 2017, Medical physics.

[18]  S Webb,et al.  Removal and effects of scatter-glare in cone-beam CT with an amorphous-silicon flat-panel detector , 2011, Physics in medicine and biology.

[19]  D. R. White,et al.  Average soft-tissue and bone models for use in radiation dosimetry. , 1987, The British journal of radiology.

[20]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[21]  Manuchehr Soleimani,et al.  TIGRE: a MATLAB-GPU toolbox for CBCT image reconstruction , 2016 .

[22]  Jelmer M. Wolterink,et al.  Deep MR to CT Synthesis Using Unpaired Data , 2017, SASHIMI@MICCAI.

[23]  F. Verhaegen,et al.  Sensitivity study for CT image use in Monte Carlo treatment planning , 2005, Physics in medicine and biology.

[24]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  S Stute,et al.  GATE V6: a major enhancement of the GATE simulation platform enabling modelling of CT and radiotherapy , 2011, Physics in medicine and biology.

[26]  K. Klingenbeck-Regn,et al.  Efficient object scatter correction algorithm for third and fourth generation CT scanners , 1999, European Radiology.

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  F Verhaegen,et al.  SpekCalc: a program to calculate photon spectra from tungsten anode x-ray tubes , 2009, Physics in medicine and biology.

[29]  Jun Xu,et al.  Learning deconvolutional deep neural network for high resolution medical image reconstruction , 2018, Inf. Sci..

[30]  J. Star-Lack,et al.  Improved scatter correction using adaptive scatter kernel superposition , 2010, Physics in medicine and biology.

[31]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[32]  Jan Kautz,et al.  Loss Functions for Image Restoration With Neural Networks , 2017, IEEE Transactions on Computational Imaging.

[33]  A. Sisniega,et al.  Monte Carlo study of the effects of system geometry and antiscatter grids on cone-beam CT scatter distributions. , 2013, Medical physics.

[34]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[35]  Lei Zhu,et al.  Scatter correction for cone-beam CT in radiation therapy. , 2009 .

[36]  K. Klingenbeck,et al.  A general framework and review of scatter correction methods in cone beam CT. Part 2: scatter estimation approaches. , 2011, Medical physics.

[37]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Paul Aljabar,et al.  Autosegmentation for thoracic radiation treatment planning: A grand challenge at AAPM 2017 , 2018, Medical physics.

[39]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[40]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[41]  Jeffrey F Williamson,et al.  Monte Carlo evaluation of scatter mitigation strategies in cone-beam CT. , 2010, Medical physics.

[42]  S Webb,et al.  An efficient Monte Carlo-based algorithm for scatter correction in keV cone-beam CT , 2009, Physics in medicine and biology.

[43]  Katia Parodi,et al.  Comparison of proton therapy treatment planning for head tumors with a pencil beam algorithm on dual and single energy CT images. , 2016, Medical physics.

[44]  Radhe Mohan,et al.  Scatter kernel estimation with an edge-spread function method for cone-beam computed tomography imaging , 2008, Physics in medicine and biology.

[45]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[46]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[47]  Marc Kachelrieß,et al.  Deep Scatter Estimation (DSE): Accurate Real-Time Scatter Estimation for X-Ray CT Using a Deep Convolutional Neural Network , 2018, Journal of Nondestructive Evaluation.

[48]  Max A. Viergever,et al.  Generative Adversarial Networks for Noise Reduction in Low-Dose CT , 2017, IEEE Transactions on Medical Imaging.

[49]  Elizabeth A. Krupinski,et al.  Artificial intelligence will soon change the landscape of medical physics research and practice. , 2018, Medical physics.

[50]  D R Dance,et al.  X-ray transmission formula for antiscatter grids. , 1983, Physics in medicine and biology.