Statistical Iterative CBCT Reconstruction Based on Neural Network

Cone-beam computed tomography (CBCT) plays an important role in radiation therapy. Statistical iterative reconstruction (SIR) algorithms with specially designed penalty terms provide good performance for low-dose CBCT imaging. Among others, the total variation (TV) penalty is the current state-of-the-art in removing noises and preserving edges, but one of its well-known limitations is its staircase effect. Recently, various penalty terms with higher order differential operators were proposed to replace the TV penalty to avoid the staircase effect, at the cost of slightly blurring object edges. We developed a novel SIR algorithm using a neural network for CBCT reconstruction. We used a data-driven method to learn the “potential regularization term” rather than design a penalty term manually. This approach converts the problem of designing a penalty term in the traditional statistical iterative framework to designing and training a suitable neural network for CBCT reconstruction. We proposed using transfer learning to overcome the data deficiency problem and an iterative deblurring approach specially designed for the CBCT iterative reconstruction process during which the noise level and resolution of the reconstructed images may change. Through experiments conducted on two physical phantoms, two simulation digital phantoms, and patient data, we demonstrated the excellent performance of the proposed network-based SIR for CBCT reconstruction, both visually and quantitatively. Our proposed method can overcome the staircase effect, preserve both edges and regions with smooth intensity transition, and provide reconstruction results at high resolution and low noise level.

[1]  Mathews Jacob,et al.  Higher Degree Total Variation (HDTV) Regularization for Image Recovery , 2012, IEEE Transactions on Image Processing.

[2]  Gaohang Yu,et al.  Nonlocal low-rank and sparse matrix decomposition for spectral CT reconstruction , 2018, Inverse problems.

[3]  Stephen P. Boyd,et al.  Compressed sensing based cone-beam computed tomography reconstruction with a first-order method. , 2010, Medical physics.

[4]  Stamatios Lefkimmiatis,et al.  Non-local Color Image Denoising with Convolutional Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[6]  Michael Unser,et al.  Hessian Schatten-Norm Regularization for Linear Inverse Problems , 2012, IEEE Transactions on Image Processing.

[7]  Steve B. Jiang,et al.  GPU-based iterative cone-beam CT reconstruction using tight frame regularization , 2010, Physics in medicine and biology.

[8]  Jeffrey A. Fessler,et al.  Low-Rank and Adaptive Sparse Signal (LASSI) Models for Highly Accelerated Dynamic Imaging , 2016, IEEE Transactions on Medical Imaging.

[9]  Steve B. Jiang,et al.  GPU-based fast low-dose cone beam CT reconstruction via total variation. , 2010, Journal of X-Ray Science and Technology.

[10]  Bernhard Schölkopf,et al.  End-to-End Learning for Image Burst Deblurring , 2016, ACCV.

[11]  R. Weissleder,et al.  Block matching 3D random noise filtering for absorption optical projection tomography , 2010, Physics in medicine and biology.

[12]  Steve B. Jiang,et al.  GPU-based fast cone beam CT reconstruction from undersampled and noisy projection data via total variation. , 2010, Medical physics.

[13]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[14]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[15]  J. Hsieh Adaptive streak artifact reduction in computed tomography resulting from excessive x-ray photon noise. , 1998, Medical physics.

[16]  Wangmeng Zuo,et al.  Learning Deep CNN Denoiser Prior for Image Restoration , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Yi Ma,et al.  The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices , 2010, Journal of structural biology.

[18]  Jing Huang,et al.  Iterative Reconstruction for X-Ray Computed Tomography Using Prior-Image Induced Nonlocal Regularization , 2014, IEEE Transactions on Biomedical Engineering.

[19]  E. Sidky,et al.  Accurate image reconstruction from few-views and limited-angle data in divergent-beam CT , 2009, 0904.4495.

[20]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[22]  Lei Zhang,et al.  Low-Dose X-ray CT Reconstruction via Dictionary Learning , 2012, IEEE Transactions on Medical Imaging.

[23]  Jeffrey A. Fessler,et al.  3D Forward and Back-Projection for X-Ray CT Using Separable Footprints , 2010, IEEE Transactions on Medical Imaging.

[24]  Hongbing Lu,et al.  Nonlinear sinogram smoothing for low-dose X-ray CT , 2004 .

[25]  Steve B. Jiang,et al.  Cine Cone Beam CT Reconstruction Using Low-Rank Matrix Factorization: Algorithm and a Proof-of-Principle Study , 2012, IEEE Transactions on Medical Imaging.

[26]  Ge Wang,et al.  Few-view image reconstruction with dual dictionaries , 2012, Physics in medicine and biology.

[27]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[28]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[29]  Rynson W. H. Lau,et al.  Learning Fully Convolutional Networks for Iterative Non-blind Deconvolution , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Ayan Chakrabarti,et al.  A Neural Approach to Blind Motion Deblurring , 2016, ECCV.

[31]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Donald Geman,et al.  Nonlinear image recovery with half-quadratic regularization , 1995, IEEE Trans. Image Process..

[33]  Li Zhang,et al.  An improved non-local means regularized iterative reconstruction method for low-dose dental CBCT , 2012, 2012 IEEE Nuclear Science Symposium and Medical Imaging Conference Record (NSS/MIC).

[34]  Jing Wang,et al.  A Biomechanical Modeling Guided CBCT Estimation Technique , 2017, IEEE Transactions on Medical Imaging.

[35]  Qi Shi,et al.  Structure-adaptive CBCT reconstruction using weighted total variation and Hessian penalties. , 2016, Biomedical optics express.

[36]  L. Xing,et al.  Iterative image reconstruction for CBCT using edge-preserving prior. , 2008, Medical physics.

[37]  Ge Wang,et al.  A Perspective on Deep Imaging , 2016, IEEE Access.

[38]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[39]  Hu Chen,et al.  Low-dose CT via convolutional neural network. , 2017, Biomedical optics express.

[40]  E. Sidky,et al.  Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization , 2008, Physics in medicine and biology.

[41]  Narendra Ahuja,et al.  Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Yong Choi,et al.  Image reconstruction using the wavelet transform for positron emission tomography , 2001, IEEE Transactions on Medical Imaging.

[43]  B. Movsas,et al.  Dose delivered from Varian's CBCT to patients receiving IMRT for prostate cancer , 2007, Physics in medicine and biology.

[44]  Andrea Vedaldi,et al.  Instance Normalization: The Missing Ingredient for Fast Stylization , 2016, ArXiv.

[45]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[46]  Jing Wang,et al.  Iterative CBCT reconstruction using Hessian penalty , 2015, Physics in medicine and biology.

[47]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[48]  Mostafa Kaveh,et al.  Fourth-order partial differential equations for noise removal , 2000, IEEE Trans. Image Process..

[49]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[50]  Jong Chul Ye,et al.  Sparse-View Spectral CT Reconstruction Using Spectral Patch-Based Low-Rank Penalty , 2015, IEEE Transactions on Medical Imaging.

[51]  Pingkun Yan,et al.  CT Image Denoising with Perceptive Deep Neural Networks , 2017, ArXiv.

[52]  Hsuan-Ming Huang,et al.  Accelerating an Ordered-Subset Low-Dose X-Ray Cone Beam Computed Tomography Image Reconstruction with a Power Factor and Total Variation Minimization , 2016, PloS one.

[53]  Andrea Vedaldi,et al.  Deep Image Prior , 2017, International Journal of Computer Vision.

[54]  Cong Nie,et al.  Bayesian statistical reconstruction for low-dose X-ray computed tomography using an adaptive-weighting nonlocal prior , 2009, Comput. Medical Imaging Graph..

[55]  Ting-Zhu Huang,et al.  Image restoration using total variation with overlapping group sparsity , 2013, Inf. Sci..

[56]  Rebecca S Lewis,et al.  Projected cancer risks from computed tomographic scans performed in the United States in 2007. , 2009, Archives of internal medicine.

[57]  Leon A. Gatys,et al.  A Neural Algorithm of Artistic Style , 2015, ArXiv.

[58]  William Y. Song,et al.  Simultaneous deblurring and iterative reconstruction of CBCT for image guided brain radiosurgery , 2017, Physics in medicine and biology.