Generative Modeling in Sinogram Domain for Sparse-view CT Reconstruction

The radiation dose in computed tomography (CT) examinations is harmful for patients but can be significantly reduced by intuitively decreasing the number of projection views. Reducing projection views usually leads to severe aliasing artifacts in reconstructed images. Previous deep learning (DL) techniques with sparse-view data require sparse-view/full-view CT image pairs to train the network with supervised manners. When the number of projection view changes, the DL network should be retrained with updated sparse-view/full-view CT image pairs. To relieve this limitation, we present a fully unsupervised score-based generative model in sinogram domain for sparse-view CT reconstruction. Specifically, we first train a score-based generative model on full-view sinogram data and use multi-channel strategy to form highdimensional tensor as the network input to capture their prior distribution. Then, at the inference stage, the stochastic differential equation (SDE) solver and data-consistency step were performed iteratively to achieve fullview projection. Filtered back-projection (FBP) algorithm was used to achieve the final image reconstruction. Qualitative and quantitative studies were implemented to evaluate the presented method with several CT data. Experimental results demonstrated that our method achieved comparable or better performance than the supervised learning counterparts.

[1]  Hengyong Yu,et al.  DRONE: Dual-Domain Residual-based Optimization NEtwork for Sparse-View CT Reconstruction , 2021, IEEE Transactions on Medical Imaging.

[2]  Hongwen Yang,et al.  A Lightweight Structure Aimed to Utilize Spatial Correlation for Sparse-View CT Reconstruction , 2021, ArXiv.

[3]  Juan Feng,et al.  Hybrid-Domain Neural Network Processing for Sparse-View CT Reconstruction , 2021, IEEE Transactions on Radiation and Plasma Medical Sciences.

[4]  Abhishek Kumar,et al.  Score-Based Generative Modeling through Stochastic Differential Equations , 2020, ICLR.

[5]  Zhanli Hu,et al.  Considering anatomical prior information for low-dose CT image enhancement using attribute-augmented Wasserstein generative adversarial networks , 2020, Neurocomputing.

[6]  Yang Chen,et al.  Iterative Reconstruction for Low-Dose CT Using Deep Gradient Priors of Generative Model , 2020, IEEE Transactions on Radiation and Plasma Medical Sciences.

[7]  Dong Liang,et al.  Homotopic Gradients of Generative Density Priors for MR Image Reconstruction , 2020, IEEE Transactions on Medical Imaging.

[8]  Tao Yang,et al.  Limited-Angle Computed Tomography Reconstruction using Combined FDK-Based Neural Network and U-Net , 2020, 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).

[9]  Stefano Ermon,et al.  Improved Techniques for Training Score-Based Generative Models , 2020, NeurIPS.

[10]  Zhanli Hu,et al.  Artifact removal using a hybrid-domain convolutional neural network for limited-angle computed tomography imaging , 2020, Physics in medicine and biology.

[11]  Yi Zhang,et al.  REDAEP: Robust and Enhanced Denoising Autoencoding Prior for Sparse-View CT Reconstruction , 2020, IEEE Transactions on Radiation and Plasma Medical Sciences.

[12]  Huiyan Jiang,et al.  Two stage residual CNN for texture denoising and structure enhancement on low dose CT image , 2020, Comput. Methods Programs Biomed..

[13]  Yang Song,et al.  Generative Modeling by Estimating Gradients of the Data Distribution , 2019, NeurIPS.

[14]  Uwe Kruger,et al.  Competitive performance of a modularized deep neural network compared to commercial algorithms for low-dose CT image reconstruction , 2019, Nat. Mach. Intell..

[15]  Ali Ahmed,et al.  Invertible generative models for inverse problems: mitigating representation error and dataset bias , 2019, ICML.

[16]  Dragica Radosav,et al.  Deep Learning and Medical Diagnosis: A Review of Literature , 2018, Multimodal Technol. Interact..

[17]  Mathias Unberath,et al.  Deep Learning Computed Tomography: Learning Projection-Domain Weights From Image Domain in Limited Angle Problems , 2018, IEEE Transactions on Medical Imaging.

[18]  Jin Liu,et al.  3D Feature Constrained Reconstruction for Low-Dose CT Imaging , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Jongha Lee,et al.  Deep-Neural-Network-Based Sinogram Synthesis for Sparse-View CT Image Reconstruction , 2018, IEEE Transactions on Radiation and Plasma Medical Sciences.

[20]  Jongha Lee,et al.  Sinogram synthesis using convolutional-neural-network for sparsely view-sampled CT , 2018, Medical Imaging.

[21]  Ender Konukoglu,et al.  MR Image Reconstruction Using Deep Density Priors , 2017, IEEE Transactions on Medical Imaging.

[22]  Jong Chul Ye,et al.  Framing U-Net via Deep Convolutional Framelets: Application to Sparse-View CT , 2017, IEEE Transactions on Medical Imaging.

[23]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[24]  Jiliu Zhou,et al.  Learned Experts' Assessment-based Reconstruction Network ("LEARN") for Sparse-data CT , 2017, ArXiv.

[25]  Jongha Lee,et al.  View-interpolation of sparsely sampled sinogram using convolutional neural network , 2017, Medical Imaging.

[26]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[27]  Jong Chul Ye,et al.  Deep Residual Learning for Compressed Sensing CT Reconstruction via Persistent Homology Analysis , 2016, ArXiv.

[28]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[29]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[30]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[31]  Jeffrey A. Fessler,et al.  Low dose CT image reconstruction with learned sparsifying transform , 2016, 2016 IEEE 12th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP).

[32]  Samy Bengio,et al.  Generating Sentences from a Continuous Space , 2015, CoNLL.

[33]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[34]  Rob Fergus,et al.  Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks , 2015, NIPS.

[35]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[36]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[37]  Alex Graves Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[38]  Bin Dong,et al.  X-Ray CT Image Reconstruction via Wavelet Frame Based Regularization and Radon Domain Inpainting , 2013, J. Sci. Comput..

[39]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[40]  Steve B. Jiang,et al.  Cine Cone Beam CT Reconstruction Using Low-Rank Matrix Factorization: Algorithm and a Proof-of-Principle Study , 2012, IEEE Transactions on Medical Imaging.

[41]  Pascal Vincent,et al.  A Connection Between Score Matching and Denoising Autoencoders , 2011, Neural Computation.

[42]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[43]  Cong Nie,et al.  Bayesian statistical reconstruction for low-dose X-ray computed tomography using an adaptive-weighting nonlocal prior , 2009, Comput. Medical Imaging Graph..

[44]  Hengyong Yu,et al.  Compressed sensing based interior tomography , 2009, Physics in medicine and biology.

[45]  Geoffrey E. Hinton,et al.  Deep Boltzmann Machines , 2009, AISTATS.

[46]  E. Sidky,et al.  Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization , 2008, Physics in medicine and biology.

[47]  D. Brenner,et al.  Computed tomography--an increasing source of radiation exposure. , 2007, The New England journal of medicine.

[48]  Tugba Taskaya-Temizel,et al.  2005 Special Issue: A comparative study of autoregressive neural network hybrids , 2005 .

[49]  Bjorn De Sutter,et al.  A Fast Algorithm to Calculate the Exact Radiological Path through a Pixel or Voxel Space , 1998 .

[50]  R. Siddon Fast calculation of the exact radiological path for a three-dimensional CT array. , 1985, Medical physics.

[51]  Yair Censor,et al.  Block-Iterative Algorithms with Diagonally Scaled Oblique Projections for the Linear Feasibility Problem , 2002, SIAM J. Matrix Anal. Appl..