LEARN++: Recurrent Dual-Domain Reconstruction Network for Compressed Sensing CT

Compressed sensing (CS) computed tomography has been proven to be important for several clinical applications, such as sparse-view computed tomography (CT), digital tomosynthesis and interior tomography. Traditional compressed sensing focuses on the design of handcrafted prior regularizers, which are usually image-dependent and time-consuming. Inspired by recently proposed deep learning-based CT reconstruction models, we extend the state-of-the-art LEARN model to a dual-domain version, dubbed LEARN++. Different from existing iteration unrolling methods, which only involve projection data in the data consistency layer, the proposed LEARN++ model integrates two parallel and interactive subnetworks to perform image restoration and sinogram inpainting operations on both the image and projection domains simultaneously, which can fully explore the latent relations between projection data and reconstructed images. The experimental results demonstrate that the proposed LEARN++ model achieves competitive qualitative and quantitative results compared to several state-of-the-art methods in terms of both artifact reduction and detail preservation.

[1]  Huazhong Shu,et al.  Domain Progressive 3D Residual Convolution Network to Improve Low-Dose CT Imaging , 2019, IEEE Transactions on Medical Imaging.

[2]  Bin Yan,et al.  Image Prediction for Limited-angle Tomography via Deep Learning with Convolutional Neural Network , 2016, ArXiv.

[3]  Hu Chen,et al.  Visual Attention Network for Low-Dose CT , 2018, IEEE Signal Processing Letters.

[4]  Jiliu Zhou,et al.  Few-view image reconstruction with fractional-order total variation. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[5]  Yaoqin Xie,et al.  A Sparse-View CT Reconstruction Method Based on Combination of DenseNet and Deconvolution , 2018, IEEE Transactions on Medical Imaging.

[6]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[7]  Otto Zhou,et al.  Stationary chest tomosynthesis using a CNT x-ray source array , 2013, Medical Imaging.

[8]  Ge Wang,et al.  Quest for the ultimate cardiac CT scanner , 2017, Medical physics.

[9]  R. Siddon.  Fast calculation of the exact radiological path for a three-dimensional CT array. , 1985, Medical physics.

[10]  Jong Chul Ye,et al.  Multi-Scale Wavelet Domain Residual Learning for Limited-Angle CT Reconstruction , 2017, ArXiv.

[11]  S. Osher,et al.  Multi-energy CT based on a prior rank, intensity and sparsity model (PRISM) , 2011, Inverse problems.

[12]  Yan Wang,et al.  Statistical iterative reconstruction using adaptive fractional order regularization. , 2016, Biomedical optics express.

[13]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[14]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[15]  Yann LeCun,et al.  Learning Fast Approximations of Sparse Coding , 2010, ICML.

[16]  Jaejun Yoo,et al.  Deep Convolutional Framelet Denosing for Low-Dose CT via Wavelet Residual Network , 2018, IEEE Transactions on Medical Imaging.

[17]  Steve B. Jiang,et al.  Cine Cone Beam CT Reconstruction Using Low-Rank Matrix Factorization: Algorithm and a Proof-of-Principle Study , 2012, IEEE Transactions on Medical Imaging.

[18]  Ge Wang,et al.  Few-view image reconstruction with dual dictionaries , 2012, Physics in medicine and biology.

[19]  Zhaoying Bian,et al.  Optimizing a Parameterized Plug-and-Play ADMM for Iterative Low-Dose CT Reconstruction , 2019, IEEE Transactions on Medical Imaging.

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  Jonas Adler,et al.  Learned Primal-Dual Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[22]  Jeffrey A. Fessler,et al.  Image Reconstruction is a New Frontier of Machine Learning , 2018, IEEE Transactions on Medical Imaging.

[23]  Gaohang Yu,et al.  Sparse-view x-ray CT reconstruction via total generalized variation regularization , 2014, Physics in medicine and biology.

[24]  Hee-Joung Kim,et al.  High quality imaging from sparsely sampled computed tomography data with deep learning and wavelet transform in various domains , 2018, Medical physics.

[25]  Hongming Shan,et al.  3-D Convolutional Encoder-Decoder Network for Low-Dose CT via Transfer Learning From a 2-D Trained Network , 2018, IEEE Transactions on Medical Imaging.

[26]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[27]  Hu Chen,et al.  LEARN: Learned Experts’ Assessment-Based Reconstruction Network for Sparse-Data CT , 2017, IEEE Transactions on Medical Imaging.

[28]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[30]  Yan Liu,et al.  Low-dose CT restoration via stacked sparse denoising autoencoders , 2018, Neurocomputing.

[31]  Jong Chul Ye,et al.  Framing U-Net via Deep Convolutional Framelets: Application to Sparse-View CT , 2017, IEEE Transactions on Medical Imaging.

[32]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[33]  Michael J. Black,et al.  Fields of Experts , 2009, International Journal of Computer Vision.

[34]  S. Schafer,et al.  Mobile C-arm cone-beam CT for guidance of spine surgery: Image quality, radiation dose, and integration with interventional guidance. , 2011, Medical physics.

[35]  Zhaoying Bian,et al.  Iterative quality enhancement via residual-artifact learning networks for low-dose CT , 2018, Physics in medicine and biology.

[36]  Max A. Viergever,et al.  Generative Adversarial Networks for Noise Reduction in Low-Dose CT , 2017, IEEE Transactions on Medical Imaging.

[37]  Michael Unser,et al.  CNN-Based Projected Gradient Descent for Consistent CT Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[38]  Jongha Lee,et al.  Deep-Neural-Network-Based Sinogram Synthesis for Sparse-View CT Image Reconstruction , 2018, IEEE Transactions on Radiation and Plasma Medical Sciences.

[39]  Bin Yan,et al.  A sinogram inpainting method based on generative adversarial network for limited-angle computed tomography , 2019, 15th International Meeting on Fully Three-Dimensional Image Reconstruction in Radiology and Nuclear Medicine.

[40]  Hu Chen,et al.  Low-dose CT via convolutional neural network. , 2017, Biomedical optics express.

[41]  E. Sidky,et al.  Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization , 2008, Physics in medicine and biology.

[42]  Ge Wang,et al.  Spectral CT Reconstruction With Image Sparsity and Spectral Mean , 2016, IEEE Transactions on Computational Imaging.

[43]  Jiliu Zhou,et al.  Ct Reconstruction With Pdf: Parameter-Dependent Framework For Multiple Scanning Geometries And Dose Levels , 2020, 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI).

[44]  Ge Wang,et al.  A Perspective on Deep Imaging , 2016, IEEE Access.

[45]  Dong Liang,et al.  DIMENSION: Dynamic MR imaging with both k‐space and spatial prior knowledge obtained via multi‐supervised network training , 2018, NMR in biomedicine.

[46]  Hengyong Yu,et al.  Spectral CT Reconstruction—ASSIST: Aided by Self-Similarity in Image-Spectral Tensors , 2019, IEEE Transactions on Computational Imaging.

[47]  Jian Sun,et al.  Deep ADMM-Net for Compressive Sensing MRI , 2016, NIPS.

[48]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[49]  Quanzheng Li,et al.  Iterative Low-Dose CT Reconstruction With Priors Trained by Artificial Neural Network , 2017, IEEE Transactions on Medical Imaging.

[50]  Xuanqin Mou,et al.  Machine Learning for Tomographic Imaging , 2020 .

[51]  Juan Feng,et al.  Hybrid-Domain Neural Network Processing for Sparse-View CT Reconstruction , 2021, IEEE Transactions on Radiation and Plasma Medical Sciences.