DIOR: Deep Iterative Optimization-Based Residual-Learning for Limited-Angle CT Reconstruction

Limited-angle CT is a challenging problem in real applications. Incomplete projection data will lead to severe artifacts and distortions in reconstruction images. To tackle this problem, we propose a novel reconstruction framework termed Deep Iterative Optimization-based Residual-learning (DIOR) for limited-angle CT. Instead of directly deploying the regularization term on image space, the DIOR combines iterative optimization and deep learning based on the residual domain, significantly improving the convergence property and generalization ability. Specifically, the asymmetric convolutional modules are adopted to strengthen the feature extraction capacity in smooth regions for deep priors. Besides, in our DIOR method, the information contained in low-frequency and high-frequency components is also evaluated by perceptual loss to improve the performance in tissue preservation. Both simulated and clinical datasets are performed to validate the performance of DIOR. Compared with existing competitive algorithms, quantitative and qualitative results show that the proposed method brings a promising improvement in artifact removal, detail restoration and edge preservation.

[1]  J. Duncan,et al.  DuDoDR-Net: Dual-domain data consistent recurrent network for simultaneous sparse view and metal artifact reduction in computed tomography , 2021, Medical Image Anal..

[2]  James S. Duncan,et al.  Limited View Tomographic Reconstruction Using a Cascaded Residual Dense Spatial-Channel Attention Network With Projection Data Fidelity Layer , 2021, IEEE Transactions on Medical Imaging.

[3]  Weiwen Wu,et al.  Limited-Angle X-Ray CT Reconstruction Using Image Gradient ℓ₀-Norm With Dictionary Learning , 2021, IEEE Transactions on Radiation and Plasma Medical Sciences.

[4]  Juan Feng,et al.  Hybrid-Domain Neural Network Processing for Sparse-View CT Reconstruction , 2021, IEEE Transactions on Radiation and Plasma Medical Sciences.

[5]  Luc Van Gool,et al.  Plug-and-Play Image Restoration With Deep Denoiser Prior , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  W. Clem Karl,et al.  Data and Image Prior Integration for Image Reconstruction Using Consensus Equilibrium , 2020, IEEE Transactions on Computational Imaging.

[7]  Hengyong Yu,et al.  Stabilizing Deep Tomographic Reconstruction , 2020, SSRN Electronic Journal.

[8]  Bin Dong,et al.  MetaInv-Net: Meta Inversion Network for Sparse View CT Image Reconstruction , 2020, IEEE Transactions on Medical Imaging.

[9]  Zhanli Hu,et al.  Artifact removal using a hybrid-domain convolutional neural network for limited-angle computed tomography imaging , 2020, Physics in medicine and biology.

[10]  W. Clem Karl,et al.  Integrating Data and Image Domain Deep Learning for Limited Angle Tomography using Consensus Equilibrium , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[11]  Andreas Maier,et al.  Data Consistent Artifact Reduction for Limited Angle Tomography with Deep Learning Prior , 2019, MLMIR@MICCAI.

[12]  Jungong Han,et al.  ACNet: Strengthening the Kernel Skeletons for Powerful CNN via Asymmetric Convolution Blocks , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[13]  Rama Chellappa,et al.  DuDoNet: Dual Domain Network for CT Metal Artifact Reduction , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Li Zeng,et al.  ADMM-based deep reconstruction for limited-angle CT , 2019, Physics in medicine and biology.

[15]  Huazhong Shu,et al.  Domain Progressive 3D Residual Convolution Network to Improve Low-Dose CT Imaging , 2019, IEEE Transactions on Medical Imaging.

[16]  Wojciech Samek,et al.  Learning the invisible: a hybrid deep learning-shearlet framework for limited angle computed tomography , 2018, Inverse Problems.

[17]  Qian Wang,et al.  Non-Local Low-Rank Cube-Based Tensor Factorization for Spectral CT Reconstruction , 2018, IEEE Transactions on Medical Imaging.

[18]  Taeseong Kim,et al.  KIKI‐net: cross‐domain convolutional neural networks for reconstructing undersampled magnetic resonance images , 2018, Magnetic resonance in medicine.

[19]  Yaoqin Xie,et al.  A Sparse-View CT Reconstruction Method Based on Combination of DenseNet and Deconvolution , 2018, IEEE Transactions on Medical Imaging.

[20]  Yun Fu,et al.  Residual Dense Network for Image Super-Resolution , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[21]  Andreas Maier,et al.  Scale-Space Anisotropic Total Variation for Limited Angle Tomography , 2017, IEEE Transactions on Radiation and Plasma Medical Sciences.

[22]  Hyojin Kim,et al.  Lose the Views: Limited Angle CT Reconstruction via Implicit Sinogram Completion , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Quanzheng Li,et al.  Iterative Low-Dose CT Reconstruction With Priors Trained by Artificial Neural Network , 2017, IEEE Transactions on Medical Imaging.

[24]  Heye Zhang,et al.  Reweighted Anisotropic Total Variation Minimization for Limited-Angle CT Reconstruction , 2017, IEEE Transactions on Nuclear Science.

[25]  Michael Unser,et al.  CNN-Based Projected Gradient Descent for Consistent CT Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[26]  Michael A. Speidel,et al.  Radiation Dose Reduction in CT Myocardial Perfusion Imaging Using SMART-RECON , 2017, IEEE Transactions on Medical Imaging.

[27]  Jong Chul Ye,et al.  Framing U-Net via Deep Convolutional Framelets: Application to Sparse-View CT , 2017, IEEE Transactions on Medical Imaging.

[28]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[29]  Jaejun Yoo,et al.  Deep Convolutional Framelet Denosing for Low-Dose CT via Wavelet Residual Network , 2018, IEEE Transactions on Medical Imaging.

[30]  Hu Chen,et al.  LEARN: Learned Experts’ Assessment-Based Reconstruction Network for Sparse-Data CT , 2017, IEEE Transactions on Medical Imaging.

[31]  Bernard Ghanem,et al.  ISTA-Net: Interpretable Optimization-Inspired Deep Network for Image Compressive Sensing , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[32]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[33]  Chengxiang Wang,et al.  Edge-preserving reconstruction from sparse projections of limited-angle computed tomography using ℓ0-regularized gradient prior. , 2017, The Review of scientific instruments.

[34]  Jong Chul Ye,et al.  Multi-Scale Wavelet Domain Residual Learning for Limited-Angle CT Reconstruction , 2017, ArXiv.

[35]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[36]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[37]  Manuchehr Soleimani,et al.  TIGRE: a MATLAB-GPU toolbox for CBCT image reconstruction , 2016 .

[38]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[39]  Chengxiang Wang,et al.  Error bounds and stability in the $l_{0}$ regularized for CT reconstruction from small projections , 2016 .

[40]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[41]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Shuqian Luo,et al.  A Novel Iterative CT Reconstruction Approach Based on FBP Algorithm , 2015, PloS one.

[43]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[44]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[45]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[46]  Yuli Sun,et al.  Image reconstruction from few views by ℓ0-norm optimization , 2014, ArXiv.

[47]  Xin Jin,et al.  A limited-angle CT reconstruction method based on anisotropic TV minimization , 2013, Physics in medicine and biology.

[48]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[49]  Lei Zhang,et al.  Low-Dose X-ray CT Reconstruction via Dictionary Learning , 2012, IEEE Transactions on Medical Imaging.

[50]  Anders Tingberg,et al.  X-ray tomosynthesis: a review of its use for breast and chest imaging. , 2010, Radiation protection dosimetry.

[51]  E. Sidky,et al.  Accurate image reconstruction from few-views and limited-angle data in divergent-beam CT , 2009, 0904.4495.

[52]  Bruno De Man,et al.  An outlook on x-ray CT research and development. , 2008, Medical physics.

[53]  J H Siewerdsen,et al.  Image quality and localization accuracy in C-arm tomosynthesis-guided head and neck surgery. , 2007, Medical physics.

[54]  Li Zhang,et al.  Direct filtered-backprojection-type reconstruction from a straight-line trajectory , 2007 .

[55]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[56]  Qiegen Liu,et al.  CD-Net: Comprehensive Domain Network With Spectral Complementary for DECT Sparse-View Reconstruction , 2021, IEEE Transactions on Computational Imaging.

[57]  Yu Wang,et al.  Learned Full-Sampling Reconstruction From Incomplete Data , 2020, IEEE Transactions on Computational Imaging.

[58]  Limin Luo,et al.  SISTER: Spectral-Image Similarity-Based Tensor With Enhanced-Sparsity Reconstruction for Sparse-View Multi-Energy CT , 2020, IEEE Transactions on Computational Imaging.

[59]  Xiaoqiang Luo,et al.  An Image Reconstruction Method Based on Total Variation and Wavelet Tight Frame for Limited-Angle CT , 2018, IEEE Access.