Limited View Tomographic Reconstruction Using a Deep Recurrent Framework with Residual Dense Spatial-Channel Attention Network and Sinogram Consistency

Limited view tomographic reconstruction aims to reconstruct a tomographic image from a limited number of sinogram or projection views arising from sparse view or limited angle acquisitions that reduce radiation dose or shorten scanning time. However, such a reconstruction suffers from high noise and severe artifacts due to the incompleteness of sinogram. To derive quality reconstruction, previous state-of-the-art methods use UNet-like neural architectures to directly predict the full view reconstruction from limited view data; but these methods leave the deep network architecture issue largely intact and cannot guarantee the consistency between the sinogram of the reconstructed image and the acquired sinogram, leading to a non-ideal reconstruction. In this work, we propose a novel recurrent reconstruction framework that stacks the same block multiple times. The recurrent block consists of a custom-designed residual dense spatial-channel attention network. Further, we develop a sinogram consistency layer interleaved in our recurrent framework in order to ensure that the sampled sinogram is consistent with the sinogram of the intermediate outputs of the recurrent blocks. We evaluate our methods on two datasets. Our experimental results on AAPM Low Dose CT Grand Challenge datasets demonstrate that our algorithm achieves a consistent and significant improvement over the existing state-of-the-art neural methods on both limited angle reconstruction (over 5dB better in terms of PSNR) and sparse view reconstruction (about 4dB better in term of PSNR). In addition, our experimental results on Deep Lesion datasets demonstrate that our method is able to generate high-quality reconstruction for 8 major lesion types.

[1]  Michael Unser,et al.  CNN-Based Projected Gradient Descent for Consistent CT Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[2]  Jongha Lee,et al.  Deep-Neural-Network-Based Sinogram Synthesis for Sparse-View CT Image Reconstruction , 2018, IEEE Transactions on Radiation and Plasma Medical Sciences.

[3]  Lei Zhang,et al.  Low-Dose X-ray CT Reconstruction via Dictionary Learning , 2012, IEEE Transactions on Medical Imaging.

[4]  Bo Zhou,et al.  Limited Angle Tomography Reconstruction: Synthetic Reconstruction via Unsupervised Sinogram Adaptation , 2019, IPMI.

[5]  Carola-Bibiane Schönlieb,et al.  Task adapted reconstruction for inverse problems , 2018, Inverse Problems.

[6]  Jong Chul Ye,et al.  Framing U-Net via Deep Convolutional Framelets: Application to Sparse-View CT , 2017, IEEE Transactions on Medical Imaging.

[7]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[8]  S. Kevin Zhou,et al.  DuDoRNet: Learning a Dual-Domain Recurrent Network for Fast MRI Reconstruction With Deep T1 Prior , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[10]  Jing Huang,et al.  Iterative Reconstruction for X-Ray Computed Tomography Using Prior-Image Induced Nonlocal Regularization , 2014, IEEE Transactions on Biomedical Engineering.

[11]  Jonas Adler,et al.  Learned Primal-Dual Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[12]  Jeffrey A. Fessler,et al.  Image Reconstruction is a New Frontier of Machine Learning , 2018, IEEE Transactions on Medical Imaging.

[13]  Markus Haltmeier,et al.  A U-Nets Cascade for Sparse View Computed Tomography , 2018, MLMIR@MICCAI.

[14]  Andreas Maier,et al.  Data Consistent Artifact Reduction for Limited Angle Tomography with Deep Learning Prior , 2019, MLMIR@MICCAI.

[15]  Charles A. Bouman,et al.  TIMBIR: A Method for Time-Space Reconstruction From Interlaced Views , 2015, IEEE Transactions on Computational Imaging.

[16]  Daniel Rueckert,et al.  A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[17]  Yaoqin Xie,et al.  A Sparse-View CT Reconstruction Method Based on Combination of DenseNet and Deconvolution , 2018, IEEE Transactions on Medical Imaging.

[18]  Long Wei,et al.  A Joint Reconstruction and Segmentation Method for Limited-Angle X-Ray Tomography , 2018, IEEE Access.

[19]  P. Lions,et al.  Image recovery via total variation minimization and related problems , 1997 .

[20]  Nassir Navab,et al.  Recalibrating Fully Convolutional Networks With Spatial and Channel “Squeeze and Excitation” Blocks , 2018, IEEE Transactions on Medical Imaging.

[21]  Robert Schmitt,et al.  Industrial applications of computed tomography , 2014 .

[22]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[23]  Jianhua Ma,et al.  Radon inversion via deep learning , 2018, Medical Imaging.

[24]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[25]  Quanzheng Li,et al.  Iterative Low-Dose CT Reconstruction With Priors Trained by Artificial Neural Network , 2017, IEEE Transactions on Medical Imaging.

[26]  Yun Fu,et al.  Residual Dense Network for Image Restoration , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Ming Li,et al.  Low-dose CT reconstruction via L1 dictionary learning regularization using iteratively reweighted least-squares , 2016, BioMedical Engineering OnLine.

[28]  C. McCollough TU-FG-207A-04: Overview of the Low Dose CT Grand Challenge. , 2016, Medical physics.

[29]  Hyojin Kim,et al.  Lose the Views: Limited Angle CT Reconstruction via Implicit Sinogram Completion , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[30]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Rama Chellappa,et al.  DuDoNet: Dual Domain Network for CT Metal Artifact Reduction , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Jeffrey A. Fessler,et al.  Motion-compensated image reconstruction for cardiac CT with sinogram-based motion estimation , 2013, 2013 IEEE Nuclear Science Symposium and Medical Imaging Conference (2013 NSS/MIC).

[33]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[34]  Jiebo Luo,et al.  Adversarial Sparse-View CBCT Artifact Reduction , 2018, MICCAI.

[35]  Osamu Abe,et al.  Current and Novel Techniques for Metal Artifact Reduction at CT: Practical Guide for Radiologists. , 2018, Radiographics : a review publication of the Radiological Society of North America, Inc.

[36]  Le Lu,et al.  DeepLesion: automated mining of large-scale lesion annotations and universal lesion detection with deep learning , 2018, Journal of medical imaging.