An effective sinogram inpainting for complementary limited-angle dual-energy computed tomography imaging using generative adversarial networks.

Dual-energy computed tomography (DECT) provides more anatomical and functional information for image diagnosis. Presently, the popular DECT imaging systems need to scan at least full angle (i.e., 360°). In this study, we propose a DECT using complementary limited-angle scan (DECT-CL) technology to reduce the radiation dose and compress the spatial distribution of the imaging system. The dual-energy total scan is 180°, where the low- and high-energy scan range is the first 90° and last 90°, respectively. We describe this dual limited-angle problem as a complementary limited-angle problem, which is challenging to obtain high-quality images using traditional reconstruction algorithms. Furthermore, a complementary-sinogram-inpainting generative adversarial networks (CSI-GAN) with a sinogram loss is proposed to inpainting sinogram to suppress the singularity of truncated sinogram. The sinogram loss focuses on the data distribution of the generated sinogram while approaching the target sinogram. We use the simultaneous algebraic reconstruction technique namely, a total variable (SART-TV) algorithms for image reconstruction. Then, taking reconstructed CT images of pleural and cranial cavity slices as examples, we evaluate the performance of our method and numerically compare different methods based on root mean square error (RMSE), peak signal-to-noise ratio (PSNR) and structural similarity (SSIM). Compared with traditional algorithms, the proposed network shows advantages in numerical terms. Compared with Patch-GAN, the proposed network can also reduce the RMSE of the reconstruction results by an average of 40% and increase the PSNR by an average of 26%. In conclusion, both qualitative and quantitative comparison and analysis demonstrate that our proposed method achieves a good artifact suppression effect and can suitably solve the complementary limited-angle problem.

[1]  Bin Yan,et al.  A sinogram inpainting method based on generative adversarial network for limited-angle computed tomography , 2019, 15th International Meeting on Fully Three-Dimensional Image Reconstruction in Radiology and Nuclear Medicine.

[2]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[3]  Li Zhang,et al.  Metal artifacts reduction in CT images through Euler's elastica and curvature based sinogram inpainting , 2006, SPIE Medical Imaging.

[4]  Xiangyang Tang,et al.  Statistical CT noise reduction with multiscale decomposition and penalized weighted least squares in the projection domain. , 2012, Medical physics.

[5]  Hengyong Yu,et al.  Compressed sensing based interior tomography , 2009, Physics in medicine and biology.

[6]  Bin Dong,et al.  Limited tomography reconstruction via tight frame and simultaneous sinogram extrapolation , 2016 .

[7]  Mannudeep K. Kalra,et al.  Low-Dose CT with a Residual Encoder-Decoder Convolutional Neural Network (RED-CNN) , 2017, ArXiv.

[8]  Ge Wang,et al.  Spectral CT Reconstruction With Image Sparsity and Spectral Mean , 2016, IEEE Transactions on Computational Imaging.

[9]  A. Macovski,et al.  Energy-selective reconstructions in X-ray computerised tomography , 1976, Physics in medicine and biology.

[10]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[11]  M. Nikolova.  An Algorithm for Total Variation Minimization and Applications , 2004 .

[12]  T. Johnson,et al.  Dual-energy CT: general principles. , 2012, AJR. American journal of roentgenology.

[13]  Ping Tan,et al.  DualGAN: Unsupervised Dual Learning for Image-to-Image Translation , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Daniel Babot,et al.  A robust segmentation approach based on analysis of features for defect detection in X-ray images of aluminium castings , 2007 .

[15]  T Caspersson,et al.  A TV-based technique for optical analysis of chromosome regions. , 1972, Experimental cell research.

[16]  S. Osher,et al.  Multi-energy CT based on a prior rank, intensity and sparsity model (PRISM) , 2011, Inverse problems.

[17]  Isaac N. Bankman,et al.  Handbook of Medical Imaging. Processing and Analysis , 2002 .

[18]  Ge Wang,et al.  A Perspective on Deep Imaging , 2016, IEEE Access.

[19]  M. Reiser,et al.  Material differentiation by dual energy CT: initial experience , 2007, European Radiology.

[20]  Tzu-Chien Hsiao,et al.  Development of Limited-Angle Iterative Reconstruction Algorithms with Context Encoder-Based Sinogram Completion for Micro-CT Applications , 2018, Sensors.

[21]  Eric L. Miller,et al.  Tensor-Based Formulation and Nuclear Norm Regularization for Multienergy Computed Tomography , 2013, IEEE Transactions on Image Processing.

[22]  Bin Yan,et al.  Image reconstruction based on total-variation minimization and alternating direction method in linear scan computed tomography , 2013 .

[23]  Bin Yan,et al.  Image Prediction for Limited-angle Tomography via Deep Learning with Convolutional Neural Network , 2016, ArXiv.

[24]  Aykut Erdem,et al.  Image Synthesis in Multi-Contrast MRI With Conditional Generative Adversarial Networks , 2018, IEEE Transactions on Medical Imaging.

[25]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[26]  Marc Kachelriess,et al.  Automatic multi-organ segmentation in dual energy CT using 3D fully convolutional network , 2018 .

[27]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[28]  Ziheng Li,et al.  Promising Generative Adversarial Network Based Sinogram Inpainting Method for Ultra-Limited-Angle Computed Tomography Imaging , 2019, Sensors.

[29]  Jie Tang,et al.  Prior image constrained compressed sensing (PICCS): a method to accurately reconstruct dynamic CT images from highly undersampled projection data sets. , 2008, Medical physics.

[30]  Peng Zhang,et al.  Accurate Iterative FBP Reconstruction Method for Material Decomposition of Dual Energy CT , 2019, IEEE Transactions on Medical Imaging.

[31]  G. Elaiyaraja,et al.  Fast and Efficient Filter Using Wavelet Threshold for Removal of Gaussian Noise from MRI/CT Scanned Medical Images/Color Video Sequence , 2019, IETE Journal of Research.

[32]  W. D. Friedman,et al.  Review of dual-energy computed tomography techniques , 1990 .

[33]  K. Tam,et al.  Tomographical imaging with limited-angle input , 1981 .

[34]  Tamon Inouye,et al.  Image Reconstruction with Limited Angle Projection Data , 1979, IEEE Transactions on Nuclear Science.

[35]  Craig S. Levin,et al.  Robust Timing Calibration for PET Using L1-Norm Minimization , 2017, IEEE Transactions on Medical Imaging.