Deep Sinogram Completion With Image Prior for Metal Artifact Reduction in CT Images

Computed tomography (CT) has been widely used for medical diagnosis, assessment, and therapy planning and guidance. In reality, CT images may be affected adversely in the presence of metallic objects, which could lead to severe metal artifacts and influence clinical diagnosis or dose calculation in radiation therapy. In this article, we propose a generalizable framework for metal artifact reduction (MAR) by simultaneously leveraging the advantages of image domain and sinogram domain-based MAR techniques. We formulate our framework as a sinogram completion problem and train a neural network (SinoNet) to restore the metal-affected projections. To improve the continuity of the completed projections at the boundary of metal trace and thus alleviate new artifacts in the reconstructed CT images, we train another neural network (PriorNet) to generate a good prior image to guide sinogram learning, and further design a novel residual sinogram learning strategy to effectively utilize the prior image information for better sinogram completion. The two networks are jointly trained in an end-to-end fashion with a differentiable forward projection (FP) operation so that the prior image generation and deep sinogram completion procedures can benefit from each other. Finally, the artifact-reduced CT images are reconstructed using the filtered backward projection (FBP) from the completed sinogram. Extensive experiments on simulated and real artifacts data demonstrate that our method produces superior artifact-reduced results while preserving the anatomical structures and outperforms other MAR methods.

[1]  Jaakko Lehtinen,et al.  Noise2Noise: Learning Image Restoration without Clean Data , 2018, ICML.

[2]  Benoit M. Dawant,et al.  Conditional Generative Adversarial Networks for Metal Artifact Reduction in CT Images of the Ear , 2018, MICCAI.

[3]  Lei Xing,et al.  A binary image reconstruction technique for accurate determination of the shape and location of metal objects in x-ray computed tomography. , 2010, Journal of X-ray science and technology.

[4]  Joseph A. O'Sullivan,et al.  Iterative deblurring for CT metal artifact reduction , 1996, IEEE Trans. Medical Imaging.

[5]  Steve B. Jiang,et al.  A hybrid metal artifact reduction algorithm for x-ray CT. , 2013, Medical physics.

[6]  Rainer Raupach,et al.  Normalized metal artifact reduction (NMAR) in computed tomography. , 2010, Medical physics.

[7]  Lei Xing,et al.  Sinogram preprocessing and binary reconstruction for determination of the shape and location of metal objects in computed tomography (CT). , 2010, Medical physics.

[8]  Habib Zaidi,et al.  X-ray CT Metal Artifact Reduction Using Wavelet Domain $L_{0}$ Sparse Regularization , 2013, IEEE Transactions on Medical Imaging.

[9]  Jun Wang,et al.  Metal artifact reduction in CT using fusion based prior image. , 2013, Medical physics.

[10]  Ronald M. Summers,et al.  Deep Lesion Graphs in the Wild: Relationship Learning and Organization of Significant Radiology Image Findings in a Diverse Large-Scale Lesion Database , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[11]  Yannan Jin,et al.  Reducing Metal Streak Artifacts in CT Images via Deep Learning : Pilot Results , 2017 .

[12]  Ge Wang,et al.  Deep learning methods to guide CT image reconstruction and reduce metal artifacts , 2017, Medical Imaging.

[13]  J. Hsieh,et al.  An iterative approach to the beam hardening correction in cone beam CT. , 2000, Medical physics.

[14]  Jiebo Luo,et al.  ADN: Artifact Disentanglement Network for Unsupervised Metal Artifact Reduction , 2019, IEEE Transactions on Medical Imaging.

[15]  Thorsten M. Buzug,et al.  Spurious structures created by interpolation-based CT metal artifact reduction , 2009, Medical Imaging.

[16]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[17]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[18]  Jin Keun Seo,et al.  CT sinogram‐consistency learning for metal‐induced beam hardening correction , 2017, Medical physics.

[19]  P. Suetens,et al.  Metal streak artifacts in X-ray computed tomography: a simulation study , 1998, 1998 IEEE Nuclear Science Symposium Conference Record. 1998 IEEE Nuclear Science Symposium and Medical Imaging Conference (Cat. No.98CH36255).

[20]  W. Kalender,et al.  Reduction of CT artifacts caused by metallic implants. , 1987 .

[21]  Jin Keun Seo,et al.  Machine-learning-based nonlinear decomposition of CT images for metal artifact reduction , 2017, 1708.00244.

[22]  Ge Wang,et al.  Metal Artifact Reduction in CT: Where Are We After Four Decades? , 2016, IEEE Access.

[23]  Rama Chellappa,et al.  DuDoNet: Dual Domain Network for CT Metal Artifact Reduction , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Willi A Kalender,et al.  A novel forward projection-based metal artifact reduction method for flat-detector computed tomography , 2009, Physics in medicine and biology.

[25]  Yuxiang Xing,et al.  Metal artifact reduction for practical dental computed tomography by improving interpolation-based reconstruction with deep learning. , 2019, Medical physics.

[26]  Rainer Raupach,et al.  Empirical scatter correction (esc): A new CT scatter correction method and its application to metal artifact reduction , 2010, IEEE Nuclear Science Symposuim & Medical Imaging Conference.

[27]  Hao Chen,et al.  Volumetric ConvNets with Mixed Residual Connections for Automated Prostate Segmentation from 3D MR Images , 2017, AAAI.

[28]  Yu Zhang,et al.  Metal artifact reduction on cervical CT images by deep residual learning , 2018, BioMedical Engineering OnLine.

[29]  L. Xing,et al.  Metal artifact reduction in x-ray computed tomography (CT) by constrained optimization. , 2011, Medical physics.

[30]  Jiebo Luo,et al.  Generative Mask Pyramid Network for CT/CBCT Metal Artifact Reduction with Joint Projection-Sinogram Correction , 2019, MICCAI.

[31]  Jin Keun Seo,et al.  Metal Artifact Reduction for Polychromatic X-ray CT Based on a Beam-Hardening Corrector , 2016, IEEE Transactions on Medical Imaging.

[32]  Yaoqin Xie,et al.  A Sparse-View CT Reconstruction Method Based on Combination of DenseNet and Deconvolution , 2018, IEEE Transactions on Medical Imaging.

[33]  Wang,et al.  Iterative X-ray Cone-Beam Tomography for Metal Artifact Reduction and Local Region Reconstruction , 1999, Microscopy and Microanalysis.

[34]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Y. Lyu,et al.  Encoding Metal Mask Projection for Metal Artifact Reduction in Computed Tomography , 2020, MICCAI.

[37]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[38]  Jeffrey A. Fessler,et al.  Image Reconstruction is a New Frontier of Machine Learning , 2018, IEEE Transactions on Medical Imaging.

[39]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[40]  Francesco C Stingo,et al.  An evaluation of three commercially available metal artifact reduction methods for CT imaging , 2015, Physics in medicine and biology.

[41]  Jiebo Luo,et al.  Artifact Disentanglement Network for Unsupervised Metal Artifact Reduction , 2019, MICCAI.

[42]  Jingjing Lu,et al.  DuDoNet++: Encoding mask projection to reduce CT metal artifacts , 2020, ArXiv.

[43]  Andrea Vedaldi,et al.  Deep Image Prior , 2017, International Journal of Computer Vision.

[44]  David Faul,et al.  Suppression of Metal Artifacts in CT Using a Reconstruction Procedure That Combines MAP and Projection Completion , 2009, IEEE Transactions on Medical Imaging.

[45]  Hengyong Yu,et al.  Convolutional Neural Network Based Metal Artifact Reduction in X-Ray Computed Tomography , 2017, IEEE Transactions on Medical Imaging.

[46]  Hongming Shan,et al.  Deep Neural Network for CT Metal Artifact Reduction with a Perceptual Loss Function , 2018 .