DuDoNet: Dual Domain Network for CT Metal Artifact Reduction

Computed tomography (CT) is an imaging modality widely used for medical diagnosis and treatment. CT images are often corrupted by undesirable artifacts when metallic implants are carried by patients, which creates the problem of metal artifact reduction (MAR). Existing methods for reducing the artifacts due to metallic implants are inadequate for two main reasons. First, metal artifacts are structured and non-local so that simple image domain enhancement approaches would not suffice. Second, the MAR approaches which attempt to reduce metal artifacts in the X-ray projection (sinogram) domain inevitably lead to severe secondary artifact due to sinogram inconsistency. To overcome these difficulties, we propose an end-to-end trainable Dual Domain Network (DuDoNet) to simultaneously restore sinogram consistency and enhance CT images. The linkage between the sigogram and image domains is a novel Radon inversion layer that allows the gradients to back-propagate from the image domain to the sinogram domain during training. Extensive experiments show that our method achieves significant improvements over other single domain MAR approaches. To the best of our knowledge, it is the first end-to-end dual-domain network for MAR.

[1]  Yu Qiao,et al.  ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks , 2018, ECCV Workshops.

[2]  Hongyang Chao,et al.  Building Dual-Domain Representations for Compression Artifacts Reduction , 2016, ECCV.

[3]  Rainer Raupach,et al.  Normalized metal artifact reduction (NMAR) in computed tomography. , 2010, Medical physics.

[4]  Yannan Jin,et al.  Reducing Metal Streak Artifacts in CT Images via Deep Learning : Pilot Results , 2017 .

[5]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[6]  Beer Bestimmung der Absorption des rothen Lichts in farbigen Flüssigkeiten , 1852 .

[7]  Ronald M. Summers,et al.  Deep Lesion Graphs in the Wild: Relationship Learning and Organization of Significant Radiology Image Findings in a Diverse Large-Scale Lesion Database , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[8]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[9]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[10]  Shiyu Xu,et al.  Deep residual learning enabled metal artifact reduction in CT , 2018, Medical Imaging.

[11]  Wenhan Yang,et al.  Dmcnn: Dual-Domain Multi-Scale Convolutional Neural Network for Compression Artifacts Removal , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[12]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[13]  Avinash C. Kak,et al.  Principles of computerized tomographic imaging , 2001, Classics in applied mathematics.

[14]  Jin Keun Seo,et al.  Sinogram-consistency learning in CT for metal artifact reduction , 2017, ArXiv.

[15]  Ming-Hsuan Yang,et al.  Learning to Deblur Images with Exemplars , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Benoit M. Dawant,et al.  Conditional Generative Adversarial Networks for Metal Artifact Reduction in CT Images of the Ear , 2018, MICCAI.

[17]  Vishal M. Patel,et al.  Densely Connected Pyramid Dehazing Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[18]  Jaakko Lehtinen,et al.  Noise2Noise: Learning Image Restoration without Clean Data , 2018, ICML.

[19]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[20]  Chao Zhang,et al.  Joint Sub-bands Learning with Clique Structures for Wavelet Domain Super-Resolution , 2018, NeurIPS.

[21]  Yaoqin Xie,et al.  A Sparse-View CT Reconstruction Method Based on Combination of DenseNet and Deconvolution , 2018, IEEE Transactions on Medical Imaging.

[22]  Alessandro Foi,et al.  Optimal Inversion of the Anscombe Transformation in Low-Count Poisson Image Denoising , 2011, IEEE Transactions on Image Processing.

[23]  Habib Zaidi,et al.  X-ray CT Metal Artifact Reduction Using Wavelet Domain $L_{0}$ Sparse Regularization , 2013, IEEE Transactions on Medical Imaging.

[24]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Bin Dong,et al.  A Reweighted Joint Spatial-Radon Domain CT Image Reconstruction Model for Metal Artifact Reduction , 2017, SIAM J. Imaging Sci..

[26]  Bin Yan,et al.  Iterative metal artifact reduction for x-ray computed tomography using unmatched projector/backprojector pairs. , 2016, Medical physics.

[27]  Li Zhang,et al.  Metal artifact reduction in CT images by sinogram TV inpainting , 2008, 2008 IEEE Nuclear Science Symposium Conference Record.

[28]  Hengyong Yu,et al.  Convolutional Neural Network Based Metal Artifact Reduction in X-Ray Computed Tomography , 2017, IEEE Transactions on Medical Imaging.

[29]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Ge Wang,et al.  Deep learning methods to guide CT image reconstruction and reduce metal artifacts , 2017, Medical Imaging.

[31]  Andreas K. Maier,et al.  Deep Learning Computed Tomography , 2016, MICCAI.

[32]  Andrea Vedaldi,et al.  Deep Image Prior , 2017, International Journal of Computer Vision.

[33]  Yun Fu,et al.  Residual Dense Network for Image Super-Resolution , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[34]  W. Kalender,et al.  Reduction of CT artifacts caused by metallic implants. , 1987 .

[35]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[36]  Jonas Adler,et al.  Learned Primal-Dual Reconstruction , 2017, IEEE Transactions on Medical Imaging.