DAN-Net: Dual-domain adaptive-scaling non-local network for CT metal artifact reduction

Metallic implants can heavily attenuate x-rays in computed tomography (CT) scans, leading to severe artifacts in reconstructed images, which significantly jeopardize image quality and negatively impact subsequent diagnoses and treatment planning. With the rapid development of deep learning in the field of medical imaging, several network models have been proposed for metal artifact reduction (MAR) in CT. Despite the encouraging results achieved by these methods, there is still much room to further improve performance. In this paper, a novel dual-domain adaptive-scaling non-local network (DAN-Net) is proposed for MAR. We correct the corrupted sinogram using adaptive scaling first to preserve more tissue and bone details. Then, an end-to-end dual-domain network is adopted to successively process the sinogram and its corresponding reconstructed image is generated by the analytical reconstruction layer. In addition, to better suppress the existing artifacts and restrain the potential secondary artifacts caused by inaccurate results of the sinogram-domain network, a novel residual sinogram learning strategy and non-local module are leveraged in the proposed network model. Experiments demonstrate the performance of the proposed DAN-Net is competitive with several state-of-the-art MAR methods in both qualitative and quantitative aspects.

[1]  Yin Hai,et al.  Low-dose computed tomography reconstruction regularized by structural group sparsity joined with gradient prior , 2021, Signal Process..

[2]  Lequan Yu,et al.  Deep Sinogram Completion With Image Prior for Metal Artifact Reduction in CT Images , 2020, IEEE Transactions on Medical Imaging.

[3]  Wei Chen,et al.  Deep Learning Methods for Solving Linear Inverse Problems: Research Directions and Paradigms , 2020, Signal Process..

[4]  Ming Li,et al.  An Irregular Metal Trace Inpainting Network for X-ray CT Metal Artifact Reduction. , 2020, Medical physics.

[5]  Jiaotong Wei,et al.  Spectral CT imaging method based on blind separation of polychromatic projections with Poisson prior. , 2020, Optics express.

[6]  Y. Lyu,et al.  Encoding Metal Mask Projection for Metal Artifact Reduction in Computed Tomography , 2020, MICCAI.

[7]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[8]  Li Zeng,et al.  Adaptive iterative reconstruction based on relative total variation for low-intensity computed tomography , 2019, Signal Process..

[9]  Bruno De Man,et al.  A dual-stream deep convolutional network for reducing metal streak artifacts in CT images , 2019, Physics in medicine and biology.

[10]  M. Belyaev,et al.  Multidomain CT Metal Artifacts Reduction Using Partial Convolution Based Inpainting , 2019, 2020 International Joint Conference on Neural Networks (IJCNN).

[11]  Jiebo Luo,et al.  Generative Mask Pyramid Network for CT/CBCT Metal Artifact Reduction with Joint Projection-Sinogram Correction , 2019, MICCAI.

[12]  Jiebo Luo,et al.  ADN: Artifact Disentanglement Network for Unsupervised Metal Artifact Reduction , 2019, IEEE Transactions on Medical Imaging.

[13]  Rama Chellappa,et al.  DuDoNet: Dual Domain Network for CT Metal Artifact Reduction , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Jiliu Zhou,et al.  Simultaneous denoising and super-resolution of optical coherence tomography images based on generative adversarial network. , 2019, Optics express.

[15]  Xu Ma,et al.  Compressive spectral X-ray tomography based on spatial and spectral coded illumination. , 2019, Optics express.

[16]  W. Clem Karl,et al.  Fast Enhanced CT Metal Artifact Reduction Using Data Domain Deep Learning , 2019, IEEE Transactions on Computational Imaging.

[17]  Chulhee Han,et al.  Multi-pass approach to reduce cone-beam artifacts in a circular orbit cone-beam CT system. , 2019, Optics express.

[18]  Fei Wang,et al.  Deep learning for healthcare: review, opportunities and challenges , 2018, Briefings Bioinform..

[19]  Jeffrey A. Fessler,et al.  Image Reconstruction is a New Frontier of Machine Learning , 2018, IEEE Transactions on Medical Imaging.

[20]  W. Clem Karl,et al.  Deep Learning Based Sinogram Correction for Metal Artifact Reduction , 2018, Computational Imaging.

[21]  Ronald M. Summers,et al.  Deep Lesion Graphs in the Wild: Relationship Learning and Organization of Significant Radiology Image Findings in a Diverse Large-Scale Lesion Database , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[22]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Hengyong Yu,et al.  Convolutional Neural Network Based Metal Artifact Reduction in X-Ray Computed Tomography , 2017, IEEE Transactions on Medical Imaging.

[24]  Jin Keun Seo,et al.  CT sinogram‐consistency learning for metal‐induced beam hardening correction , 2017, Medical physics.

[25]  Bin Dong,et al.  A Reweighted Joint Spatial-Radon Domain CT Image Reconstruction Model for Metal Artifact Reduction , 2017, SIAM J. Imaging Sci..

[26]  J. C. Ye,et al.  Deep Convolutional Framelets: A General Deep Learning Framework for Inverse Problems , 2017, SIAM J. Imaging Sci..

[27]  Hu Chen,et al.  Low-dose CT via convolutional neural network. , 2017, Biomedical optics express.

[28]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[29]  Ge Wang,et al.  Metal Artifact Reduction in CT: Where Are We After Four Decades? , 2016, IEEE Access.

[30]  Michael S. Lew,et al.  Deep learning for visual understanding: A review , 2016, Neurocomputing.

[31]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[33]  Trevor Darrell,et al.  Fully convolutional networks for semantic segmentation , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  C. Belka,et al.  Post-processing sets of tilted CT volumes as a method for metal artifact reduction , 2014, Radiation oncology.

[35]  Habib Zaidi,et al.  3D Prior Image Constrained Projection Completion for X-ray CT Metal Artifact Reduction , 2013, IEEE Transactions on Nuclear Science.

[36]  Jun Wang,et al.  Metal artifact reduction in CT using fusion based prior image. , 2013, Medical physics.

[37]  Habib Zaidi,et al.  X-ray CT Metal Artifact Reduction Using Wavelet Domain $L_{0}$ Sparse Regularization , 2013, IEEE Transactions on Medical Imaging.

[38]  Johan Nuyts,et al.  Metal artifact reduction in computed tomography using local models in an image block-iterative scheme. , 2012, Medical physics.

[39]  Rainer Raupach,et al.  Normalized metal artifact reduction (NMAR) in computed tomography. , 2010, Medical physics.

[40]  Zhiqiang Chen,et al.  Metal artifact reduction in dual energy CT by sinogram segmentation based on active contour model and TV inpainting , 2009, 2009 IEEE Nuclear Science Symposium Conference Record (NSS/MIC).

[41]  Jong Beom Ra,et al.  Metal artifact reduction based on sinogram correction in CT , 2009, 2009 IEEE Nuclear Science Symposium Conference Record (NSS/MIC).

[42]  M. Yazdi,et al.  A novel approach for reducing metal artifacts due to metallic dental implants , 2006, 2006 IEEE Nuclear Science Symposium Conference Record.

[43]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[44]  W. Kalender,et al.  A pragmatic approach to metal artifact reduction in CT: merging of metal artifact reduced images , 2004, European Radiology.

[45]  Laigao Michael Chen,et al.  Novel method for reducing high-attenuation object artifacts in CT reconstructions , 2002, SPIE Medical Imaging.

[46]  W. Kalender,et al.  Generalized multi-dimensional adaptive filtering for conventional and spiral single-slice, multi-slice, and cone-beam CT. , 2001, Medical physics.

[47]  M W Vannier,et al.  Fast iterative algorithm for metal artifact reduction in X-ray CT. , 2000, Academic radiology.

[48]  P. Suetens,et al.  Reduction of metal streak artifacts in X-ray computed tomography using a transmission maximum a posteriori algorithm , 1999, 1999 IEEE Nuclear Science Symposium. Conference Record. 1999 Nuclear Science Symposium and Medical Imaging Conference (Cat. No.99CH37019).

[49]  Xiaochuan Pan,et al.  Optimal noise control in and fast reconstruction of fan-beam computed tomography image. , 1999, Medical physics.

[50]  Wang,et al.  Iterative X-ray Cone-Beam Tomography for Metal Artifact Reduction and Local Region Reconstruction , 1999, Microscopy and Microanalysis.

[51]  Hamid Soltanian-Zadeh,et al.  CT artifact correction: an image-processing approach , 1996, Medical Imaging.

[52]  W. Kalender,et al.  Reduction of CT artifacts caused by metallic implants. , 1987 .

[53]  J. Göthlin,et al.  Basic Principles of Computed Tomography , 1984 .

[54]  Ming Li,et al.  GPU-Accelerated Dynamic Wavelet Thresholding Algorithm for X-Ray CT Metal Artifact Reduction , 2018, IEEE Transactions on Radiation and Plasma Medical Sciences.

[55]  Ming Li,et al.  A prior-based metal artifact reduction algorithm for x-ray CT. , 2015, Journal of X-ray science and technology.

[56]  J. Nuyts,et al.  An experimental survey of metal artefact reduction in computed tomography. , 2013, Journal of X-ray science and technology.

[57]  Yi-Fei Pu,et al.  A new CT metal artifacts reduction algorithm based on fractional-order sinogram inpainting. , 2011, Journal of X-ray science and technology.

[58]  Qiong Xu,et al.  Application of projection simulation based on physical imaging model to the evaluation of beam hardening corrections in X-ray transmission tomography , 2008 .

[59]  Li Zhang,et al.  Metal artifact reduction in CT images by sinogram TV inpainting , 2008, 2008 IEEE Nuclear Science Symposium Conference Record.

[60]  Xing Yuxiang Comparison among general interpolation methods for metal artifacts reduction in CT images , 2006 .

[61]  Yuxiang Xing,et al.  A method based on interpolation for metal artifacts reduction in CT images , 2006 .

[62]  Shiying Zhao,et al.  A wavelet method for metal artifact reduction with multiple metallic objects in the field of view , 2002 .

[63]  Lin Zhou Reduction of Metal Artifact in X ray CT by Quartic Polynomial Interpolation , 2001 .

[64]  Joseph A. O'Sullivan,et al.  Iterative deblurring for CT metal artifact reduction , 1996, IEEE Trans. Medical Imaging.