Generative Mask Pyramid Network for CT/CBCT Metal Artifact Reduction with Joint Projection-Sinogram Correction

A conventional approach to computed tomography (CT) or cone beam CT (CBCT) metal artifact reduction is to replace the X-ray projection data within the metal trace with synthesized data. However, existing projection or sinogram completion methods cannot always produce anatomically consistent information to fill the metal trace, and thus, when the metallic implant is large, significant secondary artifacts are often introduced. In this work, we propose to replace metal artifact affected regions with anatomically consistent content through joint projection-sinogram correction as well as adversarial learning. To handle the metallic implants of diverse shapes and large sizes, we also propose a novel mask pyramid network that enforces the mask information across the network's encoding layers and a mask fusion loss that reduces early saturation of adversarial training. Our experimental results show that the proposed projection-sinogram correction designs are effective and our method recovers information from the metal traces better than the state-of-the-art methods.

[1]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Ge Wang,et al.  Deep learning methods to guide CT image reconstruction and reduce metal artifacts , 2017, Medical Imaging.

[3]  Rainer Raupach,et al.  Normalized metal artifact reduction (NMAR) in computed tomography. , 2010, Medical physics.

[4]  Hengyong Yu,et al.  Convolutional Neural Network Based Metal Artifact Reduction in X-Ray Computed Tomography , 2017, IEEE Transactions on Medical Imaging.

[5]  Jin Keun Seo,et al.  Machine-learning-based nonlinear decomposition of CT images for metal artifact reduction , 2017, 1708.00244.

[6]  Jin Keun Seo,et al.  CT sinogram‐consistency learning for metal‐induced beam hardening correction , 2017, Medical physics.

[7]  Jiebo Luo,et al.  Adversarial Sparse-View CBCT Artifact Reduction , 2018, MICCAI.

[8]  Alexei A. Efros,et al.  Context Encoders: Feature Learning by Inpainting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Jin Keun Seo,et al.  Sinogram-consistency learning in CT for metal artifact reduction , 2017, ArXiv.

[10]  Shiyu Xu,et al.  Deep residual learning enabled metal artifact reduction in CT , 2018, Medical Imaging.

[11]  J. Verburg,et al.  CT metal artifact reduction method correcting for beam hardening and missing projections , 2012, Physics in medicine and biology.

[12]  W. Kalender,et al.  Reduction of CT artifacts caused by metallic implants. , 1987 .

[13]  Raymond Y. K. Lau,et al.  Least Squares Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Yannan Jin,et al.  Reducing Metal Streak Artifacts in CT Images via Deep Learning : Pilot Results , 2017 .

[15]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.