Regularized Three-Dimensional Generative Adversarial Nets for Unsupervised Metal Artifact Reduction in Head and Neck CT Images

The reduction of metal artifacts in computed tomography (CT) images, specifically for strong artifacts generated from multiple metal objects, is a challenging issue in medical imaging research. Although there have been some studies on supervised metal artifact reduction through the learning of synthesized artifacts, it is difficult for simulated artifacts to cover the complexity of the real physical phenomena that may be observed in X-ray propagation. In this paper, we introduce metal artifact reduction methods based on an unsupervised volume-to-volume translation learned from clinical CT images. We construct three-dimensional adversarial nets with a regularized loss function designed for metal artifacts from multiple dental fillings. The results of experiments using a CT volume database of 361 patients demonstrate that the proposed framework has an outstanding capacity to reduce strong artifacts and to recover underlying missing voxels, while preserving the anatomical features of soft tissues and tooth structures from the original images.

[1]  Dinggang Shen,et al.  Medical Image Synthesis with Deep Convolutional Adversarial Networks , 2018, IEEE Transactions on Biomedical Engineering.

[2]  P. Suetens,et al.  Metal streak artifacts in X-ray computed tomography: a simulation study , 1998, 1998 IEEE Nuclear Science Symposium Conference Record. 1998 IEEE Nuclear Science Symposium and Medical Imaging Conference (Cat. No.98CH36255).

[3]  Francesco C Stingo,et al.  An evaluation of three commercially available metal artifact reduction methods for CT imaging , 2015, Physics in medicine and biology.

[4]  Tadaaki Kirita,et al.  Automated Planning With Multivariate Shape Descriptors for Fibular Transfer in Mandibular Reconstruction , 2017, IEEE Trans. Biomed. Eng..

[5]  Per Thunberg,et al.  Evaluation of two commercial CT metal artifact reduction algorithms for use in proton radiotherapy treatment planning in the head and neck area , 2018, Medical physics.

[6]  Hengyong Yu,et al.  Convolutional Neural Network Based Metal Artifact Reduction in X-Ray Computed Tomography , 2017, IEEE Transactions on Medical Imaging.

[7]  Tadaaki Kirita,et al.  Volumetric Fibular Transfer Planning With Shape-Based Indicators in Mandibular Reconstruction , 2015, IEEE Journal of Biomedical and Health Informatics.

[8]  Rama Chellappa,et al.  DuDoNet: Dual Domain Network for CT Metal Artifact Reduction , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Jin Keun Seo,et al.  Metal Artifact Reduction for Polychromatic X-ray CT Based on a Beam-Hardening Corrector , 2016, IEEE Transactions on Medical Imaging.

[10]  S. Y. Lee,et al.  Prior-based metal artifact reduction in CT using statistical metal segmentation on projection images , 2016, 2016 IEEE Nuclear Science Symposium, Medical Imaging Conference and Room-Temperature Semiconductor Detector Workshop (NSS/MIC/RTSD).

[11]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[12]  Eric P. Xing,et al.  SCAN: Structure Correcting Adversarial Network for Organ Segmentation in Chest X-Rays , 2017, DLMIA/ML-CDS@MICCAI.

[13]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[14]  Steve P Martin,et al.  Metallic artifact reduction by evaluation of the additional value of iterative reconstruction algorithms in hip prosthesis computed tomography imaging , 2019, Medicine.

[15]  Jongduk Baek,et al.  A metal artifact reduction algorithm in CT using multiple prior images by recursive active contour segmentation , 2017, PloS one.

[16]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[17]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[18]  Benoit M. Dawant,et al.  Validation of a metal artifact reduction method based on 3D conditional GANs for CT images of the ear , 2020, Medical Imaging: Image-Guided Procedures.

[19]  Hengyong Yu,et al.  Reduction of metal artifacts in x-ray CT images using a convolutional neural network , 2017, Optical Engineering + Applications.

[20]  Benoit M. Dawant,et al.  Conditional Generative Adversarial Networks for Metal Artifact Reduction in CT Images of the Ear , 2018, MICCAI.

[21]  Tadaaki Kirita,et al.  Statistical Analysis of Interactive Surgical Planning Using Shape Descriptors in Mandibular Reconstruction with Fibular Segments , 2016, PloS one.

[22]  S. Kida,et al.  Visual enhancement of Cone-beam CT by use of CycleGAN. , 2019, Medical physics.

[23]  Rainer Raupach,et al.  Normalized metal artifact reduction (NMAR) in computed tomography. , 2010, Medical physics.

[24]  Ming Dong,et al.  Generating synthetic CTs from magnetic resonance images using generative adversarial networks , 2018, Medical physics.

[25]  Lior Wolf,et al.  Unsupervised Cross-Domain Image Generation , 2016, ICLR.

[26]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[27]  Jong Chul Ye,et al.  Cycle‐consistent adversarial denoising network for multiphase coronary CT angiography , 2018, Medical physics.

[28]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[29]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[30]  Jing Wang,et al.  Generating synthesized computed tomography (CT) from cone-beam computed tomography (CBCT) using CycleGAN for adaptive radiation therapy , 2018, Physics in medicine and biology.

[31]  Kazuaki Sawada,et al.  Interactive visual exploration of overlapping similar structures for three-dimensional microscope images , 2014, BMC Bioinformatics.

[32]  Guang Li,et al.  CT Super-Resolution GAN Constrained by the Identical, Residual, and Cycle Learning Ensemble (GAN-CIRCLE) , 2018, IEEE Transactions on Medical Imaging.

[33]  Max A. Viergever,et al.  Generative Adversarial Networks for Noise Reduction in Low-Dose CT , 2017, IEEE Transactions on Medical Imaging.

[34]  Ge Wang,et al.  Deep learning methods to guide CT image reconstruction and reduce metal artifacts , 2017, Medical Imaging.

[35]  Hervé Delingette,et al.  Deep Learning Based Metal Artifacts Reduction in Post-operative Cochlear Implant CT Imaging , 2019, MICCAI.

[36]  Paul Babyn,et al.  Generative Adversarial Network in Medical Imaging: A Review , 2018, Medical Image Anal..

[37]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[38]  Jerry L. Prince,et al.  Model-Based Tomographic Reconstruction of Objects Containing Known Components , 2012, IEEE Transactions on Medical Imaging.

[39]  Klaus Mueller,et al.  MADR: metal artifact detection and reduction , 2016, SPIE Medical Imaging.

[40]  L. Xing,et al.  Metal artifact reduction in x-ray computed tomography (CT) by constrained optimization. , 2011, Medical physics.

[41]  Yu Zhang,et al.  Metal artifact reduction on cervical CT images by deep residual learning , 2018, BioMedical Engineering OnLine.

[42]  Xiaocheng Zhou,et al.  Sparse-Adaptive Hypergraph Discriminant Analysis for Hyperspectral Image Classification , 2020, IEEE Geoscience and Remote Sensing Letters.

[43]  Jun Wang,et al.  Metal artifact reduction in CT using fusion based prior image. , 2013, Medical physics.

[44]  Habib Zaidi,et al.  X-ray CT Metal Artifact Reduction Using Wavelet Domain $L_{0}$ Sparse Regularization , 2013, IEEE Transactions on Medical Imaging.

[45]  W. Clem Karl,et al.  Fast Enhanced CT Metal Artifact Reduction Using Data Domain Deep Learning , 2019, IEEE Transactions on Computational Imaging.

[46]  Benoit M Dawant,et al.  Metal artifact reduction for the segmentation of the intra cochlear anatomy in CT images of the ear with 3D-conditional GANs , 2019, Medical Image Anal..

[47]  Jiebo Luo,et al.  Artifact Disentanglement Network for Unsupervised Metal Artifact Reduction , 2019, MICCAI.

[48]  Jiebo Luo,et al.  ADN: Artifact Disentanglement Network for Unsupervised Metal Artifact Reduction , 2019, IEEE Transactions on Medical Imaging.

[49]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[50]  Yuxiang Xing,et al.  Reduction of metal artefacts in CT with Cycle-GAN , 2018, 2018 IEEE Nuclear Science Symposium and Medical Imaging Conference Proceedings (NSS/MIC).