Unpaired Image Denoising via Wasserstein GAN in Low-Dose CT Image with Multi-Perceptual Loss and Fidelity Loss

The use of low-dose computed tomography (LDCT) in medical practice can effectively reduce the radiation risk of patients, but it may increase noise and artefacts, which can compromise diagnostic information. The methods based on deep learning can effectively improve image quality, but most of them use a training set of aligned image pairs, which are difficult to obtain in practice. In order to solve this problem, on the basis of the Wasserstein generative adversarial network (GAN) framework, we propose a generative adversarial network combining multi-perceptual loss and fidelity loss. Multi-perceptual loss uses the high-level semantic features of the image to achieve the purpose of noise suppression by minimizing the difference between the LDCT image and the normal-dose computed tomography (NDCT) image in the feature space. In addition, L2 loss is used to calculate the loss between the generated image and the original image to constrain the difference between the denoised image and the original image, so as to ensure that the image generated by the network using the unpaired images is not distorted. Experiments show that the proposed method performs comparably to the current deep learning methods which utilize paired image for

[1]  Javad Alirezaie,et al.  Deep Learning for Low-Dose CT Denoising Using Perceptual Loss and Edge Detection Layer , 2019, Journal of Digital Imaging.

[2]  E. Sidky,et al.  Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization , 2008, Physics in medicine and biology.

[3]  Jong Chul Ye,et al.  Deep Convolutional Framelets: A General Deep Learning Framework for Inverse Problems , 2017, SIAM J. Imaging Sci..

[4]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[5]  Tang Su-xiang,et al.  Research of Tongue Image Denoising Based on Partial Differential Equation , 2012 .

[6]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[7]  Jin Keun Seo,et al.  Unpaired Image Denoising Using a Generative Adversarial Network in X-Ray CT , 2019, IEEE Access.

[8]  Zhengrong Liang,et al.  Noise properties of low-dose CT projections and noise treatment by scale transformations , 2001, 2001 IEEE Nuclear Science Symposium Conference Record (Cat. No.01CH37310).

[9]  Terry M. Peters,et al.  Image reconstruction from finite numbers of projections , 1973 .

[10]  Jing Huang,et al.  Low-dose cerebral perfusion computed tomography image restoration via low-rank and total variation regularizations , 2016, Neurocomputing.

[11]  Amy Berrington de González,et al.  Risk of cancer from diagnostic X-rays: estimates for the UK and 14 other countries , 2004, The Lancet.

[12]  Jong Chul Ye,et al.  Wavelet Domain Residual Network (WavResNet) for Low-Dose X-ray CT Reconstruction , 2017, ArXiv.

[13]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[14]  Chen Zhang,et al.  Sparse-View X-ray Computed Tomography Reconstruction via Mumford-Shah Total Variation Regularization , 2015, ICIC.

[15]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[16]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[17]  Thierry Champion,et al.  The ∞-Wasserstein Distance: Local Solutions and Existence of Optimal Transport Maps , 2008, SIAM J. Math. Anal..

[18]  Yanling Wang,et al.  Low-Dose CT Image Denoising Model Based on Sparse Representation by Stationarily Classified Sub-Dictionaries , 2019, IEEE Access.

[19]  M. Osanai,et al.  Photon starvation artifacts of X-ray CT: their true cause and a solution , 2012, Radiological Physics and Technology.

[20]  Cong Nie,et al.  Bayesian statistical reconstruction for low-dose X-ray computed tomography using an adaptive-weighting nonlocal prior , 2009, Comput. Medical Imaging Graph..

[21]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[22]  Bruce R. Whiting,et al.  Signal statistics in x-ray computed tomography , 2002, SPIE Medical Imaging.

[23]  Yan Wang,et al.  Statistical iterative reconstruction using adaptive fractional order regularization. , 2016, Biomedical optics express.

[24]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[25]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[26]  Ulla Ruotsalainen,et al.  Attenuation correction for PET using count-limited transmission images reconstructed with median root prior , 1999 .

[27]  Daniel Kolditz,et al.  Iterative reconstruction methods in X-ray CT. , 2012, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[28]  Hong Shangguan,et al.  The adaptive sinogram restoration algorithm based on anisotropic diffusion by energy minimization for low-dose X-ray CT , 2014 .

[29]  Andrea Vedaldi,et al.  Understanding deep image representations by inverting them , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  D. McCauley,et al.  Low-dose CT of the lungs: preliminary observations. , 1990, Radiology.

[31]  Zhengrong Liang,et al.  Assessment of prior image induced nonlocal means regularization for low‐dose CT reconstruction: Change in anatomy , 2017, Medical physics.

[32]  Cynthia M. McCollough,et al.  Projection space denoising with bilateral filtering and CT noise modeling for dose reduction in CT. , 2009, Medical physics.

[33]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[34]  J. Hsieh.  Adaptive streak artifact reduction in computed tomography resulting from excessive x-ray photon noise. , 1998, Medical physics.

[35]  Armando Manduca,et al.  Sinogram smoothing with bilateral filtering for low-dose CT , 2008, SPIE Medical Imaging.

[36]  Lu Cheng,et al.  Low-Dose CT Image Restoration Based on Adaptive Prior Feature Matching and Nonlocal Means , 2019, Int. J. Image Graph..

[37]  Limin Luo,et al.  Bayesian sinogram smoothing with an anisotropic diffusion weighted prior for low-dose X-ray computed tomography , 2013 .

[38]  Khan A. Wahid,et al.  Denoising Low-Dose CT Images Using Multiframe Blind Source Separation and Block Matching Filter , 2018, IEEE Transactions on Radiation and Plasma Medical Sciences.

[39]  Wangmeng Zuo,et al.  Learning Deep CNN Denoiser Prior for Image Restoration , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Bin Yan,et al.  Unpaired Low-Dose CT Denoising Network Based on Cycle-Consistent Generative Adversarial Network with Prior Image Information , 2019, Comput. Math. Methods Medicine.

[41]  Jing Wang,et al.  Penalized weighted least-squares approach to sinogram noise reduction and image reconstruction for low-dose X-ray computed tomography , 2006, IEEE Transactions on Medical Imaging.

[42]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[43]  Ke Li,et al.  Low-dose CT denoising with convolutional neural network , 2016, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[44]  Omer Demirkaya.  Reduction of noise and image artifacts in computed tomography by nonlinear filtration of projection images , 2001, SPIE Medical Imaging.