Unpaired Low-Dose CT Denoising Network Based on Cycle-Consistent Generative Adversarial Network with Prior Image Information

The widespread application of X-ray computed tomography (CT) in clinical diagnosis has led to increasing public concern regarding excessive radiation dose administered to patients. However, reducing the radiation dose will inevitably cause server noise and affect radiologists' judgment and confidence. Hence, progressive low-dose CT (LDCT) image reconstruction methods must be developed to improve image quality. Over the past two years, deep learning-based approaches have shown impressive performance in noise reduction for LDCT images. Most existing deep learning-based approaches usually require the paired training dataset which the LDCT images correspond to the normal-dose CT (NDCT) images one-to-one, but the acquisition of well-paired datasets requires multiple scans, resulting the increase of radiation dose. Therefore, well-paired datasets are not readily available. To resolve this problem, this paper proposes an unpaired LDCT image denoising network based on cycle generative adversarial networks (CycleGAN) with prior image information which does not require a one-to-one training dataset. In this method, cyclic loss, an important trick in unpaired image-to-image translation, promises to map the distribution from LDCT to NDCT by using unpaired training data. Furthermore, to guarantee the accurate correspondence of the image content between the output and NDCT, the prior information obtained from the result preprocessed using the LDCT image is integrated into the network to supervise the generation of content. Given the map of distribution through the cyclic loss and the supervision of content through the prior image loss, our proposed method can not only reduce the image noise but also retain critical information. Real-data experiments were carried out to test the performance of the proposed method. The peak signal-to-noise ratio (PSNR) improves by more than 3 dB, and the structural similarity (SSIM) increases when compared with the original CycleGAN without prior information. The real LDCT data experiment demonstrates the superiority of the proposed method according to both visual inspection and quantitative evaluation.

[1]  Jeffrey A. Fessler,et al.  Statistical image reconstruction for polyenergetic X-ray computed tomography , 2002, IEEE Transactions on Medical Imaging.

[2]  Bin Dong,et al.  Limited tomography reconstruction via tight frame and simultaneous sinogram extrapolation , 2016 .

[3]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  L. Tanoue Computed Tomography — An Increasing Source of Radiation Exposure , 2009 .

[5]  Paul Babyn,et al.  Sharpness-Aware Low-Dose CT Denoising Using Conditional Generative Adversarial Network , 2017, Journal of Digital Imaging.

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  L. Xing,et al.  Iterative image reconstruction for CBCT using edge-preserving prior. , 2008, Medical physics.

[8]  Christine Toumoulin,et al.  Thoracic low-dose CT image processing using an artifact suppressed large-scale nonlocal means , 2012, Physics in medicine and biology.

[9]  Quanzheng Li,et al.  Iterative Low-Dose CT Reconstruction With Priors Trained by Artificial Neural Network , 2017, IEEE Transactions on Medical Imaging.

[10]  Armando Manduca,et al.  Adaptive nonlocal means filtering based on local noise level for CT denoising. , 2013, Medical physics.

[11]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[12]  Zhen Wang,et al.  Multi-class Generative Adversarial Networks with the L2 Loss Function , 2016, ArXiv.

[13]  R. Weissleder,et al.  Block matching 3D random noise filtering for absorption optical projection tomography , 2010, Physics in medicine and biology.

[14]  Jing Wang,et al.  Penalized weighted least-squares approach to sinogram noise reduction and image reconstruction for low-dose X-ray computed tomography , 2006, IEEE Transactions on Medical Imaging.

[15]  Lei Zhang,et al.  Low-Dose X-ray CT Reconstruction via Dictionary Learning , 2012, IEEE Transactions on Medical Imaging.

[16]  Ian J. Goodfellow,et al.  NIPS 2016 Tutorial: Generative Adversarial Networks , 2016, ArXiv.

[17]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[18]  Piotr J. Slomka,et al.  Image denoising of low-radiation dose coronary CT angiography by an adaptive block-matching 3D algorithm , 2013, Medical Imaging.

[19]  Won-Ki Jeong,et al.  Compressed Sensing MRI Reconstruction Using a Generative Adversarial Network With a Cyclic Loss , 2017, IEEE Transactions on Medical Imaging.

[20]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[21]  J. O’Sullivan,et al.  Properties of preprocessed sinogram data in x-ray computed tomography. , 2006, Medical physics.

[22]  Zhengrong Liang,et al.  Robust Low-Dose CT Sinogram Preprocessing via Exploiting Noise-Generating Mechanism , 2017, IEEE Transactions on Medical Imaging.

[23]  Rainer Raupach,et al.  Wavelet Based Noise Reduction in CT-Images Using Correlation Analysis , 2008, IEEE Transactions on Medical Imaging.

[24]  Max A. Viergever,et al.  Generative Adversarial Networks for Noise Reduction in Low-Dose CT , 2017, IEEE Transactions on Medical Imaging.

[25]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[26]  Yuanke Zhang,et al.  Statistical Sinogram Smoothing for Low-Dose CT With Segmentation-Based Adaptive Filtering , 2010, IEEE Transactions on Nuclear Science.

[27]  B. De Man,et al.  Distance-driven projection and backprojection in three dimensions. , 2004, Physics in medicine and biology.

[28]  Ping Tan,et al.  DualGAN: Unsupervised Dual Learning for Image-to-Image Translation , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[29]  Steve B. Jiang,et al.  Low-dose CT reconstruction via edge-preserving total variation regularization. , 2010, Physics in medicine and biology.

[30]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[31]  Xuenan Cui,et al.  Deep CT to MR Synthesis Using Paired and Unpaired Data , 2018, Sensors.

[32]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Lei Xing,et al.  SU‐FF‐I‐44: Iterative Image Reconstruction for CBCT Using Edge‐Preserving Prior , 2009 .

[34]  Jeffrey A. Fessler,et al.  A Splitting-Based Iterative Algorithm for Accelerated Statistical X-Ray CT Reconstruction , 2012, IEEE Transactions on Medical Imaging.

[35]  Zhengrong Liang,et al.  Adaptive-weighted total variation minimization for sparse data toward low-dose x-ray computed tomography image reconstruction , 2012, Physics in medicine and biology.

[36]  Jing Wang,et al.  Penalized weighted least-squares approach for low-dose x-ray computed tomography , 2006, SPIE Medical Imaging.

[37]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[38]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[39]  Xuanqin Mou,et al.  Tensor-Based Dictionary Learning for Spectral CT Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[40]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[41]  Patrick J. La Rivière,et al.  Penalized-likelihood sinogram restoration for computed tomography , 2006, IEEE Transactions on Medical Imaging.

[42]  O. Linton,et al.  National conference on dose reduction in CT, with an emphasis on pediatric patients. , 2003, AJR. American journal of roentgenology.

[43]  Jelmer M. Wolterink,et al.  Deep MR to CT Synthesis Using Unpaired Data , 2017, SASHIMI@MICCAI.

[44]  R M Lewitt,et al.  Multidimensional digital image representations using generalized Kaiser-Bessel window functions. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[45]  Bram van Ginneken,et al.  Local noise weighted filtering for emphysema scoring of low-dose CT images , 2006, IEEE Transactions on Medical Imaging.

[46]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[47]  David J Brenner,et al.  Cancer risks from CT scans: now we have data, what next? , 2012, Radiology.

[48]  Hu Chen,et al.  Low-dose CT via convolutional neural network. , 2017, Biomedical optics express.

[49]  E. Sidky,et al.  Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization , 2008, Physics in medicine and biology.