Deep Learning for Low-Dose CT Denoising Using Perceptual Loss and Edge Detection Layer

Low-dose CT denoising is a challenging task that has been studied by many researchers. Some studies have used deep neural networks to improve the quality of low-dose CT images and achieved fruitful results. In this paper, we propose a deep neural network that uses dilated convolutions with different dilation rates instead of standard convolution helping to capture more contextual information in fewer layers. Also, we have employed residual learning by creating shortcut connections to transmit image information from the early layers to later ones. To further improve the performance of the network, we have introduced a non-trainable edge detection layer that extracts edges in horizontal, vertical, and diagonal directions. Finally, we demonstrate that optimizing the network by a combination of mean-square error loss and perceptual loss preserves many structural details in the CT image. This objective function does not suffer from over smoothing and blurring effects causing by per-pixel loss and grid-like artifacts resulting from perceptual loss. The experiments show that each modification to the network improves the outcome while changing the complexity of the network, minimally.

[1]  Cynthia M. McCollough,et al.  Projection space denoising with bilateral filtering and CT noise modeling for dose reduction in CT. , 2009, Medical physics.

[2]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[3]  Wangmeng Zuo,et al.  Learning Deep CNN Denoiser Prior for Image Restoration , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Kaveh Abhari,et al.  Computed Tomography image denoising utilizing an efficient sparse coding algorithm , 2012, 2012 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA).

[5]  Paul Babyn,et al.  Sharpness-Aware Low-Dose CT Denoising Using Conditional Generative Adversarial Network , 2017, Journal of Digital Imaging.

[6]  Mingxuan Sun,et al.  Dilated Deep Residual Network for Image Denoising , 2017, 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI).

[7]  Max A. Viergever,et al.  Generative Adversarial Networks for Noise Reduction in Low-Dose CT , 2017, IEEE Transactions on Medical Imaging.

[8]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[9]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[10]  Jing Wang,et al.  Penalized weighted least-squares approach to sinogram noise reduction and image reconstruction for low-dose X-ray computed tomography , 2006, IEEE Transactions on Medical Imaging.

[11]  Kyle J. Myers,et al.  A resource for the assessment of lung nodule size estimation methods: database of thoracic CT scans of an anthropomorphic phantom◊ , 2010, Optics express.

[12]  Piotr J. Slomka,et al.  Image denoising of low-radiation dose coronary CT angiography by an adaptive block-matching 3D algorithm , 2013, Medical Imaging.

[13]  David H. Kim,et al.  Abdominal CT with model-based iterative reconstruction (MBIR): initial results of a prospective trial comparing ultralow-dose with standard-dose imaging. , 2012, AJR. American journal of roentgenology.

[14]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[15]  Zhaoying Bian,et al.  A Simple Low-Dose X-Ray CT Simulation From High-Dose Scan , 2015, IEEE Transactions on Nuclear Science.

[16]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[19]  G. Lee Recent publication , 2008, Brittonia.

[20]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[21]  Soosan Beheshti,et al.  Adaptively Tuned Iterative Low Dose CT Image Denoising , 2015, Comput. Math. Methods Medicine.

[22]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[23]  Timothy P. Szczykutowicz,et al.  TU-C-103-06: A Simple Method for Simulating Reduced-Dose Images for Evaluation of Clinical CT Protocols , 2013 .

[24]  田中 利恵 Radiological Society of North America : RSNA, 北米放射線学会 , 2010 .

[25]  Armando Manduca,et al.  Methods for clinical evaluation of noise reduction techniques in abdominopelvic CT. , 2014, Radiographics : a review publication of the Radiological Society of North America, Inc.

[26]  Antonio Torralba,et al.  Generating Videos with Scene Dynamics , 2016, NIPS.

[27]  Yoshua Bengio,et al.  Generative Adversarial Networks , 2014, ArXiv.

[28]  Yu-Bin Yang,et al.  Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections , 2016, NIPS.

[29]  Mannudeep K. Kalra,et al.  Low-Dose CT with a Residual Encoder-Decoder Convolutional Neural Network (RED-CNN) , 2017, ArXiv.

[30]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[31]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[32]  Bernt Schiele,et al.  Generative Adversarial Text to Image Synthesis , 2016, ICML.

[33]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[34]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  S. Borin,et al.  Annual Meeting , 1917, Pediatric Research.

[36]  Pingkun Yan,et al.  CT Image Denoising with Perceptive Deep Neural Networks , 2017, ArXiv.

[37]  Joel G Fletcher,et al.  Validation of Dual-Source Single-Tube Reconstruction as a Method to Obtain Half-Dose Images to Evaluate Radiation Dose and Noise Reduction: Phantom and Human Assessment Using CT Colonography and Sinogram-Affirmed Iterative Reconstruction (SAFIRE) , 2012, Journal of computer assisted tomography.

[38]  Mizuho Nishio,et al.  Convolutional auto-encoder for image denoising of ultra-low-dose CT , 2017, Heliyon.

[39]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Hu Chen,et al.  Low-dose CT via convolutional neural network. , 2017, Biomedical optics express.

[41]  J. Coatrieux,et al.  Improving abdomen tumor low-dose CT images using a fast dictionary learning based processing , 2013, Physics in medicine and biology.

[42]  Christine Toumoulin,et al.  Thoracic low-dose CT image processing using an artifact suppressed large-scale nonlocal means , 2012, Physics in medicine and biology.

[43]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[44]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[45]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[46]  David Firmin,et al.  Radiation in medicine: Origins, risks and aspirations , 2014, Global cardiology science & practice.

[47]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Zhengrong Liang,et al.  An experimental study on the noise properties of x-ray CT sinogram data in Radon space , 2008, Physics in medicine and biology.

[49]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[50]  Jenny T. Bencardino Radiological Society of North America (RSNA) 2010 Annual Meeting , 2011, Skeletal Radiology.

[51]  Albert Macovski,et al.  Medical imaging systems , 1983 .

[52]  Irwin Sobel,et al.  An Isotropic 3×3 image gradient operator , 1990 .

[53]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).