Window-Level is a Strong Denoising Surrogate

CT image quality is heavily reliant on radiation dose, which causes a trade-off between radiation dose and image quality that affects the subsequent image-based diagnostic performance. However, high radiation can be harmful to both patients and operators. Several (deep learning-based) approaches have been attempted to denoise low dose images. However, those approaches require access to large training sets, specifically the full dose CT images for reference, which can often be difficult to obtain. Self-supervised learning is an emerging alternative for lowering the reference data requirement facilitating unsupervised learning. Currently available self-supervised CT denoising works are either dependent on foreign domain or pretexts are not very task-relevant. To tackle the aforementioned challenges, we propose a novel self-supervised learning approach, namely Self-Supervised Window-Leveling for Image DeNoising (SSWL-IDN), leveraging an innovative, task-relevant, simple, yet effective surrogate—prediction of the window-leveled equivalent. SSWL-IDN leverages residual learning and a hybrid loss combining perceptual loss and MSE, all incorporated in a VAE framework. Our extensive (inand cross-domain) experimentation demonstrates the effectiveness of SSWLIDN in aggressive denoising of CT (abdomen and chest) images acquired at 5% dose level only.

[1]  Ge Wang,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With a Hybrid Loss Function for Noise Learning , 2020, IEEE Access.

[2]  D. Brenner,et al.  Computed tomography--an increasing source of radiation exposure. , 2007, The New England journal of medicine.

[3]  Quanzheng Li,et al.  Self-Supervised Dynamic CT Perfusion Image Denoising With Deep Neural Networks , 2020, IEEE Transactions on Radiation and Plasma Medical Sciences.

[4]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[5]  Xuanqin Mou,et al.  Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss , 2017, IEEE Transactions on Medical Imaging.

[6]  Feng Lin,et al.  Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network , 2017, IEEE Transactions on Medical Imaging.

[7]  Sepehr Ataei,et al.  Cascaded Convolutional Neural Networks with Perceptual Loss for Low Dose CT Denoising , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[8]  Jian Zhou,et al.  Half2Half: deep neural network based CT image denoising without independent reference data , 2020, Physics in medicine and biology.

[9]  Manoj Kumar,et al.  A review on CT image noise and its denoising , 2018, Biomed. Signal Process. Control..

[10]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[11]  Debashish Pal,et al.  Ssiqa: Multi-Task Learning For Non-Reference Ct Image Quality Assessment With Self-Supervised Noise Level Prediction , 2021, 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI).

[12]  Virginia R. de Sa,et al.  Learning Classification with Unlabeled Data , 1993, NIPS.

[13]  Max Welling,et al.  Improved Variational Inference with Inverse Autoregressive Flow , 2016, NIPS 2016.

[14]  Paul Babyn,et al.  Sharpness-Aware Low-Dose CT Denoising Using Conditional Generative Adversarial Network , 2017, Journal of Digital Imaging.

[15]  Alexei A. Efros,et al.  The Unreasonable Effectiveness of Deep Features as a Perceptual Metric , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Deyu Meng,et al.  Variational Denoising Network: Toward Blind Noise Modeling and Removal , 2019, NeurIPS.

[18]  Jaakko Lehtinen,et al.  High-Quality Self-Supervised Deep Image Denoising , 2019, NeurIPS.

[19]  Ming-Ming Cheng,et al.  Noisy-as-Clean: Learning Self-Supervised Denoising From Corrupted Image , 2019, IEEE Transactions on Image Processing.

[20]  Florian Jug,et al.  Noise2Void - Learning Denoising From Single Noisy Images , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Xinhui Duan,et al.  Technical Note: Development and validation of an open data format for CT projection data. , 2015, Medical physics.

[22]  Yoshua Bengio,et al.  Denoising Criterion for Variational Auto-Encoding Framework , 2015, AAAI.

[23]  Anupam Ghosh,et al.  DVAE: Deep Variational Auto-Encoders for Denoising Retinal Fundus Image , 2019, Studies in Computational Intelligence.

[24]  Shuiwang Ji,et al.  Noise2Same: Optimizing A Self-Supervised Bound for Image Denoising , 2020, NeurIPS.

[25]  Mingqin Chen,et al.  Self2Self With Dropout: Learning Self-Supervised Denoising From Single Image , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[27]  M. Shiung,et al.  Development and Validation of a Practical Lower-Dose-Simulation Tool for Optimizing Computed Tomography Scan Protocols , 2012, Journal of computer assisted tomography.