A Novel Deep Learning Based OCTA De-striping Method

Noise in images presents a considerable problem, limiting their readability and hindering the performance of post-processing and analysis tools. In particular, optical coherence tomography angiography (OCTA) suffers from stripe noise. In medical imaging, clinicians rely on high quality images in order to make accurate diagnoses and plan management. Poor quality images can lead to pathology being overlooked or undiagnosed. Image denoising is a fundamental technique that can be developed to tackle this problem and improve performance in many applications, yet there exists no method focused on removing stripe noise in OCTA. Existing OCTA denoising methods do not consider the structure of stripe noise, which severely limits their potential for recovering the image. The development of artificial intelligence (AI) have enabled deep learning approaches to obtain impressive results and play a dominant role in many areas, but require a ground truth for training, which is difficult to obtain for this problem. In this paper, we propose a revised U-net framework for removing the stripe noise from OCTA images, leaving a clean image. With our proposed method, a ground truth is not required for training, allowing both the stripe noise and the clean image to be estimated, preserving more image detail without compromising image quality. The experimental results show the impressive de-striping performance of our method on OCTA images. We evaluate the effectiveness of our proposed method using the peak-signal-to-noise ratio (PSNR) and the structural similarity index measure (SSIM), achieving excellent results as well.

[1]  Yasuyuki Matsushita,et al.  A Holistic Approach to Cross-Channel Image Noise Modeling and Its Application to Image Denoising , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Peng Liu,et al.  Learning Pixel-Distribution Prior with Wider Convolution for Image Denoising , 2017, ArXiv.

[3]  R. Venkatesh Babu,et al.  Image Denoising via CNNs: An Adversarial Approach , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[4]  Sebastian Wolf,et al.  OCT-angiography: A qualitative and quantitative comparison of 4 OCT-A devices , 2017, PloS one.

[5]  Parashkev Nachev,et al.  Computer Methods and Programs in Biomedicine NiftyNet: a deep-learning platform for medical imaging , 2022 .

[6]  Tomer Michaeli,et al.  Multi-scale Weighted Nuclear Norm Image Restoration , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[7]  Sheng Zhong,et al.  Remote Sensing Image Stripe Noise Removal: From Image Decomposition Perspective , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[9]  Jan Kautz,et al.  Loss Functions for Image Restoration With Neural Networks , 2017, IEEE Transactions on Computational Imaging.

[10]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[11]  Geraint Rees,et al.  Clinically applicable deep learning for diagnosis and referral in retinal disease , 2018, Nature Medicine.

[12]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[13]  Jan Kautz,et al.  Loss Functions for Neural Networks for Image Processing , 2015, ArXiv.

[14]  Stefan Roth,et al.  Benchmarking Denoising Algorithms with Real Photographs , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[16]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[17]  Djemel Ziou,et al.  Image Quality Metrics: PSNR vs. SSIM , 2010, 2010 20th International Conference on Pattern Recognition.

[18]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[19]  T. Wong,et al.  AI for medical imaging goes deep , 2018, Nature Medicine.

[20]  Neil J. Joshi,et al.  Automated Grading of Age-Related Macular Degeneration From Color Fundus Images Using Deep Convolutional Neural Networks , 2017, JAMA ophthalmology.

[21]  Mark Pinese,et al.  Total Variation Denoising , 2014 .