Fundus Image Enhancement Method Based on CycleGAN

In this paper, we propose a retinal image enhancement method, called Cycle-CBAM, which is based on CycleGAN to realize the migration from poor quality fundus images to good quality fundus images. It does not require paired training set any more, that is critical since it is quite difficult to obtain paired medical images. In order to solve the degeneration of texture and detail caused by training unpaired images, we enhance the CycleGAN by adopting the Convolutional Block Attention Module (CBAM). To verify the enhancement effect of our method, we not only analyzed the enhanced fundus image quantitatively and qualitatively, but also introduced a diabetic retinopathy (DR) classification module to evaluate the DR level of the fundus images before and after enhancement. The experiments show that our method of integrating CBAM into CycleGAN has superior performance than CycleGAN both in quantitative and qualitative results.

[1]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[2]  Jorge A Cuadros,et al.  EyePACS: An Adaptable Telemedicine System for Diabetic Retinopathy Screening , 2009, Journal of diabetes science and technology.

[3]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[4]  Hazim Kemal Ekenel,et al.  Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazing , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[5]  Huiqi Li,et al.  An enhancement method for color retinal images based on image formation model , 2017, Comput. Methods Programs Biomed..

[6]  Siva Ram Krishna Vadali,et al.  Enhancement of Diabetic Retinopathy Imagery Using Contrast Limited Adaptive Histogram Equalization , 2011 .

[7]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[8]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[9]  LiLing,et al.  Retinal Fundus Image Enhancement Using the Normalized Convolution and Noise Removing , 2016 .

[10]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[11]  Ronggang Wang,et al.  A New Image Contrast Enhancement Algorithm Using Exposure Fusion Framework , 2017, CAIP.

[12]  Jing Wu,et al.  Retinal Fundus Image Enhancement Using the Normalized Convolution and Noise Removing , 2016, Int. J. Biomed. Imaging.

[13]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Xiaoyan Sun,et al.  Structure-Revealing Low-Light Image Enhancement Via Robust Retinex Model , 2018, IEEE Transactions on Image Processing.

[15]  Jayanthi Sivaswamy,et al.  Colour Retinal Image Enhancement Based on Domain Knowledge , 2008, 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing.