Fundus image quality assessment: survey, challenges, and future scope

Various ocular diseases, such as cataract, diabetic retinopathy, and glaucoma have affected a large proportion of the population worldwide. In ophthalmology, fundus photography is used for the diagnosis of such retinal disorders. Nowadays, the set-up of fundus image acquisition has changed from a fixed position to portable devices, making acquisition more vulnerable to distortions. However, a trustworthy diagnosis solely relies upon the quality of the fundus image. In recent years, fundus image quality assessment (IQA) has drawn much attention from researchers. This study presents a detailed survey of the fundus IQA research. The survey covers a comprehensive discussion on the factors affecting the fundus image quality and the real-time distortions. The fundus IQA algorithms have been analysed on the basis of the methodologies used and divided into three classes, namely: (i) similarity-based, (ii) segmentation-based, and (iii) machine learning based. In addition, limitations of state of the art in this research field are also presented with the possible solutions. The objective of this study is to provide a detailed information about the fundus IQA research with its significance, present status, limitations, and future scope. To the best of the authors' knowledge, this is the first survey paper on the fundus IQA research.

[1]  A. Bovik.  A VISUAL INFORMATION FIDELITY APPROACH TO VIDEO QUALITY ASSESSMENT , 2005 .

[2]  Joni-Kristian Kämäräinen,et al.  The DIARETDB1 Diabetic Retinopathy Database and Evaluation Protocol , 2007, BMVC.

[3]  Sebastian Bosse,et al.  Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment , 2016, IEEE Transactions on Image Processing.

[4]  Xiaogang Wang,et al.  Visual Importance and Distortion Guided Deep Image Quality Assessment Framework , 2017, IEEE Transactions on Multimedia.

[5]  A.D. Hoover,et al.  Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response , 2000, IEEE Transactions on Medical Imaging.

[6]  J. Nayak,et al.  Enhancement of retinal fundus Image to highlight the features for detection of abnormal eyes , 2006, TENCON 2006 - 2006 IEEE Region 10 Conference.

[7]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[8]  C. Sinthanayothin,et al.  Automated localisation of the optic disc, fovea, and retinal blood vessels from digital colour fundus images , 1999, The British journal of ophthalmology.

[9]  Cheng Wan,et al.  Image quality classification for DR screening using deep learning , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[10]  Tubagus Maulana Kusuma,et al.  Reduced-reference metric design for objective perceptual quality assessment in wireless imaging , 2009, Signal Process. Image Commun..

[11]  D. Ruderman.  The statistics of natural images , 1994 .

[12]  Sven Loncaric,et al.  Diabetic retinopathy image database(DRiDB): A new database for diabetic retinopathy screening programs research , 2013, 2013 8th International Symposium on Image and Signal Processing and Analysis (ISPA).

[13]  Kenneth W. Tobin,et al.  Exudate-based diabetic macular edema detection in fundus images using publicly available datasets , 2012, Medical Image Anal..

[14]  Andrew Hunter,et al.  An automated retinal image quality grading algorithm , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  Tien Yin Wong,et al.  ORIGA-light: An online retinal fundus image database for glaucoma analysis and research , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[16]  Langis Gagnon,et al.  Automatic visual quality assessment in optical fundus images , 2001 .

[17]  Jongyoo Kim,et al.  Deep CNN-Based Blind Image Quality Predictor , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Gilberto Zamora,et al.  Automated image quality evaluation of retinal fundus photographs in diabetic retinopathy screening , 2012, 2012 IEEE Southwest Symposium on Image Analysis and Interpretation.

[19]  Jacques Wainer,et al.  Retinal Image Quality Analysis for Automatic Diabetic Retinopathy Detection , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[20]  Lila Iznita Izhar,et al.  Contrast Enhancement of Retinal Vasculature in Digital Fundus Image , 2009, 2009 International Conference on Digital Image Processing.

[21]  K. W. Tobin,et al.  Elliptical local vessel density: A fast and robust quality metric for retinal images , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[22]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[23]  Jorge Novo,et al.  Sirius: A web-based system for retinal image analysis , 2010, Int. J. Medical Informatics.

[24]  Chunping Hou,et al.  Effective and Efficient Blind Quality Evaluator for Contrast Distorted Images , 2019, IEEE Transactions on Instrumentation and Measurement.

[25]  Bram van Ginneken,et al.  Image structure clustering for image quality verification of color retina images in diabetic retinopathy screening , 2006, Medical Image Anal..

[26]  Zhuo Zhang,et al.  Automatic retinal interest evaluation system (ARIES) , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[28]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[29]  Carolyn G. Ford,et al.  Subjective video quality assessment methods for recognition tasks , 2009, Electronic Imaging.

[30]  Ketty Savino,et al.  A Study on Quality Assessment for Medical Ultrasound Video Compressed via HEVC , 2014, IEEE Journal of Biomedical and Health Informatics.

[31]  Qin Li,et al.  Retinopathy Online Challenge: Automatic Detection of Microaneurysms in Digital Color Fundus Photographs , 2010, IEEE Transactions on Medical Imaging.

[32]  Xiongkuo Min,et al.  Saliency-induced reduced-reference quality index for natural scene and screen content images , 2018, Signal Process..

[33]  E. Simon Barriga,et al.  Vision-based, real-time retinal image quality assessment , 2009, 2009 22nd IEEE International Symposium on Computer-Based Medical Systems.

[34]  Diana Veiga,et al.  Quality evaluation of digital fundus images through combined measures , 2014, Journal of medical imaging.

[35]  Chunping Hou,et al.  Biologically Inspired Blind Quality Assessment of Tone-Mapped Images , 2018, IEEE Transactions on Industrial Electronics.

[36]  Frans Coenen,et al.  Automated "disease/no disease" grading of age-related macular degeneration by an image mining approach. , 2012, Investigative ophthalmology & visual science.

[37]  V. Sudha,et al.  Diabetic Retinopathy Detection , 2020, International Journal of Engineering and Advanced Technology.

[38]  Titin Yulianti,et al.  Contrast measurement for no-reference retinal image quality assessment , 2014, 2014 6th International Conference on Information Technology and Electrical Engineering (ICITEE).

[39]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[40]  Zhou Wang,et al.  Reduced-reference image quality assessment using a wavelet-domain natural image statistic model , 2005, IS&T/SPIE Electronic Imaging.

[41]  David S. Doermann,et al.  Unsupervised feature learning framework for no-reference image quality assessment , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Mohammed Al-Rawi,et al.  An improved matched filter for blood vessel detection of digital retinal images , 2007, Comput. Biol. Medicine.

[43]  Umer Farooq,et al.  Improved automatic localization of optic disc in Retinal Fundus using image enhancement techniques and SVM , 2015, 2015 IEEE International Conference on Control System, Computing and Engineering (ICCSCE).

[44]  Xuelong Li,et al.  Blind Image Quality Assessment via Deep Learning , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[45]  Weisi Lin,et al.  The Analysis of Image Contrast: From Quality Assessment to Automatic Enhancement , 2016, IEEE Transactions on Cybernetics.

[46]  Patricia Ladret,et al.  The blur effect: perception and estimation with a new no-reference perceptual blur metric , 2007, Electronic Imaging.

[47]  Chunping Hou,et al.  Analysis of Structural Characteristics for Quality Assessment of Multiply Distorted Images , 2018, IEEE Transactions on Multimedia.

[48]  Ling Xu,et al.  Generic features for fundus image quality evaluation , 2016, 2016 IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom).

[49]  Jayanthi Sivaswamy,et al.  Colour Retinal Image Enhancement Based on Domain Knowledge , 2008, 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing.

[50]  Chunping Hou,et al.  Combining Local and Global Measures for DIBR-Synthesized Image Quality Evaluation , 2019, IEEE Transactions on Image Processing.

[51]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[52]  Guy Cazuguel,et al.  TeleOphta: Machine learning and image processing methods for teleophthalmology , 2013 .

[53]  Dahong Qian,et al.  Human Visual System-Based Fundus Image Quality Assessment of Portable Fundus Camera Photographs , 2016, IEEE Transactions on Medical Imaging.

[54]  Sanghoon Lee,et al.  Fully Deep Blind Image Quality Predictor , 2017, IEEE Journal of Selected Topics in Signal Processing.

[55]  Yiming Wang,et al.  Automatic retinal image quality assessment and enhancement , 1999, Medical Imaging.

[56]  Paolo Remagnino,et al.  Quantification of blood vessel calibre in retinal images of multi-ethnic school children using a model based approach , 2013, Comput. Medical Imaging Graph..

[57]  J. Olson,et al.  Automated assessment of diabetic retinal image quality based on clarity and field definition. , 2006, Investigative ophthalmology & visual science.

[58]  T. Okatani,et al.  Contrast enhancement of fundus images using regional histograms for medical diagnosis , 2004, SICE 2004 Annual Conference.

[59]  Heikki Kälviäinen,et al.  DIARETDB 0 : Evaluation Database and Methodology for Diabetic Retinopathy Algorithms , 2007 .

[60]  Aini Hussain,et al.  Methods to enhance digital fundus image for diabetic retinopathy detection , 2014, 2014 IEEE 10th International Colloquium on Signal Processing and its Applications.

[61]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[62]  Martin Kraus,et al.  Automatic no-reference quality assessment for retinal fundus images using vessel segmentation , 2013, Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems.

[63]  Wenjun Zhang,et al.  Deep learning network for blind image quality assessment , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[64]  Andrew Hunter,et al.  Tram-Line filtering for retinal vessel segmentation , 2005 .

[65]  Sebastian Bosse,et al.  A deep neural network for image quality assessment , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[66]  Weisi Lin,et al.  Fourier Transform-Based Scalable Image Quality Measure , 2012, IEEE Transactions on Image Processing.

[67]  Mei Zhou,et al.  Color Retinal Image Enhancement Based on Luminosity and Contrast Adjustment , 2018, IEEE Transactions on Biomedical Engineering.

[68]  Gajendra J. Katuwal,et al.  Automatic fundus image field detection and quality assessment , 2013, 2013 IEEE Western New York Image Processing Workshop (WNYIPW).

[69]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[70]  Dwarikanath Mahapatra,et al.  A CNN based neurobiology inspired approach for retinal image quality assessment , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[71]  Patrick P. K. Chan,et al.  Vessel enhancement of low quality fundus image using mathematical morphology and combination of Gabor and matched filter , 2016, 2016 International Conference on Wavelet Analysis and Pattern Recognition (ICWAPR).

[72]  Chunping Hou,et al.  Blind stereoscopic 3D image quality assessment via analysis of naturalness, structure, and binocular asymmetry , 2018, Signal Process..

[73]  Luís Alberto da Silva Cruz,et al.  Retinal image quality assessment using generic image quality indicators , 2014, Inf. Fusion.

[74]  Gilberto Zamora,et al.  Fast vessel segmentation in retinal images using multi-scale enhancement and second-order local entropy , 2012, Medical Imaging.

[75]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[76]  Lei Zhang,et al.  Deep Convolutional Neural Models for Picture-Quality Prediction: Challenges and Solutions to Data-Driven Image Quality Assessment , 2017, IEEE Signal Processing Magazine.

[77]  Jayanthi Sivaswamy,et al.  A Comprehensive Retinal Image Dataset for the Assessment of Glaucoma from the Optic Nerve Head Analysis , 2015 .

[78]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[79]  D. Chandler.  Seven Challenges in Image Quality Assessment: Past, Present, and Future Research , 2013 .

[80]  Joachim Hornegger,et al.  Automated quality assessment of retinal fundus photos , 2010, International Journal of Computer Assisted Radiology and Surgery.

[81]  Ljiljana Platisa,et al.  On the Subjective Assessment of the Perceived Quality of Medical Images and Videos , 2018, 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX).

[82]  Maged Habib,et al.  REVIEW - A reference data set for retinal vessel profiles , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[83]  Le Kang,et al.  A deep learning approach to document image quality assessment , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[84]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[85]  Elli Angelopoulou,et al.  Retinal vessel segmentation by improved matched filtering: evaluation on a new high-resolution fundus image database , 2013, IET Image Process..

[86]  Frédéric Zana,et al.  Segmentation of vessel-like patterns using mathematical morphology and curvature evaluation , 2001, IEEE Trans. Image Process..

[87]  Zhou Wang,et al.  Reduced-Reference Image Quality Assessment Using Divisive Normalization-Based Image Representation , 2009, IEEE Journal of Selected Topics in Signal Processing.

[88]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[89]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[90]  Min Zhang,et al.  Reduced reference image quality assessment based on statistics of edge , 2011, Electronic Imaging.

[91]  Mariano Rincón,et al.  Identification of the optic nerve head with genetic algorithms , 2008, Artif. Intell. Medicine.

[92]  Patrick Le Callet,et al.  Pseudo no reference image quality metric using perceptual data hiding , 2006, Electronic Imaging.

[93]  Xiang Zhu,et al.  Automatic Parameter Selection for Denoising Algorithms Using a No-Reference Measure of Image Content , 2010, IEEE Transactions on Image Processing.

[94]  Pamela C. Cosman,et al.  Evaluating quality of compressed medical images: SNR, subjective rating, and diagnostic accuracy , 1994, Proc. IEEE.

[95]  Weisi Lin,et al.  Perceptual Quality Assessment of Screen Content Images , 2015, IEEE Transactions on Image Processing.

[96]  Patrick Le Callet,et al.  Subjective quality assessment IRCCyN/IVC database , 2004 .

[97]  James F. Boyce,et al.  Retinal Blood Vessel Extraction by Using Multi-resolution Matched Filtering and Directional Region Growing Segmentation , 2002, MVA.

[98]  Hidayet Erdöl,et al.  Identification of suitable fundus images using automated quality assessment methods , 2014, Journal of biomedical optics.

[99]  Wenjun Zhang,et al.  A new reduced-reference image quality assessment using structural degradation model , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[100]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[101]  Francisco Fumero,et al.  RIM-ONE: An open retinal image database for optic nerve evaluation , 2011, 2011 24th International Symposium on Computer-Based Medical Systems (CBMS).

[102]  Nikolay N. Ponomarenko,et al.  METRICS PERFORMANCE COMPARISON FOR COLOR IMAGE DATABASE , 2008 .

[103]  Gangyi Jiang,et al.  Automated Quality Assessment of Fundus Images via Analysis of Illumination, Naturalness and Structure , 2018, IEEE Access.

[104]  Shahram Shirani,et al.  Subjective and Objective Quality Assessment of Image: A Survey , 2014, ArXiv.

[105]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.