Automatic fundus image quality assessment on a continuous scale

Fundus photography is commonly used for screening, diagnosis, and monitoring of various diseases affecting the eye. In addition, it has shown promise in the diagnosis of brain diseases and evaluation of cardiovascular risk factors. Good image quality is important if diagnosis is to be accurate and timely. Here, we propose a method that automatically grades image quality on a continuous scale which is more flexible than binary quality classification. The method utilizes random forest regression models trained on image features discovered automatically by combining basic image filters using simulated annealing as well as features extracted with the discrete Fourier transform. The method was developed and tested on images from two different fundus camera models. The quality of those images was rated on a continuous scale from 0.0 to 1.0 by five experts. In addition, the method was tested on DRIMDB, a publicly available dataset with binary quality ratings. On the DRIMDB dataset the method achieves an accuracy of 0.981, sensitivity of 0.993 and specificity of 0.958 which is consistent with the state of the art. When evaluating image quality on a continuous scale the method outperforms human raters.

[1]  J. Olson,et al.  Automated assessment of diabetic retinal image quality based on clarity and field definition. , 2006, Investigative ophthalmology & visual science.

[3]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[4]  Anil Kumar Tiwari,et al.  Fundus image quality assessment: survey, challenges, and future scope , 2019, IET Image Process..

[5]  Thomas Lengauer,et al.  ROCR: visualizing classifier performance in R , 2005, Bioinform..

[6]  David W Wright,et al.  Quality of nonmydriatic digital fundus photography obtained by nurse practitioners in the emergency department: the FOTO-ED study. , 2012, Ophthalmology.

[7]  Douglas G. Altman,et al.  Measurement in Medicine: The Analysis of Method Comparison Studies , 1983 .

[8]  Luis A. da Silva Cruz,et al.  Evaluation of Retinal Image Gradability by Image Features Classification , 2012 .

[9]  M. Abràmoff,et al.  Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices , 2018, npj Digital Medicine.

[10]  Yiming Wang,et al.  Automatic retinal image quality assessment and enhancement , 1999, Medical Imaging.

[11]  James Beach,et al.  Pathway to Retinal Oximetry. , 2014, Translational vision science & technology.

[12]  Gavin S. W. Tan,et al.  Advances in Retinal Imaging and Applications in Diabetic Retinopathy Screening: A Review , 2018, Ophthalmology and Therapy.

[13]  Automatic fundus image field detection and quality assessment , 2013, 2013 IEEE Western New York Image Processing Workshop (WNYIPW).

[14]  Swati Upadhyaya,et al.  Predictors of Photographic Quality with a Handheld Nonmydriatic Fundus Camera Used for Screening of Vision-Threatening Diabetic Retinopathy , 2017, Ophthalmologica.

[15]  C J Heaven,et al.  The quality of photographs produced by the non-mydriatic fundus camera in a screening programme for diabetic retinopathy: A 1 year prospective study , 1993, Eye.

[16]  J. Grauslund,et al.  Clinical motivation and the needs for RIA in healthcare , 2019, Computational Retinal Image Analysis.

[17]  Martin Kraus,et al.  Automatic no-reference quality assessment for retinal fundus images using vessel segmentation , 2013, Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems.

[18]  R. A. Karlsson,et al.  Retinal oximetry: Metabolic imaging for diseases of the retina and brain , 2019, Progress in Retinal and Eye Research.

[19]  R. Klein,et al.  Retinal vascular tortuosity, blood pressure, and cardiovascular risk factors. , 2011, Ophthalmology.

[20]  D. Altman,et al.  Measuring agreement in method comparison studies , 1999, Statistical methods in medical research.

[21]  Mathieu Lamard,et al.  Suitability of a Low-Cost, Handheld, Nonmydriatic Retinograph for Diabetic Retinopathy Diagnosis , 2016, Translational vision science & technology.

[22]  Dwarikanath Mahapatra,et al.  Retinal Image Quality Classification Using Saliency Maps and CNNs , 2016, MLMI@MICCAI.

[23]  E Peli,et al.  Restoration of retinal images obtained through cataracts. , 1989, IEEE transactions on medical imaging.

[24]  Renoh Johnson Chalakkal,et al.  Quality and content analysis of fundus images using deep learning , 2019, Comput. Biol. Medicine.

[25]  Christine T. O. Nguyen,et al.  Non-invasive in vivo hyperspectral imaging of the retina for potential biomarker use in Alzheimer’s disease , 2019, Nature Communications.

[26]  Peter Wanger,et al.  Automated quality evaluation of digital fundus photographs , 2009, Acta ophthalmologica.

[27]  F. Habibzadeh,et al.  On determining the most appropriate test cut-off value: the case of tests with continuous results , 2016, Biochemia medica.

[28]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[29]  Robert E. Coffee,et al.  Evaluation of Automated Teleretinal Screening Program for Diabetic Retinopathy. , 2016, JAMA ophthalmology.

[30]  Christos Faloutsos,et al.  EyeQual: Accurate, Explainable, Retinal Image Quality Assessment , 2017, 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA).

[31]  A Bradley,et al.  Optical and visual impact of tear break-up in human eyes. , 2000, Investigative ophthalmology & visual science.

[32]  Hidayet Erdöl,et al.  Identification of suitable fundus images using automated quality assessment methods , 2014, Journal of biomedical optics.

[33]  Richard Simon,et al.  Bias in error estimation when using cross-validation for model selection , 2006, BMC Bioinformatics.

[34]  J. Ellis,et al.  Can we predict which patients are at risk of having an ungradeable digital image for screening for diabetic retinopathy? , 2008, Eye.

[35]  Gangyi Jiang,et al.  Automated Quality Assessment of Fundus Images via Analysis of Illumination, Naturalness and Structure , 2018, IEEE Access.

[36]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.

[37]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[38]  Bram van Ginneken,et al.  Image structure clustering for image quality verification of color retina images in diabetic retinopathy screening , 2006, Medical Image Anal..

[39]  Stephen J. Aldington,et al.  The influence of age, duration of diabetes, cataract, and pupil size on image quality in digital photographic retinal screening. , 2005, Diabetes care.

[40]  M. Schwartz,et al.  The retina as a window to the brain—from eye research to CNS disorders , 2013, Nature Reviews Neurology.

[41]  Langis Gagnon,et al.  Automatic visual quality assessment in optical fundus images , 2001 .

[42]  L. Leocani,et al.  Functional and morphological changes of the retinal vessels in Alzheimer’s disease and mild cognitive impairment , 2019, Scientific Reports.

[43]  R. Klein,et al.  Methods for evaluation of retinal microvascular abnormalities associated with hypertension/sclerosis in the Atherosclerosis Risk in Communities Study. , 1999, Ophthalmology.

[44]  G. Cumming,et al.  Inference by eye: confidence intervals and how to read pictures of data. , 2005, The American psychologist.

[45]  I. Deary,et al.  Retinal vascular image analysis as a potential screening tool for cerebrovascular disease: a rationale based on homology between cerebral and retinal microvasculatures , 2005, Journal of anatomy.

[46]  Evelien Vandewalle,et al.  Retinal Oximetry Discovers Novel Biomarkers in Retinal and Brain Diseases. , 2017, Investigative ophthalmology & visual science.

[47]  M. Sonka,et al.  Retinal Imaging and Image Analysis , 2010, IEEE Reviews in Biomedical Engineering.

[48]  B. Efron Better Bootstrap Confidence Intervals , 1987 .