EyeQual: Accurate, Explainable, Retinal Image Quality Assessment

Given a retinal image, can we automatically determine whether it is of high quality (suitable for medical diagnosis)? Can we also explain our decision, pinpointing the region or regions that led to our decision? Images from human retinas are vital for the diagnosis of multiple health issues, like hypertension, diabetes, and Alzheimer’s; low quality images may force the patient to come back again for a second scanning, wasting time and possibly delaying treatment. However, existing retinal image quality assessment methods are either black boxes without explanations of the results or depend heavily on feature engineering or on complex and error-prone anatomical structures’ segmentation. Therefore, we propose EyeQual, that solves exactly this problem. EyeQual is novel, fast for inference, accurate and explainable, pinpointing low-quality regions on the image. We evaluated EyeQual on two real datasets where it achieved 100% accuracy taking just 36 milliseconds for each image.

[1]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[2]  Tomás Lozano-Pérez,et al.  A Framework for Multiple-Instance Learning , 1997, NIPS.

[3]  Yiming Wang,et al.  Automatic retinal image quality assessment and enhancement , 1999, Medical Imaging.

[4]  Thomas Hofmann,et al.  Support Vector Machines for Multiple-Instance Learning , 2002, NIPS.

[5]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  Bram van Ginneken,et al.  Image structure clustering for image quality verification of color retina images in diabetic retinopathy screening , 2006, Medical Image Anal..

[7]  J. Olson,et al.  Automated assessment of diabetic retinal image quality based on clarity and field definition. , 2006, Investigative ophthalmology & visual science.

[8]  R. Klein,et al.  Retinal vessel diameters and risk of hypertension: the Multiethnic Study of Atherosclerosis , 2009, Journal of hypertension.

[9]  Joachim Hornegger,et al.  Automated quality assessment of retinal fundus photos , 2010, International Journal of Computer Assisted Radiology and Surgery.

[10]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[11]  Roy Taylor,et al.  Handbook of Retinal Screening in Diabetes: Diagnosis and Management , 2012 .

[12]  Martin Kraus,et al.  Automatic no-reference quality assessment for retinal fundus images using vessel segmentation , 2013, Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems.

[13]  Jaume Amores,et al.  Multiple instance classification: Review, taxonomy and comparative study , 2013, Artif. Intell..

[14]  Luís Alberto da Silva Cruz,et al.  Retinal image quality assessment using generic image quality indicators , 2014, Inf. Fusion.

[15]  Hidayet Erdöl,et al.  Identification of suitable fundus images using automated quality assessment methods , 2014, Journal of biomedical optics.

[16]  Trevor Darrell,et al.  Fully convolutional networks for semantic segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[18]  Ahmed El-Rafei,et al.  Retinal image quality assessment based on image clarity and content , 2016, Journal of biomedical optics.

[19]  Christine T. O. Nguyen,et al.  The Eye As a Biomarker for Alzheimer's Disease , 2016, Frontiers in neuroscience.

[20]  Dwarikanath Mahapatra,et al.  Retinal Image Quality Classification Using Saliency Maps and CNNs , 2016, MLMI@MICCAI.

[21]  Gwénolé Quellec,et al.  Automatic detection of referral patients due to retinal pathologies through data mining , 2016, Medical Image Anal..

[22]  Masoom A. Haider,et al.  Bag of Bags: Nested Multi Instance Classification for Prostate Cancer Detection , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).

[23]  Dahong Qian,et al.  Human Visual System-Based Fundus Image Quality Assessment of Portable Fundus Camera Photographs , 2016, IEEE Transactions on Medical Imaging.

[24]  Guy Cazuguel,et al.  Multiple-Instance Learning for Medical Image and Video Analysis , 2017, IEEE Reviews in Biomedical Engineering.

[25]  Jacques Wainer,et al.  Beyond Lesion-Based Diabetic Retinopathy: A Direct Approach for Referral , 2017, IEEE Journal of Biomedical and Health Informatics.

[26]  Sajib Saha,et al.  Deep Learning for Automated Quality Assessment of Color Fundus Images in Diabetic Retinopathy Screening , 2017, ArXiv.

[27]  Beatriz Remeseiro,et al.  Objective quality assessment of retinal images based on texture features , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[28]  Ana Maria Mendonça,et al.  Retinal Image Quality Assessment by Mean-Subtracted Contrast-Normalized Coefficients , 2017 .

[29]  Pedro Costa,et al.  Convolutional bag of words for diabetic retinopathy detection from eye fundus images , 2017, MVA.