Quality and content analysis of fundus images using deep learning

Automatic retinal image analysis has remained an important topic of research in the last ten years. Various algorithms and methods have been developed for analysing retinal images. The majority of these methods use public retinal image databases for performance evaluation without first examining the retinal image quality. Therefore, the performance metrics reported by these methods are inconsistent. In this article, we propose a deep learning-based approach to assess the quality of input retinal images. The method begins with a deep learning-based classification that identifies the image quality in terms of sharpness, illumination and homogeneity, followed by an unsupervised second stage that evaluates the field definition and content in the image. Using the inter-database cross-validation technique, our proposed method achieved overall sensitivity, specificity, positive predictive value, negative predictive value and accuracy of above 90% when tested on 7007 images collected from seven different public databases, including our own developed database-the UoA-DR database. Therefore, our proposed method is generalised and robust, making it more suitable than alternative methods for adoption in clinical practice.

[1]  Bernadette Dorizzi,et al.  Retinal image quality assessment using deep learning , 2018, Comput. Biol. Medicine.

[2]  Whoi-Yul Kim,et al.  A novel approach to the fast computation of Zernike moments , 2006, Pattern Recognit..

[3]  Wenguang Yu,et al.  No-reference image quality assessment based on deep learning method , 2017, 2017 IEEE 3rd Information Technology and Mechatronics Engineering Conference (ITOEC).

[4]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Jia Deng,et al.  A large-scale hierarchical image database , 2009, CVPR 2009.

[6]  Hayit Greenspan,et al.  Chest pathology detection using deep learning with non-medical training , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[7]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[8]  Kenneth W. Tobin,et al.  Using a patient image archive to diagnose retinopathy , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  Hiba Chougrad,et al.  Deep Convolutional Neural Networks for breast cancer screening , 2018, Comput. Methods Programs Biomed..

[10]  Frédéric Zana,et al.  Segmentation of vessel-like patterns using mathematical morphology and curvature evaluation , 2001, IEEE Trans. Image Process..

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  U. Rajendra Acharya,et al.  Automated Diagnosis of Glaucoma Using Digital Fundus Images , 2009, Journal of Medical Systems.

[13]  Sebastian Bosse,et al.  Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment , 2016, IEEE Transactions on Image Processing.

[14]  Marios S. Pattichis,et al.  A Multiscale Optimization Approach to Detect Exudates in the Macula , 2014, IEEE Journal of Biomedical and Health Informatics.

[15]  Martin Kraus,et al.  Automatic no-reference quality assessment for retinal fundus images using vessel segmentation , 2013, Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems.

[16]  Cheng Wan,et al.  Image quality classification for DR screening using deep learning , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[17]  Bram van Ginneken,et al.  Automatic classification of pulmonary peri-fissural nodules in computed tomography using an ensemble of 2D views and a convolutional neural network out-of-the-box , 2015, Medical Image Anal..

[18]  Daniel L. Rubin,et al.  Transfer learning on fused multiparametric MR images for classifying histopathological subtypes of rhabdomyosarcoma , 2017, Comput. Medical Imaging Graph..

[19]  Kenneth W. Tobin,et al.  Detection of Anatomic Structures in Human Retinal Imagery , 2007, IEEE Transactions on Medical Imaging.

[20]  Guy Cazuguel,et al.  FEEDBACK ON A PUBLICLY DISTRIBUTED IMAGE DATABASE: THE MESSIDOR DATABASE , 2014 .

[21]  Moyses Szklo,et al.  American Journal of Epidemiology Practice of Epidemiology Brazilian Longitudinal Study of Adult Health (elsa-brasil): Objectives and Design , 2022 .

[22]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[23]  Muhammad Moazam Fraz,et al.  Automated retinal image quality assessment on the UK Biobank dataset for epidemiological studies , 2016, Comput. Biol. Medicine.

[24]  Waleed H. Abdulla,et al.  Automatic segmentation of retinal vasculature , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[25]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[26]  Bo Yan,et al.  An accurate deep convolutional neural networks model for no-reference image quality assessment , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[27]  I. Deary,et al.  Retinal image analysis: Concepts, applications and potential , 2006, Progress in Retinal and Eye Research.

[28]  Waleed H. Abdulla,et al.  Automatic detection and segmentation of optic disc and fovea in retinal images , 2018, IET Image Process..

[29]  Gilberto Zamora,et al.  Automated image quality evaluation of retinal fundus photographs in diabetic retinopathy screening , 2012, 2012 IEEE Southwest Symposium on Image Analysis and Interpretation.

[30]  Jacques Wainer,et al.  Retinal Image Quality Analysis for Automatic Diabetic Retinopathy Detection , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[31]  Mehmet A. Orgun,et al.  A novel end-to-end classifier using domain transferred deep convolutional neural networks for biomedical images , 2017, Comput. Methods Programs Biomed..

[32]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[33]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[34]  Waleed H. Abdulla,et al.  Comparative Analysis of University of Auckland Diabetic Retinopathy Database , 2017, ICSPS 2017.

[35]  Miguel Ángel Guevara-López,et al.  Representation learning for mammography mass lesion classification with convolutional neural networks , 2016, Comput. Methods Programs Biomed..

[36]  Kenneth W. Tobin,et al.  Automatic detection of retina disease: Robustness to image quality and localization of anatomy structure , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[37]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[38]  Bram van Ginneken,et al.  Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[39]  Andrew Hunter,et al.  An automated retinal image quality grading algorithm , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[40]  Sen Jia,et al.  Blind high dynamic range image quality assessment using deep learning , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[41]  K. W. Tobin,et al.  Elliptical local vessel density: A fast and robust quality metric for retinal images , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[42]  J. Olson,et al.  Automated assessment of diabetic retinal image quality based on clarity and field definition. , 2006, Investigative ophthalmology & visual science.