Automatic detection of referral patients due to retinal pathologies through data mining

With the increased prevalence of retinal pathologies, automating the detection of these pathologies is becoming more and more relevant. In the past few years, many algorithms have been developed for the automated detection of a specific pathology, typically diabetic retinopathy, using eye fundus photography. No matter how good these algorithms are, we believe many clinicians would not use automatic detection tools focusing on a single pathology and ignoring any other pathology present in the patient's retinas. To solve this issue, an algorithm for characterizing the appearance of abnormal retinas, as well as the appearance of the normal ones, is presented. This algorithm does not focus on individual images: it considers examination records consisting of multiple photographs of each retina, together with contextual information about the patient. Specifically, it relies on data mining in order to learn diagnosis rules from characterizations of fundus examination records. The main novelty is that the content of examination records (images and context) is characterized at multiple levels of spatial and lexical granularity: 1) spatial flexibility is ensured by an adaptive decomposition of composite retinal images into a cascade of regions, 2) lexical granularity is ensured by an adaptive decomposition of the feature space into a cascade of visual words. This multigranular representation allows for great flexibility in automatically characterizing normality and abnormality: it is possible to generate diagnosis rules whose precision and generalization ability can be traded off depending on data availability. A variation on usual data mining algorithms, originally designed to mine static data, is proposed so that contextual and visual data at adaptive granularity levels can be mined. This framework was evaluated in e-ophtha, a dataset of 25,702 examination records from the OPHDIAT screening network, as well as in the publicly-available Messidor dataset. It was successfully applied to the detection of patients that should be referred to an ophthalmologist and also to the specific detection of several pathologies.

[1]  Gwénolé Quellec,et al.  Medical Case Retrieval From a Committee of Decision Trees , 2010, IEEE Transactions on Information Technology in Biomedicine.

[2]  Qin Li,et al.  Retinopathy Online Challenge: Automatic Detection of Microaneurysms in Digital Color Fundus Photographs , 2010, IEEE Transactions on Medical Imaging.

[3]  James R. Foulds,et al.  Speeding Up and Boosting Diverse Density Learning , 2010, Discovery Science.

[4]  J. Olson,et al.  The efficacy of automated “disease/no disease” grading for diabetic retinopathy in a systematic screening programme , 2007, British Journal of Ophthalmology.

[5]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[6]  Charles V. Stewart,et al.  A Feature-Based Technique for Joint Linear Estimation of High-Order Image-to-Mosaic Transformations: Mosaicing the Curved Human Retina , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  A Erginay,et al.  OPHDIAT: quality-assurance programme plan and performance of the network. , 2008, Diabetes & metabolism.

[8]  Keshab K. Parhi,et al.  DREAM: Diabetic Retinopathy Analysis Using Machine Learning , 2014, IEEE Journal of Biomedical and Health Informatics.

[9]  Milan Sonka,et al.  Three-Dimensional Analysis of Retinal Layer Texture: Identification of Fluid-Filled Regions in SD-OCT of the Macula , 2010, IEEE Transactions on Medical Imaging.

[10]  Baoxin Li,et al.  Classification of diabetic retinopathy images using multi-class multiple-instance learning based on color correlogram features , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[12]  Swaminathan Ramakrishnan,et al.  Abnormality detection in retinal images using ant colony optimization and artificial neural networks - biomed 2010. , 2010, Biomedical sciences instrumentation.

[13]  Robert C. Bolles,et al.  Parametric Correspondence and Chamfer Matching: Two New Techniques for Image Matching , 1977, IJCAI.

[14]  Wen Gao,et al.  Learning to Distribute Vocabulary Indexing for Scalable Visual Search , 2013, IEEE Transactions on Multimedia.

[15]  Ali Erginay,et al.  Classification simplifiée de la rétinopathie diabétique adaptée au dépistage par photographies du fond d’œil , 2007 .

[16]  Bram van Ginneken,et al.  Information Fusion for Diabetic Retinopathy CAD in Digital Color Fundus Photographs , 2009, IEEE Transactions on Medical Imaging.

[17]  Dinesh Kumar,et al.  Validating retinal fundus image analysis algorithms: issues and a proposal. , 2013, Investigative ophthalmology & visual science.

[18]  Joseph M. Reinhardt,et al.  Retinal atlas statistics from color fundus images , 2010, Medical Imaging.

[19]  Calvin R. Maurer,et al.  A Linear Time Algorithm for Computing Exact Euclidean Distance Transforms of Binary Images in Arbitrary Dimensions , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  José Manuel Bravo,et al.  Locating the fovea center position in digital fundus images using thresholding and feature extraction techniques , 2013, Comput. Medical Imaging Graph..

[21]  Mun Wai Lee,et al.  Optimal Global Mosaic Generation from Retinal Images , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[22]  Jayanthi Sivaswamy,et al.  A Bag of Words approach for discriminating between retinal images containing exudates or drusen , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[23]  Bram van Ginneken,et al.  Fast detection of the optic disc and fovea in color fundus photographs , 2009, Medical Image Anal..

[24]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[26]  D B Brown,et al.  Glaucoma screening by means of an optic disc grid. , 1983, The British journal of ophthalmology.

[27]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[28]  Philip J. Morrow,et al.  Algorithms for digital image processing in diabetic retinopathy , 2009, Comput. Medical Imaging Graph..

[29]  Jacques Wainer,et al.  Points of Interest and Visual Dictionaries for Automatic Retinal Lesion Detection , 2012, IEEE Transactions on Biomedical Engineering.

[30]  Roberto J. Bayardo,et al.  Efficiently mining long patterns from databases , 1998, SIGMOD '98.

[31]  Guy Cazuguel,et al.  TeleOphta: Machine learning and image processing methods for teleophthalmology , 2013 .

[32]  M. Sonka,et al.  Retinal Imaging and Image Analysis , 2010, IEEE Reviews in Biomedical Engineering.

[33]  Gwénolé Quellec,et al.  Multimedia data mining for automatic diabetic retinopathy screening , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[34]  Gwénolé Quellec,et al.  A multiple-instance learning framework for diabetic retinopathy screening , 2012, Medical Image Anal..

[35]  Yuan Yan Tang,et al.  Elastic registration for retinal images based on reconstructed vascular trees , 2006, IEEE Transactions on Biomedical Engineering.

[36]  Sharib Ali,et al.  Exudate segmentation on retinal atlas space , 2013, 2013 8th International Symposium on Image and Signal Processing and Analysis (ISPA).

[37]  Grading diabetic retinopathy from stereoscopic color fundus photographs--an extension of the modified Airlie House classification. ETDRS report number 10. Early Treatment Diabetic Retinopathy Study Research Group. , 1991, Ophthalmology.

[38]  Ali Erginay,et al.  Article originalClassification simplifiée de la rétinopathie diabétique adaptée au dépistage par photographies du fond d’œilA new grading system from color fundus photographs for screening for diabetic retinopathy , 2007 .

[39]  Hamid Reza Pourreza,et al.  Fully automated diabetic retinopathy screening using morphological component analysis , 2015, Comput. Medical Imaging Graph..

[40]  Meindert Niemeijer,et al.  Evaluation of a computer-aided diagnosis system for diabetic retinopathy screening on public data. , 2011, Investigative ophthalmology & visual science.

[41]  Mathieu Lamard,et al.  Multimodal Information Retrieval Based on DSmT. Application to Computeraided Medical Diagnosis , 2016 .

[42]  Wynne Hsu,et al.  Abnormality Detection in Retinal Images , 2004 .

[43]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[44]  Gwénolé Quellec,et al.  Automated early detection of diabetic retinopathy. , 2010, Ophthalmology.

[45]  Haogang Zhu,et al.  Detecting abnormality in optic nerve head images using a feature extraction analysis. , 2014, Biomedical optics express.

[46]  Peter F. Sharp,et al.  Evaluation of a System for Automatic Detection of Diabetic Retinopathy From Color Fundus Photographs in a Large Population of Patients With Diabetes , 2008, Diabetes Care.

[47]  Frédéric Zana,et al.  Segmentation of vessel-like patterns using mathematical morphology and curvature evaluation , 2001, IEEE Trans. Image Process..

[48]  Gwénolé Quellec,et al.  Optimal Wavelet Transform for the Detection of Microaneurysms in Retina Photographs , 2008, IEEE Transactions on Medical Imaging.

[49]  Jaume Amores,et al.  Multiple instance classification: Review, taxonomy and comparative study , 2013, Artif. Intell..

[50]  Bálint Antal,et al.  An Ensemble-Based System for Microaneurysm Detection and Diabetic Retinopathy Grading , 2012, IEEE Transactions on Biomedical Engineering.

[51]  P Gain,et al.  [A new grading system from color fundus photographs for screening for diabetic retinopathy]. , 2007, Journal francais d'ophtalmologie.

[52]  Chen Houjin,et al.  A Robust Feature-Based Method for Mosaic of the Curved Human Color Retinal Images , 2008, 2008 International Conference on BioMedical Engineering and Informatics.

[53]  Gwénolé Quellec,et al.  Case Retrieval in Medical Databases by Fusing Heterogeneous Information , 2015, IEEE Transactions on Medical Imaging.

[54]  Ziqiang Wu,et al.  MACULAR THICKNESS MEASUREMENTS IN NORMAL EYES WITH TIME-DOMAIN AND FOURIER-DOMAIN OPTICAL COHERENCE TOMOGRAPHY , 2009, Retina.

[55]  Lin Pan,et al.  The Retinal Image Mosaic Based on Invariant Feature and Hierarchial Transformation Models , 2009, 2009 2nd International Congress on Image and Signal Processing.

[56]  Gwénolé Quellec,et al.  Exudate detection in color retinal images for mass screening of diabetic retinopathy , 2014, Medical Image Anal..

[57]  Tomás Lozano-Pérez,et al.  A Framework for Multiple-Instance Learning , 1997, NIPS.

[58]  Pan Yu,et al.  Automated localization of retinal features. , 2011, Applied optics.

[59]  Ramakrishnan Srikant,et al.  Fast Algorithms for Mining Association Rules in Large Databases , 1994, VLDB.

[60]  J. Wainer,et al.  Advancing Bag-of-Visual-Words Representations for Lesion Classification in Retinal Images , 2014, PloS one.

[61]  Guy Cazuguel,et al.  FEEDBACK ON A PUBLICLY DISTRIBUTED IMAGE DATABASE: THE MESSIDOR DATABASE , 2014 .

[62]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[63]  Alexander Zelinsky,et al.  Fast Radial Symmetry for Detecting Points of Interest , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[64]  Marios S. Pattichis,et al.  Automatic system for diabetic retinopathy screening based on AM-FM, partial least squares, and support vector machines , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[65]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[66]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[67]  Tien Yin Wong,et al.  Automatic localization of retinal landmarks , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[68]  Melih Kandemir,et al.  Computer-aided diagnosis from weak supervision: A benchmarking study , 2015, Comput. Medical Imaging Graph..

[69]  Jacques Wainer,et al.  Assessing the Need for Referral in Automatic Diabetic Retinopathy Detection , 2013, IEEE Transactions on Biomedical Engineering.

[70]  Qi Tian,et al.  Contextual Hashing for Large-Scale Image Search , 2014, IEEE Transactions on Image Processing.

[71]  Huiqi Li,et al.  Automated feature extraction in color retinal images by a model based approach , 2004, IEEE Transactions on Biomedical Engineering.

[72]  G. Quellec,et al.  Automated analysis of retinal images for detection of referable diabetic retinopathy. , 2013, JAMA ophthalmology.