An Efficient and Comprehensive Labeling Tool for Large-Scale Annotation of Fundus Images

Computerized labeling tools are often used to systematically record the assessment for fundus images. Carefully designed labeling tools not only save time and enable comprehensive and thorough assessment at clinics, but also economize large-scale data collection processes for the development of automatic algorithms. To realize efficient and thorough fundus assessment, we developed a new labeling tool with novel schemes - stepwise labeling and regional encoding. We have used our tool in a large-scale data annotation project in which 318,376 annotations for 109,885 fundus images were gathered with a total duration of 421 h. We believe that the fundamental concepts in our tool would inspire other data collection processes and annotation procedure in different domains.

[1]  E. Finkelstein,et al.  Development and Validation of a Deep Learning System for Diabetic Retinopathy and Related Eye Diseases Using Retinal Images From Multiethnic Populations With Diabetes , 2017, JAMA.

[2]  M. C. Leske,et al.  The prevalence of diabetic retinopathy among adults in the United States. , 2004, Archives of ophthalmology.

[3]  Mariano Rincón,et al.  Identification of the optic nerve head with genetic algorithms , 2008, Artif. Intell. Medicine.

[4]  M. Blumenkranz,et al.  The sensitivity and specificity of single-field nonmydriatic monochromatic digital fundus photography with remote image interpretation for diabetic retinopathy screening: a comparison with ophthalmoscopy and standardized mydriatic color photography. , 2002, American journal of ophthalmology.

[5]  Guy Cazuguel,et al.  FEEDBACK ON A PUBLICLY DISTRIBUTED IMAGE DATABASE: THE MESSIDOR DATABASE , 2014 .

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Guy Cazuguel,et al.  TeleOphta: Machine learning and image processing methods for teleophthalmology , 2013 .

[8]  Rishab Gargeya,et al.  Automated Identification of Diabetic Retinopathy Using Deep Learning. , 2017, Ophthalmology.

[9]  Grading diabetic retinopathy from stereoscopic color fundus photographs--an extension of the modified Airlie House classification. ETDRS report number 10. Early Treatment Diabetic Retinopathy Study Research Group. , 1991, Ophthalmology.

[10]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[11]  Fabrice Mériaudeau,et al.  Indian Diabetic Retinopathy Image Dataset (IDRiD): A Database for Diabetic Retinopathy Screening Research , 2018, Data.

[12]  Sang Jun Park,et al.  A Novel Fundus Image Reading Tool for Efficient Generation of a Multi-dimensional Categorical Image Database for Machine Learning Algorithm Training , 2018, Journal of Korean medical science.

[13]  T Zeyen,et al.  Screening for Glaucoma in a General Population with the Non-Mydriatic Fundus Camera and the Frequency Doubling Perimeter , 2004, European journal of ophthalmology.