Validation of an Automated Artificial Intelligence Algorithm for the Quantification of Major OCT Parameters in Diabetic Macular Edema

Artificial intelligence (AI) and deep learning (DL)-based systems have gained wide interest in macular disorders, including diabetic macular edema (DME). This paper aims to validate an AI algorithm for identifying and quantifying different major optical coherence tomography (OCT) biomarkers in DME eyes by comparing the algorithm to human expert manual examination. Intraretinal (IRF) and subretinal fluid (SRF) detection and volumes, external limiting-membrane (ELM) and ellipsoid zone (EZ) integrity, and hyperreflective retina foci (HRF) quantification were analyzed. Three-hundred three DME eyes were included. The mean central subfield thickness was 386.5 ± 130.2 µm. IRF was present in all eyes and confirmed by AI software. The agreement (kappa value) (95% confidence interval) for SRF presence and ELM and EZ interruption were 0.831 (0.738–0.924), 0.934 (0.886–0.982), and 0.936 (0.894–0.977), respectively. The accuracy of the automatic quantification of IRF, SRF, ELM, and EZ ranged between 94.7% and 95.7%, while accuracy of quality parameters ranged between 99.0% (OCT layer segmentation) and 100.0% (fovea centering). The Intraclass Correlation Coefficient between clinical and automated HRF count was excellent (0.97). This AI algorithm provides a reliable and reproducible assessment of the most relevant OCT biomarkers in DME. It may allow clinicians to routinely identify and quantify these parameters, offering an objective way of diagnosing and following DME eyes.

[1]  R. Sznitman,et al.  Evaluation of an Artificial Intelligence-Based Detector of Sub- and Intraretinal Fluid on a Large Set of Optical Coherence Tomography Volumes in Age-Related Macular Degeneration and Diabetic Macular Edema , 2022, Ophthalmologica.

[2]  Kai Jin,et al.  OCT-Based Biomarkers are Associated with Systemic Inflammation in Patients with Treatment-Naïve Diabetic Macular Edema , 2022, Ophthalmology and Therapy.

[3]  U. Schmidt-Erfurth,et al.  VALIDATION OF AN AUTOMATED FLUID ALGORITHM ON REAL-WORLD DATA OF NEOVASCULAR AGE-RELATED MACULAR DEGENERATION OVER FIVE YEARS , 2022, Retina.

[4]  F. Asadi,et al.  Artificial intelligence in screening, diagnosis, and classification of diabetic macular edema: A systematic review. , 2022, Survey of ophthalmology.

[5]  P. Tien,et al.  Optical Coherence Tomography Biomarkers in Predicting Treatment Outcomes of Diabetic Macular Edema After Dexamethasone Implants , 2022, Frontiers in Medicine.

[6]  S. Nicoară,et al.  SD-OCT Biomarkers and the Current Status of Artificial Intelligence in Predicting Progression from Intermediate to Advanced AMD , 2022, Life.

[7]  Suber S. Huang,et al.  Optical Coherence Tomography Classification Systems for Diabetic Macular Edema and Their Associations With Visual Outcome and Treatment Responses – An Updated Review , 2021, Asia-Pacific journal of ophthalmology.

[8]  C. Cheung,et al.  OCT-based biomarkers for predicting treatment response in eyes with centre-involved diabetic macular oedema treated with anti-VEGF injections: a real-life retina clinic-based study , 2021, British Journal of Ophthalmology.

[9]  R. Raman,et al.  Narrative review of artificial intelligence in diabetic macular edema: Diagnosis and predicting treatment response using optical coherence tomography , 2021, Indian journal of ophthalmology.

[10]  T. Wong,et al.  Global Prevalence of Diabetic Retinopathy and Projection of Burden through 2045: Systematic Review and Meta-analysis. , 2021, Ophthalmology.

[11]  E. Pilotto,et al.  OCT Hyperreflective Retinal Foci in Diabetic Retinopathy: A Semi-Automatic Detection Comparative Study , 2021, Frontiers in Immunology.

[12]  N. Rocha,et al.  Age-Friendly Health Care: A Systematic Review , 2021, Healthcare.

[13]  Bianca S. Gerendas,et al.  Automated quantification of macular fluid in retinal diseases and their response to anti-VEGF therapy , 2020, British Journal of Ophthalmology.

[14]  V. Castro-Navarro,et al.  Effect of Dexamethasone Intravitreal Implant on Visual Acuity and Foveal Photoreceptor Integrity in Macular Edema Secondary to Retinal Vascular Disease , 2020, Ophthalmologica.

[15]  Bianca S. Gerendas,et al.  Quantification of Fluid Resolution and Visual Acuity Gain in Patients With Diabetic Macular Edema Using Deep Learning: A Post Hoc Analysis of a Randomized Clinical Trial. , 2020, JAMA ophthalmology.

[16]  R. Smolarczyk,et al.  The World Health Organization (WHO) approach to healthy ageing , 2020, Maturitas.

[17]  T. Jiang,et al.  Supervised Machine Learning: A Brief Primer. , 2020, Behavior therapy.

[18]  M. Shanmugam,et al.  Validation of Deep Convolutional Neural Network-based algorithm for detection of diabetic retinopathy – Artificial intelligence versus clinician for screening , 2020, Indian journal of ophthalmology.

[19]  I. Pinilla,et al.  Interpretation of OCT and OCTA images from a histological approach: Clinical and experimental implications , 2020, Progress in Retinal and Eye Research.

[20]  Jeany Q. Li,et al.  Prevalence, incidence and future projection of diabetic eye disease in Europe: a systematic review and meta-analysis , 2019, European Journal of Epidemiology.

[21]  Wynne Hsu,et al.  Artificial Intelligence Screening for Diabetic Retinopathy: the Real-World Emerging Application , 2019, Current Diabetes Reports.

[22]  I. Rudan,et al.  Global epidemiology of retinal vein occlusion: a systematic review and meta-analysis of prevalence, incidence, and risk factors , 2019, Journal of global health.

[23]  Amir Sadeghipour,et al.  Artificial intelligence in retina , 2018, Progress in Retinal and Eye Research.

[24]  E. Pilotto,et al.  Hyperreflective Intraretinal Foci as an OCT Biomarker of Retinal Inflammation in Diabetic Macular Edema. , 2018, Investigative ophthalmology & visual science.

[25]  Bianca S. Gerendas,et al.  Fully Automated Detection and Quantification of Macular Fluid in OCT Using Deep Learning. , 2017, Ophthalmology.

[26]  Min Zhao,et al.  Mechanisms of macular edema: Beyond the surface , 2017, Progress in Retinal and Eye Research.

[27]  A. Loewenstein,et al.  OCT Biomarkers as Functional Outcome Predictors in Diabetic Macular Edema Treated with Dexamethasone Implant. , 2017, Ophthalmology.

[28]  S. Vujosevic,et al.  Imaging retinal inflammatory biomarkers after intravitreal steroid and anti‐VEGF treatment in diabetic macular oedema , 2017, Acta ophthalmologica.

[29]  S. Vujosevic,et al.  HYPERREFLECTIVE RETINAL SPOTS IN NORMAL AND DIABETIC EYES: B-Scan and En Face Spectral Domain Optical Coherence Tomography Evaluation , 2017, Retina.

[30]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[31]  E. Midena,et al.  Multimodal retinal imaging of diabetic macular edema: toward new paradigms of pathophysiology , 2016, Graefe's Archive for Clinical and Experimental Ophthalmology.

[32]  Arup Das,et al.  Diabetic Macular Edema: Pathophysiology and Novel Therapeutic Targets. , 2015, Ophthalmology.

[33]  N. Bressler,et al.  Comparison of time- and spectral-domain optical coherence tomography in management of diabetic macular edema. , 2014, Investigative ophthalmology & visual science.

[34]  M. McHugh Interrater reliability: the kappa statistic , 2012, Biochemia medica.

[35]  E. Pilotto,et al.  Emerging Insights into Pathogenesis. , 2017, Developments in ophthalmology.