Sensitivity and Specificity of Machine Learning Classifiers and Spectral Domain OCT for the Diagnosis of Glaucoma

Purpose. To investigate the sensitivity and specificity of machine learning classifiers (MLC) and spectral domain optical coherence tomography (SD-OCT) for the diagnosis of glaucoma. Methods. Sixty-two patients with early to moderate glaucomatous visual field damage and 48 healthy individuals were included. All subjects underwent a complete ophthalmologic examination, achromatic standard automated perimetry, and RNFL imaging with SD-OCT (Cirrus HD-OCT; Carl Zeiss Meditec, Inc., Dublin, California, USA). Receiver operating characteristic (ROC) curves were obtained for all SD-OCT parameters. Subsequently, the following MLCs were tested: Classification Tree (CTREE), Random Forest (RAN), Bagging (BAG), AdaBoost M1 (ADA), Ensemble Selection (ENS), Multilayer Perceptron (MLP), Radial Basis Function (RBF), Naive-Bayes (NB), and Support Vector Machine (SVM). Areas under the ROC curves (aROCs) obtained for each parameter and each MLC were compared. Results. The mean age was 57.0±9.2 years for healthy individuals and 59.9±9.0 years for glaucoma patients (p=0.103). Mean deviation values were −4.1±2.4 dB for glaucoma patients and −1.5±1.6 dB for healthy individuals (p<0.001). The SD-OCT parameters with the greater aROCs were inferior quadrant (0.813), average thickness (0.807), 7 o'clock position (0.765), and 6 o'clock position (0.754). The aROCs from classifiers varied from 0.785 (ADA) to 0.818 (BAG). The aROC obtained with BAG was not significantly different from the aROC obtained with the best single SD-OCT parameter (p=0.93). Conclusions. The SD-OCT showed good diagnostic accuracy in a group of patients with early glaucoma. In this series, MLCs did not improve the sensitivity and specificity of SD-OCT for the diagnosis of glaucoma.

[1]  Ki Ho Park,et al.  Comparison of Cirrus OCT and Stratus OCT on the ability to detect localized retinal nerve fiber layer defects in preperimetric glaucoma. , 2010, Investigative ophthalmology & visual science.

[2]  Anders Heijl,et al.  Trained Artificial Neural Network for Glaucoma Diagnosis Using Visual Field Data: A Comparison With Conventional Algorithms , 2007, Journal of glaucoma.

[3]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[4]  E A Swanson,et al.  Quantification of nerve fiber layer thickness in normal and glaucomatous eyes using optical coherence tomography. , 1995, Archives of ophthalmology.

[5]  William J Feuer,et al.  Comparison of retinal nerve fiber layer measurements using time domain and spectral domain optical coherent tomography. , 2009, Ophthalmology.

[6]  A. Sommer,et al.  Clinically detectable nerve fiber atrophy precedes the onset of glaucomatous field loss. , 1991, Archives of ophthalmology.

[7]  William J Feuer,et al.  Sensitivity and specificity of time-domain versus spectral-domain optical coherence tomography in diagnosing early to moderate glaucoma. , 2009, Ophthalmology.

[8]  T. Sejnowski,et al.  Relevance vector machine and support vector machine classifier analysis of scanning laser polarimetry retinal nerve fiber layer measurements. , 2005, Investigative ophthalmology & visual science.

[9]  Te-Won Lee,et al.  Bayesian machine learning classifiers for combining structural and functional measurements to classify healthy and glaucomatous eyes. , 2008, Investigative ophthalmology & visual science.

[10]  Berthold Lausen,et al.  Improving Glaucoma Diagnosis by the Combination of Perimetry and HRT Measurements , 2006, Journal of glaucoma.

[11]  Georg Michelson,et al.  Combined Evaluation of Frequency Doubling Technology Perimetry and Scanning Laser Ophthalmoscopy for Glaucoma Detection Using Automated Classification , 2012, Journal of glaucoma.

[12]  L. Zangwill,et al.  Discriminating between normal and glaucomatous eyes using the Heidelberg Retina Tomograph, GDx Nerve Fiber Analyzer, and Optical Coherence Tomograph. , 2001, Archives of ophthalmology.

[13]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[14]  S. Sathiya Keerthi,et al.  Improvements to Platt's SMO Algorithm for SVM Classifier Design , 2001, Neural Computation.

[15]  J. Schuman,et al.  Optical coherence tomography. , 2000, Science.

[16]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[17]  Chris A. Johnson,et al.  The Relationship Between Structural and Functional Alterations in Glaucoma: A Review , 2000, Seminars in ophthalmology.

[18]  Anders Heijl,et al.  Machine learning classifiers for glaucoma diagnosis based on classification of retinal nerve fibre layer thickness parameters measured by Stratus OCT , 2010, Acta ophthalmologica.

[19]  J. Fujimoto,et al.  Optical coherence tomography: A new tool for glaucoma diagnosis , 1995, Current opinion in ophthalmology.

[20]  C. Glymour,et al.  Optical coherence tomography machine learning classifiers for glaucoma detection: a preliminary study. , 2005, Investigative ophthalmology & visual science.

[21]  Kyung Rim Sung,et al.  Comparison of glaucoma diagnostic Capabilities of Cirrus HD and Stratus optical coherence tomography. , 2009, Archives of ophthalmology.

[22]  J. Zarranz-Ventura,et al.  Cirrus high-definition optical coherence tomography compared with Stratus optical coherence tomography in glaucoma diagnosis. , 2010, Investigative ophthalmology & visual science.

[23]  A. Brenning,et al.  Glaucoma Detection With Frequency Doubling Perimetry and Short-wavelength Perimetry , 2007, Journal of glaucoma.

[24]  Mei-Ling Huang,et al.  Development and comparison of automated classifiers for glaucoma diagnosis using Stratus optical coherence tomography. , 2005, Investigative ophthalmology & visual science.

[25]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[26]  A. S. Vilupuru,et al.  The relationship between nerve fiber layer and perimetry measurements. , 2007, Investigative ophthalmology & visual science.

[27]  K. A. Townsend,et al.  Heidelberg Retina Tomograph 3 machine learning classifiers for glaucoma detection , 2008, British Journal of Ophthalmology.

[28]  Robert N Weinreb,et al.  Assessing visual field clustering schemes using machine learning classifiers in standard perimetry. , 2007, Investigative ophthalmology & visual science.

[29]  Xiaohui Liu,et al.  A spatio-temporal Bayesian network classifier for understanding visual field deterioration , 2005, Artif. Intell. Medicine.

[30]  Anthony J Correnti,et al.  Optical coherence tomography measurement of macular and nerve fiber layer thickness in normal and glaucomatous human eyes. , 2003, Ophthalmology.