Deep Transfer Learning for Improved Detection of Keratoconus using Corneal Topographic Maps

Clinical keratoconus (KCN) detection is a challenging and time-consuming task. In the diagnosis process, ophthalmologists must revise demographic and clinical ophthalmic examinations. The latter include slit-lamb, corneal topographic maps, and Pentacam indices (PI). We propose an Ensemble of Deep Transfer Learning (EDTL) based on corneal topographic maps. We consider four pretrained networks, SqueezeNet (SqN), AlexNet (AN), ShuffleNet (SfN), and MobileNet-v2 (MN), and fine-tune them on a dataset of KCN and normal cases, each including four topographic maps. We also consider a PI classifier. Then, our EDTL method combines the output probabilities of each of the five classifiers to obtain a decision based on the fusion of probabilities. Individually, the classifier based on PI achieved 93.1% accuracy, whereas the deep classifiers reached classification accuracies over 90% only in isolated cases. Overall, the average accuracy of the deep networks over the four corneal maps ranged from 86% (SfN) to 89.9% (AN). The classifier ensemble increased the accuracy of the deep classifiers based on corneal maps to values ranging (92.2% to 93.1%) for SqN and (93.1% to 94.8%) for AN. Including in the ensemble-specific combinations of corneal maps’ classifiers and PI increased the accuracy to 98.3%. Moreover, visualization of first learner filters in the networks and Grad-CAMs confirmed that the networks had learned relevant clinical features. This study shows the potential of creating ensembles of deep classifiers fine-tuned with a transfer learning strategy as it resulted in an improved accuracy while showing learnable filters and Grad-CAMs that agree with clinical knowledge. This is a step further towards the potential clinical deployment of an improved computer-assisted diagnosis system for KCN detection to help ophthalmologists to confirm the clinical decision and to perform fast and accurate KCN treatment.

[1]  J. Hjortdal,et al.  Keratoconus: Tissue Engineering and Biomaterials , 2014, Journal of functional biomaterials.

[2]  Ruben Morales-Menendez,et al.  A deep learning and grad-CAM based color visualization approach for fast detection of COVID-19 cases using chest X-ray and CT-Scan images , 2020, Chaos, Solitons & Fractals.

[3]  N. Shoji,et al.  Keratoconus detection using deep learning of colour-coded maps with anterior segment optical coherence tomography: a diagnostic accuracy study , 2019, BMJ Open.

[4]  M. Abràmoff,et al.  Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep Learning. , 2016, Investigative ophthalmology & visual science.

[5]  M. Khorrami-Nejad,et al.  Characteristics of Posterior Corneal Astigmatism in Different Stages of Keratoconus , 2018, Journal of ophthalmic & vision research.

[6]  Guang-Zhong Yang,et al.  Deep Learning for Health Informatics , 2017, IEEE Journal of Biomedical and Health Informatics.

[7]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[8]  P. Asbell,et al.  Keratoconus severity identification using unsupervised machine learning , 2018, PloS one.

[9]  Damien Gatinel,et al.  Corneal Elevation Topography: Best Fit Sphere, Elevation Distance, Asphericity, Toricity, and Clinical Implications , 2011, Cornea.

[10]  Eran Berkowitz,et al.  Wavefront Analysis for Keratoconus , 2014 .

[11]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[12]  D. Gatinel,et al.  Corneal topography raw data classification using a convolutional neural network. , 2020, American journal of ophthalmology.

[13]  P Agostino Accardo,et al.  Neural network-based system for early keratoconus detection from corneal topography , 2002, J. Biomed. Informatics.

[14]  Marcus Ang,et al.  Artificial intelligence for anterior segment diseases: Emerging applications in ophthalmology , 2020, British Journal of Ophthalmology.

[15]  M. Abràmoff,et al.  Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices , 2018, npj Digital Medicine.

[16]  Carina Koppen,et al.  Computer aided diagnosis for suspect keratoconus detection , 2019, Comput. Biol. Medicine.

[17]  Renato Ambrósio,et al.  Scheimpflug imaging for keratoconus and ectatic disease , 2013, Indian journal of ophthalmology.

[18]  Jung Sub Kim,et al.  Adopting machine learning to automatically identify candidate patients for corneal refractive surgery , 2019, npj Digital Medicine.

[19]  Xiangyu Zhang,et al.  ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[20]  Alexandru Lavric,et al.  KeratoDetect: Keratoconus Detection Algorithm Using Convolutional Neural Networks , 2019, Comput. Intell. Neurosci..

[21]  Álvaro Fernández-Rodríguez,et al.  Impact of Speller Size on a Visual P300 Brain-Computer Interface (BCI) System under Two Conditions of Constraint for Eye Movement , 2019, Comput. Intell. Neurosci..

[22]  M. Wake,et al.  Population health bio-phenotypes in 11–12 year old children and their midlife parents: Growing Up in Australia’s Child Health CheckPoint , 2019, BMJ Open.

[23]  Omran Al-Shamma,et al.  DFU_QUTNet: diabetic foot ulcer classification using novel deep convolutional neural network , 2019, Multimedia Tools and Applications.

[24]  S. Klyce,et al.  Current keratoconus detection methods compared with a neural network approach. , 1997, Investigative ophthalmology & visual science.

[25]  Ian H. Witten,et al.  Data mining - practical machine learning tools and techniques, Second Edition , 2005, The Morgan Kaufmann series in data management systems.

[26]  Taghi M. Khoshgoftaar,et al.  Survey on deep learning with class imbalance , 2019, J. Big Data.

[27]  M. Mazen Step by Stepㆮ Reading Pentacam Topography (Basics and Case Study Series) , 2010 .

[28]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[29]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[30]  N Maeda,et al.  Neural network classification of corneal topography. Preliminary demonstration. , 1995, Investigative ophthalmology & visual science.

[31]  Christiane,et al.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. , 2013, JAMA.

[32]  Hao Chen,et al.  Standard Plane Localization in Fetal Ultrasound via Domain Transferred Deep Neural Networks , 2015, IEEE Journal of Biomedical and Health Informatics.

[33]  Rebecca J. Cook,et al.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. , 2003, The Journal of the American College of Dentists.

[34]  Zahraa M. Mosa,et al.  Detecting Keratoconus by Using SVM and Decision Tree Classifiers with the Aid of Image Processing , 2019 .

[35]  Qian Xing,et al.  Machine Learning on Cataracts Classification Using SqueezeNet , 2018, 2018 4th International Conference on Universal Village (UV).

[36]  R. Navarro,et al.  SyntEyes KTC: higher order statistical eye model for developing keratoconus , 2017, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[37]  Bernardo T. Lopes,et al.  Artificial Intelligence in Corneal Diagnosis: Where Are we? , 2019, Current Ophthalmology Reports.

[38]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[39]  A. Renzaho,et al.  Non-communicable disease (NCD) corners in public sector health facilities in Bangladesh: a qualitative study assessing challenges and opportunities for improving NCD services at the primary healthcare level , 2019, BMJ Open.

[40]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[41]  Dimitri T. Azar,et al.  The AI Revolution and How to Prepare for It , 2020, Translational vision science & technology.

[42]  Jia-Yush Yen,et al.  Keratoconus Screening Based on Deep Learning Approach of Corneal Topography , 2020, Translational vision science & technology.

[43]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[44]  Aaron Y. Lee,et al.  Artificial intelligence and deep learning in ophthalmology , 2018, British Journal of Ophthalmology.