Automatic cataract grading methods based on deep learning

BACKGROUND AND OBJECTIVE The shortage of ophthalmologists in rural areas in China causes a lot of cataract patients not getting timely diagnosis and effective treatment. We develop an algorithm and platform to automatically diagnose and grade cataract based on fundus images of patients. This method can help government assisting poor population more accurately. METHODS The novel six-level cataract grading method proposed in this paper focuses on the multi-feature fusion based on stacking. We extract two kinds of features which can effectively distinguish different levels of cataract. One is high-level features extracted from residual network (ResNet18). The other is texture features extarcted by gray level co-occurrence matrix (GLCM). Then a frame is proposed to automatically grade cataract by the extracted features. In the frame, two support vector machine (SVM) classifiers are used as base-learners to obtain the probability outputs of each fundus image, and fully connected neural network (FCNN) are used as meta-learner to output the final classification result, which consists of two fully-connected layers. RESULT The accuracy of six-level grading achieved by the proposed method is up to 92.66% on average, the highest of which reaches 93.33%. The proposed method achieves 94.75% accuracy on four-level grading for cataract, which is at least 1.75% higher than those of the exiting methods. CONCLUSIONS Six-category cataract classification algorithm show that Multi-feature & Stacking proposed in this paper helps achieve higher grading performance and lower volatility than grading using high-level features and texture features respectively. We also apply our algorithm into four-level cataract grading system and it shows higher accuracy compared with previous reports.

[1]  Jianqiang Li,et al.  Classification of retinal image for automatic cataract detection , 2013, 2013 IEEE 15th International Conference on e-Health Networking, Applications and Services (Healthcom 2013).

[2]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[3]  Max Q.-H. Meng,et al.  Texture analysis for ulcer detection in capsule endoscopy images , 2009, Image Vis. Comput..

[4]  Liming Wang,et al.  An artificial intelligence platform for the multihospital collaborative management of congenital cataracts , 2017, Nature Biomedical Engineering.

[5]  J. Cano,et al.  Innovative tools for assessing risks for severe adverse events in areas of overlapping Loa loa and other filarial distributions: the application of micro-stratification mapping , 2014, Parasites & Vectors.

[6]  Jianqiang Li,et al.  Automatic cataract detection and grading using Deep Convolutional Neural Network , 2017, 2017 IEEE 14th International Conference on Networking, Sensing and Control (ICNSC).

[7]  Qinyan Zhang,et al.  Classification of cataract fundus image based on deep learning , 2017, 2017 IEEE International Conference on Imaging Systems and Techniques (IST).

[8]  A. Rai,et al.  A smartphone dongle for diagnosis of infectious diseases at the point of care , 2015, Science Translational Medicine.

[9]  Peter Szolovits,et al.  The coming of age of artificial intelligence in medicine , 2009, Artif. Intell. Medicine.

[10]  Zhengguo Li,et al.  Structure-Preserving Guided Retinal Image Filtering and Its Application for Optic Disk Analysis , 2018, IEEE Transactions on Medical Imaging.

[11]  Patrick Blake,et al.  Clinical decision support systems for improving diagnostic accuracy and achieving precision medicine , 2015, Journal of Clinical Bioinformatics.

[12]  Dinesh Kumar,et al.  Validating retinal fundus image analysis algorithms: issues and a proposal. , 2013, Investigative ophthalmology & visual science.

[13]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[14]  Qinyan Zhang,et al.  Application of SVM based on genetic algorithm in classification of cataract fundus images , 2017, 2017 IEEE International Conference on Imaging Systems and Techniques (IST).

[15]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  V. Bhanumathi,et al.  Automatic cataract classification system , 2016, 2016 International Conference on Communication and Signal Processing (ICCSP).

[17]  Joo-Hwee Lim,et al.  A Computer-Aided Diagnosis System of Nuclear Cataract , 2010, IEEE Transactions on Biomedical Engineering.

[18]  Ana Maria Mendonça,et al.  Segmentation of retinal blood vessels by combining the detection of centerlines and morphological reconstruction , 2006, IEEE Transactions on Medical Imaging.

[19]  Hans Limburg,et al.  Global causes of blindness and distance vision impairment 1990-2020: a systematic review and meta-analysis. , 2017, The Lancet. Global health.

[20]  S. Sathiya Keerthi,et al.  Improvements to Platt's SMO Algorithm for SVM Classifier Design , 2001, Neural Computation.

[21]  Jianqiang Li,et al.  A computer-aided healthcare system for cataract classification and grading based on fundus image analysis , 2015, Comput. Ind..

[22]  Li Xiong,et al.  An Approach to Evaluate Blurriness in Retinal Images with Vitreous Opacity for Cataract Diagnosis , 2017, Journal of healthcare engineering.