A New Screening Method for COVID-19 based on Ocular Feature Recognition by Machine Learning Tools

The Coronavirus disease 2019 (COVID-19) has affected several million people. With the outbreak of the epidemic, many researchers are devoting themselves to the COVID-19 screening system. The standard practices for rapid risk screening of COVID-19 are the CT imaging or RT-PCR (real-time polymerase chain reaction). However, these methods demand professional efforts of the acquisition of CT images and saliva samples, a certain amount of waiting time, and most importantly prohibitive examination fee in some countries. Recently, some literatures have shown that the COVID-19 patients usually accompanied by ocular manifestations consistent with the conjunctivitis, including conjunctival hyperemia, chemosis, epiphora, or increased secretions. After more than four months study, we found that the confirmed cases of COVID-19 present the consistent ocular pathological symbols; and we propose a new screening method of analyzing the eye-region images, captured by common CCD and CMOS cameras, could reliably make a rapid risk screening of COVID-19 with very high accuracy. We believe a system implementing such an algorithm should assist the triage management or the clinical diagnosis. To further evaluate our algorithm and approved by the Ethics Committee of Shanghai public health clinic center of Fudan University, we conduct a study of analyzing the eye-region images of 303 patients (104 COVID-19, 131 pulmonary, and 68 ocular patients), as well as 136 healthy people. Remarkably, our results of COVID-19 patients in testing set consistently present similar ocular pathological symbols; and very high testing results have been achieved in terms of sensitivity and specificity. We hope this study can be inspiring and helpful for encouraging more researches in this topic.

[1]  Po-Whei Huang,et al.  Automatic Classification for Pathological Prostate Images Based on Fractal Analysis , 2009, IEEE Transactions on Medical Imaging.

[2]  G. Heinze,et al.  Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal , 2020, BMJ.

[3]  M. Arfan Jaffar,et al.  A novel spontaneous facial expression recognition using dynamically weighted majority voting based ensemble classifier , 2018, Multimedia Tools and Applications.

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Chen Liu,et al.  DessiLBI: Exploring Structural Sparsity of Deep Networks via Differential Inclusion Paths , 2020, ICML.

[6]  Quanxin Long,et al.  Clinical and immunological assessment of asymptomatic SARS-CoV-2 infections , 2020, Nature Medicine.

[7]  Shriji N. Patel,et al.  Ocular Symptoms among Nonhospitalized Patients Who Underwent COVID-19 Testing , 2020, Ophthalmology.

[8]  G. Ippolito,et al.  SARS-CoV-2 Isolation From Ocular Secretions of a Patient With COVID-19 in Italy With Prolonged Viral RNA Detection , 2020, Annals of Internal Medicine.

[9]  Yuhong Nie,et al.  Ocular Findings and Proportion with Conjunctival SARS-COV-2 in COVID-19 Patients , 2020, Ophthalmology.

[10]  A. Aguzzi,et al.  Inflammatory olfactory neuropathy in two patients with COVID-19 , 2020, The Lancet.

[11]  E. Finkelstein,et al.  Development and Validation of a Deep Learning System for Diabetic Retinopathy and Related Eye Diseases Using Retinal Images From Multiethnic Populations With Diabetes , 2017, JAMA.

[12]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[13]  Tao Xiang,et al.  Learning Multimodal Latent Attributes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  W. Liang,et al.  Clinically Applicable AI System for Accurate Diagnosis, Quantitative Measurements, and Prognosis of COVID-19 Pneumonia Using Computed Tomography , 2020, Cell.

[15]  Z. Fayad,et al.  Artificial intelligence–enabled rapid diagnosis of patients with COVID-19 , 2020, Nature Medicine.

[16]  K. Yuen,et al.  Clinical Characteristics of Coronavirus Disease 2019 in China , 2020, The New England journal of medicine.

[17]  Yan Zhao,et al.  Clinical Characteristics of 138 Hospitalized Patients With 2019 Novel Coronavirus-Infected Pneumonia in Wuhan, China. , 2020, JAMA.

[18]  H. Krumholz,et al.  Extrapulmonary manifestations of COVID-19 , 2020, Nature Medicine.

[19]  Andrew Hunter,et al.  Learnable Stroke Models for Example-based Portrait Painting , 2013, BMVC.

[20]  Y. Hu,et al.  Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China , 2020, The Lancet.