Pathological facial weakness detection using computational image analysis

Stroke is the leading cause of disability in the U.S. Early recognition and treatment of stroke decreases the mortality and possibility of severe injury. One prominent stroke symptom is facial weakness. Existing methods such as telestroke systems, which require complex configuration including a tablet, a dedicated video conference system, 4G wireless connection, and a standby clinical support team for diagnosis, are far from widely practical use. In this pilot study, we present an automatic pathological facial weakness detection tool based on computational image analysis. The proposed system is able to extract the facial landmarks and classify facial weakness using a learning method. In the experiment, each image in the dataset is scored independently by two senior neurology residents. Only images rated concordantly by both raters as likely normal or likely abnormal (including left facial weakness and right facial weakness) were included for analysis. Our method performed with overall accuracy of 94.5%, precision of 94.8%, sensitivity of 94.6%, and specificity of 96.8%. The experimental result indicates that our method is able to identify pathological facial weakness accurately on the static images.

[1]  Yilin Mo,et al.  Penalized Fisher discriminant analysis and its application to image-based morphometry , 2011, Pattern Recognit. Lett..

[2]  Monty Silverdale,et al.  Facial Behaviour Analysis in Parkinson's Disease , 2016, MIAR.

[3]  Virginia M. Roberts,et al.  Hospital prenotification of stroke patients by emergency medical services improves stroke time targets. , 2013, Journal of stroke and cerebrovascular diseases : the official journal of National Stroke Association.

[4]  Marc Quinlan,et al.  Time to Treatment with Intravenous Tissue Plasminogen Activator and Outcome from Acute Ischemic Stroke , 2013 .

[5]  Hua Yu,et al.  A direct LDA algorithm for high-dimensional data - with application to face recognition , 2001, Pattern Recognit..

[6]  A. R. Porras,et al.  22q11.2 deletion syndrome in diverse populations , 2017, American journal of medical genetics. Part A.

[7]  Manal Abdel Wahed,et al.  Quantifying facial paralysis using the kinect v2 , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Gregory H. Gilbert,et al.  Acute Stroke: Current Evidence-based Recommendations for Prehospital Care , 2016, The western journal of emergency medicine.

[9]  Josephine Sullivan,et al.  One millisecond face alignment with an ensemble of regression trees , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Timothy L McMurry,et al.  Mobile Telestroke During Ambulance Transport Is Feasible in a Rural EMS Setting: The iTREAT Study. , 2016, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[11]  M. B. Stegmann,et al.  A Brief Introduction to Statistical Shape Analysis , 2002 .

[12]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[13]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).