Analyzing Facial and Eye Movements to Screen for Alzheimer’s Disease

Brain disease can be screened using eye movements. Degenerative brain disorders change eye movement because they affect not only memory and cognition but also the cranial nervous system involved in eye movement. We compared the facial and eye movement patterns of patients with mild Alzheimer’s disease and cognitively normal people to analyze the neurological signs of dementia. After detecting the facial landmarks, the coordinate values for the movements were extracted. We used Spearman’s correlation coefficient to examine associations between horizontal and vertical facial and eye movements. We analyzed the correlation between facial and eye movements without using special eye-tracking equipment or complex conditions in order to measure the behavioral aspect of the natural human gaze. As a result, we found differences between patients with Alzheimer’s disease and cognitively normal people. Patients suffering from Alzheimer’s disease tended to move their face and eyes simultaneously in the vertical direction, whereas the cognitively normal people did not, as confirmed by a Mann–Whitney–Wilcoxon test. Our findings suggest that objective and accurate measurement of facial and eye movements can be used to screen such patients quickly. The use of camera-based testing for the early detection of patients showing signs of neurodegeneration can have a significant impact on the public care of dementia.

[1]  Peter Robinson,et al.  Constrained Local Neural Fields for Robust Facial Landmark Detection in the Wild , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[2]  C Kennard,et al.  Ocular motor abnormalities in neurodegenerative disorders , 2015, Eye.

[3]  Louis-Philippe Morency,et al.  OpenFace 2.0: Facial Behavior Analysis Toolkit , 2018, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[4]  D Kömpf,et al.  Eye movement dysfunction in dementia of the Alzheimer type. , 1995, Dementia.

[5]  B. Miller,et al.  Oculomotor function in frontotemporal lobar degeneration, related disorders and Alzheimer's disease , 2008, Brain : a journal of neurology.

[6]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Francisco Jesús Martínez-Murcia,et al.  Computer Aided Diagnosis tool for Alzheimer's Disease based on Mann-Whitney-Wilcoxon U-Test , 2012, Expert Syst. Appl..

[8]  Abhinav Dhall,et al.  Depression Scale Recognition from Audio, Visual and Text Analysis , 2017, ArXiv.

[9]  M. Downs,et al.  THE ROLE OF GENERAL PRACTICE AND THE PRIMARY CARE TEAM IN DEMENTIA DIAGNOSIS AND MANAGEMENT , 1996 .

[10]  A. Reeves,et al.  Attentional release in the saccadic gap effect , 2009, Vision Research.

[11]  Hans-Werner Gellersen,et al.  Monitoring dementia with automatic eye movements analysis , 2016 .

[12]  Joan Y. Chiao,et al.  Eye movements during emotion recognition in faces. , 2014, Journal of vision.

[13]  Dag Aarsland,et al.  Cognitive impairment in Parkinson's disease and dementia with Lewy bodies. , 2016, Parkinsonism & related disorders.

[14]  Yifei Lu,et al.  Combining Eye Movements and EEG to Enhance Emotion Recognition , 2015, IJCAI.

[15]  M. Kimble,et al.  Eye tracking and visual attention to threating stimuli in veterans of the Iraq war. , 2010, Journal of anxiety disorders.

[16]  Sandra P Marshall,et al.  Identifying cognitive state from eye metrics. , 2007, Aviation, space, and environmental medicine.

[17]  Jennine Kirby,et al.  Visual Impairment and Dysfunction in Combat-Injured Servicemembers With Traumatic Brain Injury , 2009, Optometry and vision science : official publication of the American Academy of Optometry.

[18]  Brian P. Bailey,et al.  Categories & Subject Descriptors: H.5.2 [Information , 2022 .

[19]  Molly McNett,et al.  The Pupillary Response in Traumatic Brain Injury: A Guide for Trauma Nurses , 2007, Journal of trauma nursing : the official journal of the Society of Trauma Nurses.

[20]  S. Nakaji,et al.  Position related analysis of the appearance of and relationship between post-match physical and mental fatigue in university rugby football players , 2004, British Journal of Sports Medicine.

[21]  H. Lilliefors On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown , 1967 .

[22]  S. Lal,et al.  Stability of exploratory eye movements as a marker of schizophrenia — a WHO multi-center study , 2001, Schizophrenia Research.

[23]  B L Miller,et al.  Patterns of brain atrophy in frontotemporal dementia and semantic dementia , 2002, Neurology.

[24]  M. Mesulam,et al.  Impairment of spatially directed attention in patients with probable Alzheimer's disease as measured by eye movements. , 1994, Archives of neurology.

[25]  Louis-Philippe Morency,et al.  Convolutional Experts Constrained Local Model for 3D Facial Landmark Detection , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[26]  E. Hess,et al.  Pupil Size in Relation to Mental Activity during Simple Problem-Solving , 1964, Science.

[27]  B. Winblad,et al.  The worldwide costs of dementia 2015 and comparisons with 2010 , 2017, Alzheimer's & Dementia.

[28]  J. Cohen-Mansfield,et al.  Self-identity in older persons suffering from dementia: preliminary results. , 2000, Social science & medicine.

[29]  Peter Robinson,et al.  Rendering of Eyes for Eye-Shape Registration and Gaze Estimation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[30]  Philippe R Goldin,et al.  "Fear guides the eyes of the beholder": Assessing gaze avoidance in social anxiety disorder via covert eye tracking of dynamic social stimuli. , 2019, Journal of anxiety disorders.

[31]  Jason L. Powell,et al.  The Power of Global Aging , 2018 .

[32]  M. Folstein,et al.  Clinical diagnosis of Alzheimer's disease: Report of the NINCDS—ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer's Disease , 2011, Neurology.

[33]  Chunming Rong,et al.  Using Spearman's correlation coefficients for exploratory data analysis on big dataset , 2015, Concurr. Comput. Pract. Exp..

[34]  David R Williams,et al.  Progressive supranuclear palsy: clinicopathological concepts and diagnostic challenges , 2009, The Lancet Neurology.

[35]  J. Felblinger,et al.  Saccadic eye movement changes in Parkinson's disease dementia and dementia with Lewy bodies. , 2005, Brain : a journal of neurology.

[36]  Lars Kuchinke,et al.  Pupillary responses in art appreciation: Effects of aesthetic emotions , 2009 .

[37]  E. Granholm,et al.  Pupillary responses as a biomarker of early risk for Alzheimer’s disease: Association with tau not beta‐amyloid , 2021, Journal of Alzheimer's disease : JAD.