Monitoring dementia with automatic eye movements analysis

Eye movement patterns are found to reveal human cognitive and mental states that can not be easily measured by other biological signals. With the rapid development of eye tracking technologies, there are growing interests in analysing gaze data to infer information about people’ cognitive states, tasks and activities performed in naturalistic environments. In this paper, we investigate the link between eye movements and cognitive function. We conducted experiments to record subject’s eye movements during video watching. By using computational methods, we identified eye movement features that are correlated to people’s cognitive health measures obtained through the standard cognitive tests. Our results show that it is possible to infer people’s cognitive function by analysing natural gaze behaviour. This work contributes an initial understanding of monitoring cognitive deterioration and dementia with automatic eye movement analysis.

[1]  T. Crawford,et al.  Inhibitory control of saccadic eye movements and cognitive impairment in Alzheimer’s disease , 2005, Biological Psychiatry.

[2]  T. Anderson,et al.  Eye movements in patients with neurodegenerative disorders , 2013, Nature Reviews Neurology.

[3]  L. Itti,et al.  Defending Yarbus: eye movements reveal observers' task. , 2014, Journal of vision.

[4]  P. Benson,et al.  Simple Viewing Tests Can Detect Eye Movement Abnormalities That Distinguish Schizophrenia Cases from Controls with Exceptional Accuracy , 2012, Biological Psychiatry.

[5]  Roman Bednarik,et al.  What do you want to do next: a novel approach for intent prediction in gaze-based interaction , 2012, ETRA.

[6]  Cristina Conati,et al.  Inferring Visualization Task Properties, User Performance, and User Cognitive Abilities from Eye Gaze Data , 2014, ACM Trans. Interact. Intell. Syst..

[7]  Haogang Zhu,et al.  What's on TV? Detecting age-related neurodegenerative eye disease using eye movement scanpaths , 2014, Front. Aging Neurosci..

[8]  H. Buschke,et al.  Genuine memory deficits in dementia , 1987 .

[9]  R. Schleicher,et al.  Blinks and saccades as indicators of fatigue in sleepiness warners: looking tired? , 2022 .

[10]  J. Cummings,et al.  The Montreal Cognitive Assessment, MoCA: A Brief Screening Tool For Mild Cognitive Impairment , 2005, Journal of the American Geriatrics Society.

[11]  H. Jimison,et al.  Monitoring Computer Interactions to Detect Early Cognitive Impairment in Elders , 2006, 1st Transdisciplinary Conference on Distributed Diagnosis and Home Healthcare, 2006. D2H2..

[12]  Rebekka S. Renner,et al.  Saccadic peak velocity sensitivity to variations in mental workload. , 2010, Aviation, space, and environmental medicine.

[13]  Steve Higham,et al.  The role of working memory and attentional disengagement on inhibitory control: effects of aging and Alzheimer's disease , 2012, AGE.

[14]  Minho Lee,et al.  Recognition of Human's Implicit Intention Based on an Eyeball Movement Pattern Analysis , 2011, ICONIP.

[15]  John M. Henderson,et al.  Predicting Cognitive State from Eye Movements , 2013, PloS one.

[16]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[17]  Gerhard Tröster,et al.  What's in the Eyes for Context-Awareness? , 2011, IEEE Pervasive Computing.

[18]  L. Itti,et al.  High-throughput classification of clinical populations from natural viewing eye movements , 2012, Journal of Neurology.

[19]  J. Henderson,et al.  Classifying mental states from eye movements during scene viewing. , 2015, Journal of experimental psychology. Human perception and performance.

[20]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.