Augmenting Dementia Cognitive Assessment With Instruction-Less Eye-Tracking Tests

Eye-tracking technology is an innovative tool that holds promise for enhancing dementia screening. In this work, we introduce a novel way of extracting salient features directly from the raw eye-tracking data of a mixed sample of dementia patients during a novel instruction-less cognitive test. Our approach is based on self-supervised representation learning where, by training initially a deep neural network to solve a pretext task using well-defined available labels (e.g. recognising distinct cognitive activities in healthy individuals), the network encodes high-level semantic information which is useful for solving other problems of interest (e.g. dementia classification). Inspired by previous work in explainable AI, we use the Layer-wise Relevance Propagation (LRP) technique to describe our network's decisions in differentiating between the distinct cognitive activities. The extent to which eye-tracking features of dementia patients deviate from healthy behaviour is then explored, followed by a comparison between self-supervised and handcrafted representations on discriminating between participants with and without dementia. Our findings not only reveal novel self-supervised learning features that are more sensitive than handcrafted features in detecting performance differences between participants with and without dementia across a variety of tasks, but also validate that instruction-less eye-tracking tests can detect oculomotor biomarkers of dementia-related cognitive dysfunction. This work highlights the contribution of self-supervised representation learning techniques in biomedical applications where the small number of patients, the non-homogenous presentations of the disease and the complexity of the setting can be a challenge using state-of-the-art feature extraction methods.

[1]  Philip C. Ko,et al.  Eye movements in Alzheimer's disease. , 2015, Journal of Alzheimer's disease : JAD.

[2]  Gerhard Tröster,et al.  Eye Movement Analysis for Activity Recognition Using Electrooculography , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Nick C. Fox,et al.  Eyetracking Metrics in Young Onset Alzheimer’s Disease: A Window into Cognitive Visual Functions , 2017, Front. Neurol..

[4]  Alexander Binder,et al.  On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation , 2015, PloS one.

[5]  Dana Kulic,et al.  Data augmentation of wearable sensor data for parkinson’s disease monitoring using convolutional neural networks , 2017, ICMI.

[6]  Paolo Favaro,et al.  Representation Learning by Learning to Count , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[7]  U. Rajendra Acharya,et al.  Deep learning for healthcare applications based on physiological signals: A review , 2018, Comput. Methods Programs Biomed..

[8]  R. Morishita,et al.  Novel Method for Rapid Assessment of Cognitive Impairment Using High-Performance Eye-Tracking Technology , 2019, Scientific Reports.

[9]  M C Morris,et al.  Methodological issues in the study of cognitive decline. , 1999, American journal of epidemiology.

[10]  S. Zeger,et al.  Longitudinal data analysis using generalized linear models , 1986 .

[11]  Kenneth Holmqvist,et al.  gazeNet: End-to-end eye-movement event detection with deep neural networks , 2018, Behavior Research Methods.

[12]  Enrique Onieva,et al.  Multi-head CNN-RNN for multi-time series anomaly detection: An industrial case study , 2019, Neurocomputing.

[13]  Nicholas C. Firth,et al.  Eyetracking metrics reveal impaired spatial anticipation in behavioural variant frontotemporal dementia , 2017, Neuropsychologia.

[14]  Guang-Zhong Yang,et al.  Deep learning for human activity recognition: A resource efficient implementation on low-power devices , 2016, 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[15]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[17]  T. Loetscher,et al.  Eye Movements During Everyday Behavior Predict Personality Traits , 2018, Front. Hum. Neurosci..

[18]  M. Hornberger,et al.  Eye tracking – The overlooked method to measure cognition in neurodegeneration? , 2019, Neuropsychologia.

[19]  Keir X X Yong,et al.  Reduced modulation of scanpaths in response to task demands in posterior cortical atrophy , 2015, Neuropsychologia.

[20]  T. Anderson,et al.  Eye movements in patients with neurodegenerative disorders , 2013, Nature Reviews Neurology.

[21]  Timo Grimmer,et al.  Mapping scores onto stages: mini-mental state examination and clinical dementia rating. , 2006, The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry.

[22]  C. Kennard,et al.  The role of visual salience in directing eye movements in visual object agnosia , 2009, Current Biology.

[23]  D. Montaldi,et al.  The pupillary response discriminates between subjective and objective familiarity and novelty , 2015, Psychophysiology.

[24]  Mohammad Reza Daliri,et al.  Investigation of eye movement pattern parameters of individuals with different fluid intelligence , 2018, Experimental Brain Research.

[25]  Guang-Zhong Yang,et al.  Deep Learning for Health Informatics , 2017, IEEE Journal of Biomedical and Health Informatics.