Measuring Saccade Latency Using Smartphone Cameras

Objective: Accurate quantification of neurodegenerative disease progression is an ongoing challenge that complicates efforts to understand and treat these conditions. Clinical studies have shown that eye movement features may serve as objective biomarkers to support diagnosis and tracking of disease progression. Here, we demonstrate that saccade latency—an eye movement measure of reaction time—can be measured robustly outside of the clinical environment with a smartphone camera. Methods: To enable tracking of saccade latency in large cohorts of patients and control subjects, we combined a deep convolutional neural network for gaze estimation with a model-based approach for saccade onset determination that provides automated signal-quality quantification and artifact rejection. Results: Simultaneous recordings with a smartphone and a high-speed camera resulted in negligible differences in saccade latency distributions. Furthermore, we demonstrated that the constraint of chinrest support can be removed when recording healthy subjects. Repeat smartphone-based measurements of saccade latency in 11 self-reported healthy subjects resulted in an intraclass correlation coefficient of 0.76, showing our approach has good to excellent test–retest reliability. Additionally, we conducted more than 19 000 saccade latency measurements in 29 self-reported healthy subjects and observed significant intra- and inter-subject variability, which highlights the importance of individualized tracking. Lastly, we showed that with around 65 measurements we can estimate mean saccade latency to within less-than-10-ms precision, which takes within 4 min with our setup. Conclusion and Significance: By enabling repeat measurements of saccade latency and its distribution in individual subjects, our framework opens the possibility of quantifying patient state on a finer timescale in a broader population than previously possible.

[1]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[2]  Lee H. Schwamm,et al.  Teleneurology and mobile technologies: the future of neurological care , 2018, Nature Reviews Neurology.

[3]  A. Siderowf,et al.  Validity of the MoCA and MMSE in the detection of MCI and dementia in Parkinson disease , 2009, Neurology.

[4]  Christopher Kennard,et al.  Eye-tracking in amyotrophic lateral sclerosis: A longitudinal study of saccadic and cognitive tasks , 2016, Amyotrophic lateral sclerosis & frontotemporal degeneration.

[5]  Keith S. Karn,et al.  Commentary on Section 4. Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. , 2003 .

[6]  Philip D. Harvey,et al.  Performance-based and Observational Assessments in Clinical Trials Across the Alzheimer's Disease Spectrum. , 2017, Innovations in clinical neuroscience.

[7]  Philip D. Harvey,et al.  Outcomes Assessment in Clinical Trials of Alzheimer's Disease and its Precursors: Readying for Short-term and Long-term Clinical Trial Needs. , 2017, Innovations in clinical neuroscience.

[8]  R. Yee,et al.  Test-retest reliability of saccadic measures in subjects at risk for Huntington disease. , 2009, Investigative ophthalmology & visual science.

[9]  P. Knox,et al.  Express saccades in distinct populations: east, west, and in-between , 2017, Experimental Brain Research.

[10]  Magali Seassau,et al.  Prodromal Alzheimer's Disease Demonstrates Increased Errors at a Simple and Automated Anti-Saccade Task. , 2018, Journal of Alzheimer's disease : JAD.

[11]  Wojciech Matusik,et al.  Eye Tracking for Everyone , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  R. Carpenter,et al.  Huntington’s disease: changes in saccades and hand-tapping over 3 years , 2010, Journal of Neurology.

[13]  Peter M. Corcoran,et al.  Real-time eye gaze tracking for gaming design and consumer electronics systems , 2012, IEEE Transactions on Consumer Electronics.

[14]  M Vidailhet,et al.  Mixing pro- and antisaccades in patients with parkinsonian syndromes. , 2006, Brain : a journal of neurology.

[15]  C. Masters,et al.  Spectrum of saccade system function in Alzheimer disease. , 2003, Archives of neurology.

[16]  David J. Mack,et al.  The effect of sampling rate and lowpass filters on saccades – A modeling approach , 2017, Behavior Research Methods.

[17]  Christine T. O. Nguyen,et al.  The Eye As a Biomarker for Alzheimer's Disease , 2016, Frontiers in neuroscience.

[18]  R. John Leigh,et al.  The Saccadic System , 2015 .

[19]  T. Crawford,et al.  Inhibitory control of saccadic eye movements and cognitive impairment in Alzheimer’s disease , 2005, Biological Psychiatry.

[20]  T. Anderson,et al.  Eye movements in patients with neurodegenerative disorders , 2013, Nature Reviews Neurology.

[21]  Päivi Majaranta,et al.  Eye Tracking and Eye-Based Human–Computer Interaction , 2014 .

[22]  Philip C. Ko,et al.  Eye movements in Alzheimer's disease. , 2015, Journal of Alzheimer's disease : JAD.

[23]  J. Weir Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. , 2005, Journal of strength and conditioning research.

[24]  J. Felblinger,et al.  Saccadic eye movement changes in Parkinson's disease dementia and dementia with Lewy bodies. , 2005, Brain : a journal of neurology.

[25]  N. Smyrnis,et al.  Variability in the decision process leading to saccades: a specific marker for schizophrenia? , 2014, Psychophysiology.

[26]  Qiong Huang,et al.  TabletGaze: dataset and analysis for unconstrained appearance-based gaze estimation in mobile tablets , 2017, Machine Vision and Applications.

[27]  Vivienne Sze,et al.  Determination of Saccade Latency Distributions using Video Recordings from Consumer-grade Devices , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[28]  Willem J. van der Linden,et al.  A lognormal model for response times on test items , 2006 .

[29]  Jeff Miller,et al.  Information processing models generating lognormally distributed reaction times , 1993 .

[30]  A. Mitchell,et al.  A meta-analysis of the accuracy of the mini-mental state examination in the detection of dementia and mild cognitive impairment. , 2009, Journal of psychiatric research.

[31]  R. Carpenter,et al.  Saccadic latency in Parkinson's disease correlates with executive function and brain atrophy, but not motor severity , 2011, Neurobiology of Disease.

[32]  M. Yassuda,et al.  Mini-mental State Examination performance in mild cognitive impairment subtypes , 2007, International Psychogeriatrics.

[33]  A. Radant,et al.  Human oculomotor function: Reliability and diurnal variation , 1995, Biological Psychiatry.

[34]  B. Gaymard,et al.  Eye movement disorders after frontal eye field lesions in humans , 2004, Experimental Brain Research.

[35]  E. Růžička,et al.  Eye movements in idiopathic rapid eye movement sleep behaviour disorder: High antisaccade error rate reflects prefrontal cortex dysfunction , 2018, Journal of sleep research.

[36]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[37]  E. Dorsey,et al.  The First Frontier: Digital Biomarkers for Neurodegenerative Disorders , 2017, Digital Biomarkers.

[38]  Robert J. K. Jacob,et al.  Eye tracking in human-computer interaction and usability research : Ready to deliver the promises , 2002 .

[39]  Albert F. Fuchs,et al.  THE SACCADIC SYSTEM , 1971 .

[40]  D. Cicchetti Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment Instruments in Psychology. , 1994 .

[41]  Nick C Fox,et al.  Biological and clinical manifestations of Huntington's disease in the longitudinal TRACK-HD study: cross-sectional analysis of baseline data , 2009, The Lancet Neurology.

[42]  C. Pierrot-Deseilligny,et al.  Decisional role of the dorsolateral prefrontal cortex in ocular motor behaviour. , 2003, Brain : a journal of neurology.

[43]  Charles Sodini,et al.  Enabling Saccade Latency Measurements with Consumer-Grade Cameras , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[44]  R. Petersen,et al.  Rapidly progressive neurodegenerative dementias. , 2009, Archives of neurology.

[45]  Steve Higham,et al.  The disengagement of visual attention in Alzheimer's disease: a longitudinal eye-tracking study , 2015, Front. Aging Neurosci..

[46]  Qiong Huang,et al.  TabletGaze: A Dataset and Baseline Algorithms for Unconstrained Appearance-based Gaze Estimation in Mobile Tablets , 2015, ArXiv.

[47]  B. Miller,et al.  Antisaccade task reflects cortical involvement in mild cognitive impairment , 2013, Neurology.

[48]  Mario Fritz,et al.  It’s Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[49]  B. Gaymard,et al.  Eye Movements in Ephedrone-Induced Parkinsonism , 2014, PloS one.

[50]  Evžen Růžička,et al.  Automated analysis of connected speech reveals early biomarkers of Parkinson’s disease in patients with rapid eye movement sleep behaviour disorder , 2017, Scientific Reports.

[51]  N. Smyrnis,et al.  Increased intra-subject reaction time variability in the volitional control of movement in schizophrenia , 2014, Psychiatry Research.

[52]  Andreas Bulling,et al.  EyeTab: model-based gaze estimation on unmodified tablet computers , 2014, ETRA.

[53]  B. Miller,et al.  Saccade abnormalities in autopsy-confirmed frontotemporal lobar degeneration and Alzheimer disease. , 2012, Archives of neurology.

[54]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[55]  B. Miller,et al.  Oculomotor function in frontotemporal lobar degeneration, related disorders and Alzheimer's disease , 2008, Brain : a journal of neurology.