Web Camera Based Eye Tracking to Assess Visual Memory on a Visual Paired Comparison Task

Background: Web cameras are increasingly part of the standard hardware of most smart devices. Eye movements can often provide a noninvasive “window on the brain,” and the recording of eye movements using web cameras is a burgeoning area of research. Objective: This study investigated a novel methodology for administering a visual paired comparison (VPC) decisional task using a web camera.To further assess this method, we examined the correlation between a standard eye-tracking camera automated scoring procedure [obtaining images at 60 frames per second (FPS)] and a manually scored procedure using a built-in laptop web camera (obtaining images at 3 FPS). Methods: This was an observational study of 54 clinically normal older adults.Subjects completed three in-clinic visits with simultaneous recording of eye movements on a VPC decision task by a standard eye tracker camera and a built-in laptop-based web camera. Inter-rater reliability was analyzed using Siegel and Castellan's kappa formula. Pearson correlations were used to investigate the correlation between VPC performance using a standard eye tracker camera and a built-in web camera. Results: Strong associations were observed on VPC mean novelty preference score between the 60 FPS eye tracker and 3 FPS built-in web camera at each of the three visits (r = 0.88–0.92). Inter-rater agreement of web camera scoring at each time point was high (κ = 0.81–0.88). There were strong relationships on VPC mean novelty preference score between 10, 5, and 3 FPS training sets (r = 0.88–0.94). Significantly fewer data quality issues were encountered using the built-in web camera. Conclusions: Human scoring of a VPC decisional task using a built-in laptop web camera correlated strongly with automated scoring of the same task using a standard high frame rate eye tracker camera.While this method is not suitable for eye tracking paradigms requiring the collection and analysis of fine-grained metrics, such as fixation points, built-in web cameras are a standard feature of most smart devices (e.g., laptops, tablets, smart phones) and can be effectively employed to track eye movements on decisional tasks with high accuracy and minimal cost.

[1]  S. Zola,et al.  A Behavioral Task Predicts Conversion to Mild Cognitive Impairment and Alzheimer’s Disease , 2013, American journal of Alzheimer's disease and other dementias.

[2]  J. Bachevalier,et al.  Limbic-dependent recognition memory in monkeys develops early in infancy. , 1993, Neuroreport.

[3]  K. Swartz,et al.  Visual recognition in infant pigtailed macaques after a 24‐hour delay , 1985, American journal of primatology.

[4]  Diederick C. Niehorster,et al.  What to expect from your remote eye-tracker when participants are unrestrained , 2017, Behavior Research Methods.

[5]  Dan Witzner Hansen,et al.  Eye tracking in the wild , 2005, Comput. Vis. Image Underst..

[6]  Nicola C. Anderson,et al.  Exploiting human sensitivity to gaze for tracking the eyes , 2011, Behavior research methods.

[7]  Theodoros Giannakopoulos,et al.  Unobtrusive Low Cost Pupil Size Measurements using Web cameras , 2013, ArXiv.

[8]  Jian-Gang Wang,et al.  Gaze determination via images of irises , 2001, Image Vis. Comput..

[9]  J. Hirsch,et al.  Automatic stimulus presentation for the proboscis extension reflex in diptera , 1983 .

[10]  O. Pascalis,et al.  Long-Term Recognition Memory for Faces Assessed by Visual Paired Comparison in 3- and 6-Month-Old Infants , 1998 .

[11]  G. Sackett,et al.  Development of Pattern Recognition in Infant Pigtailed Macaques (Macaca nemestrina). , 1984 .

[12]  Eugene Agichtein,et al.  Detecting cognitive impairment by eye movement analysis using automatic classification algorithms , 2011, Journal of Neuroscience Methods.

[13]  Yogesan Kanagasingam,et al.  Innovative diagnostic tools for early detection of Alzheimer's disease , 2015, Alzheimer's & Dementia.

[14]  Yu-Tzu Lin,et al.  Real-time eye-gaze estimation using a low-resolution webcam , 2012, Multimedia Tools and Applications.

[15]  Beatriz Remeseiro,et al.  Directional Gaze Analysis in Webcam Video Sequences , 2010, ICIAR.

[16]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[17]  R. L. Fantz.  Visual Experience in Infants: Decreased Attention to Familiar Patterns Relative to Novel Ones , 1964, Science.

[18]  L. Squire,et al.  The visual paired-comparison task as a measure of declarative memory. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[19]  R. Clark,et al.  Impaired Recognition Memory in Monkeys after Damage Limited to the Hippocampal Region , 2000, The Journal of Neuroscience.

[20]  S. Amado,et al.  Comparison of change detection performance and visual search patterns among children with/without ADHD: Evidence from eye movements. , 2016, Research in developmental disabilities.

[21]  J. Fagan.  Memory in the infant. , 1970, Journal of experimental child psychology.

[22]  Kevin A Hallgren,et al.  Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial. , 2012, Tutorials in quantitative methods for psychology.

[23]  V. Pankratz,et al.  Validation of the Telephone Interview for Cognitive Status-modified in Subjects with Normal Cognition, Mild Cognitive Impairment, or Dementia , 2009, Neuroepidemiology.

[24]  Thomas Armstrong,et al.  DWELLING ON POTENTIAL THREAT CUES: AN EYE MOVEMENT MARKER FOR COMBAT‐RELATED PTSD , 2013, Depression and anxiety.

[25]  Wojciech Matusik,et al.  Eye Tracking for Everyone , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  M. D. Crutcher,et al.  Eye Tracking During a Visual Paired Comparison Task as a Predictor of Early Dementia , 2009, American journal of Alzheimer's disease and other dementias.

[27]  M. Rinck,et al.  Shorter gaze duration for happy faces in current but not remitted depression: Evidence from eye movements , 2014, Psychiatry Research.