Dynamic gaze-position prediction of saccadic eye movements using a Taylor series

Gaze-contingent displays have been widely used in vision research and virtual reality applications. Due to data transmission, image processing, and display preparation, the time delay between the eye tracker and the monitor update may lead to a misalignment between the eye position and the image manipulation during eye movements. We propose a method to reduce the misalignment using a Taylor series to predict the saccadic eye movement. The proposed method was evaluated using two large datasets including 219,335 human saccades (collected with an EyeLink 1000 system, 95% range from 1° to 32°) and 21,844 monkey saccades (collected with a scleral search coil, 95% range from 1° to 9°). When assuming a 10-ms time delay, the prediction of saccade movements using the proposed method could reduce the misalignment greater than the state-of-the-art methods. The average error was about 0.93° for human saccades and 0.26° for monkey saccades. Our results suggest that this proposed saccade prediction method will create more accurate gaze-contingent displays.

[1]  D. Hubel,et al.  Microsaccadic eye movements and firing of single cells in the striate cortex of macaque monkeys , 2000, Nature Neuroscience.

[2]  Guang-Zhong Yang,et al.  Gaze-Contingent Motor Channelling, haptic constraints and associated cognitive demand for robotic MIS , 2012, Medical Image Anal..

[3]  Andrew T. Duchowski,et al.  Gaze-Contingent Displays: A Review , 2004, Cyberpsychology Behav. Soc. Netw..

[4]  Eric Castet,et al.  Gaze-contingent simulation of retinopathy: Some potential pitfalls and remedies , 2011, Vision Research.

[5]  Eli Peli,et al.  Intrasaccadic Perception , 2001, The Journal of Neuroscience.

[6]  Sharon M. Crook,et al.  Fixational Eye Movement Correction of Blink-Induced Gaze Position Errors , 2014, PloS one.

[7]  R. Baloh,et al.  Quantitative measurement of saccade amplitude, duration, and velocity , 1975, Neurology.

[8]  D. Hubel,et al.  The function of bursts of spikes during visual fixation in the awake primate lateral geniculate nucleus and primary visual cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Zhuanghua Shi,et al.  Invariant spatial context is learned but not retrieved in gaze-contingent tunnel-view search. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[10]  L. Stark,et al.  The trajectories of saccadic eye movements. , 1979, Scientific American.

[11]  Francisco M. Costela,et al.  Characteristics of Spontaneous Square-Wave Jerks in the Healthy Macaque Monkey during Visual Fixation , 2015, PloS one.

[12]  Martina Poletti,et al.  A compact field guide to the study of microsaccades: Challenges and functions , 2016, Vision Research.

[13]  Gang Luo,et al.  Trajectory prediction of saccadic eye movements using a compressed exponential model. , 2013, Journal of vision.

[14]  J. Barton,et al.  The word-length effect in acquired alexia, and real and virtual hemianopia , 2012, Neuropsychologia.

[15]  S. Liversedge,et al.  Saccadic eye movements and cognition , 2000, Trends in Cognitive Sciences.

[16]  S. Reder.  On-line monitoring of eye-position signals in contingent and noncontingent paradigms , 1973 .

[17]  Wilson S. Geisler,et al.  Gaze-contingent real-time simulation of arbitrary visual fields , 2002, IS&T/SPIE Electronic Imaging.

[18]  J. Reynolds,et al.  Temporal Resolution for the Perception of Features and Conjunctions , 2007, The Journal of Neuroscience.

[19]  Lester C. Loschky,et al.  Investigating spatial vision and dynamic attentional selection using a gaze-contingent multiresolutional display. , 2002, Journal of experimental psychology. Applied.

[20]  Wieske van Zoest,et al.  Stimulus-salience and the time-course of saccade trajectory deviations. , 2012, Journal of vision.

[21]  Komogortsev Vladimirovich Oleg.  EYE MOVEMENT PREDICTION BY OCULOMOTOR PLANT MODELING WITH KALMAN FILTER , 2007 .

[22]  Jing Fan,et al.  A Gaze-Contingent Adaptive Virtual Reality Driving Environment for Intervention in Individuals with Autism Spectrum Disorders , 2016, ACM Trans. Interact. Intell. Syst..

[23]  Lester C. Loschky,et al.  Investigating spatial vision and dynamic attentional selection using a gaze-contingent multiresolutional display. , 2002 .

[24]  Daniel R Saunders,et al.  Direct measurement of the system latency of gaze-contingent displays , 2013, Behavior Research Methods.

[25]  Erik D. Reichle,et al.  Eye movements in reading and information processing : , 2015 .

[26]  Michele Rucci,et al.  EyeRIS: A general-purpose system for eye-movement-contingent display control , 2007, Behavior research methods.

[27]  Keith Rayner,et al.  The gaze-contingent moving window in reading: Development and review , 2014 .

[28]  Eric Castet,et al.  Perception of Intra-saccadic Motion , 2009 .

[29]  J. V. Van Gisbergen,et al.  Skewness of saccadic velocity profiles: a unifying parameter for normal and slow saccades. , 1987, Vision research.

[30]  Luke Fletcher,et al.  Driver Inattention Detection based on Eye Gaze—Road Event Correlation , 2009, Int. J. Robotics Res..

[31]  D. Robinson.  A method of measuring eye movement using a scleral coil in a magnetic field , 1963 .

[32]  Wei Zhou,et al.  An updated Time-Optimal 3rd-Order Linear Saccadic Eye Plant Model , 2009, Int. J. Neural Syst..

[33]  Arthur F. Kramer,et al.  Measuring the Useful Field of View During Simulated Driving With Gaze-Contingent Displays , 2016, Hum. Factors.

[34]  R. Remington.  Attention and saccadic eye movements. , 1980, Journal of experimental psychology. Human perception and performance.

[35]  Peter E Pidcoe,et al.  Oculomotor tracking strategy in normal subjects with and without simulated scotoma. , 2006, Investigative ophthalmology & visual science.

[36]  F. Campbell,et al.  Saccadic omission: Why we do not see a grey-out during a saccadic eye movement , 1978, Vision Research.

[37]  Lester C. Loschky,et al.  Perception onset time during fixations in free viewing , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[38]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[39]  Russell L Woods,et al.  Crowdsourcing a Normative Natural Language Dataset: A Comparison of Amazon Mechanical Turk and In-Lab Data Collection , 2013, Journal of medical Internet research.

[40]  E. Castet,et al.  Intrasaccadic perception triggers pupillary constriction , 2015, PeerJ.

[41]  D. Sparks.  The brainstem control of saccadic eye movements , 2002, Nature Reviews Neuroscience.

[42]  Lester C. Loschky,et al.  Gaze-Contingent Multiresolutional Displays: An Integrative Review , 2003, Hum. Factors.

[43]  Guillaume S. Masson,et al.  Motion perception during saccadic eye movements , 2000, Nature Neuroscience.