Looking at Breakout: Urgency and predictability direct eye events

We investigated the organization of eye-movement classes in a natural and dynamical setup. To mimic the goals and objectives of the natural world in a controlled environment, we studied eye-movements while participants played Breakout, an old Atari game which remains surprisingly entertaining, often addictive, in spite of its graphic and structural simplicity. Our results show that eye-movement dynamics can be explained in terms of simple principles of moments of prediction and urgency of action. We observed a consistent anticipatory behavior (gaze was directed ahead of ball trajectory) except during the moment in which the ball bounced either in the walls, or in the paddle. At these moments, we observed a refractory period during which there are no blinks and saccades. Saccade delay caused the gaze to fall behind the ball. This pattern is consistent with a model by which participants postpone saccades at the bounces while predicting the ball trajectory and subsequently make a catch-up saccade directed to a position which anticipates ball trajectory. During bounces, trajectories were smooth and curved interpolating the V-shape function of the ball with minimal acceleration. These results pave the path to understand the taxonomy of eye-movements on natural configurations in which stimuli and goals switch dynamically in time.

[1]  Ralf Engbert,et al.  Tracking the mind during reading: the influence of past, present, and future words on fixation durations. , 2006, Journal of experimental psychology. General.

[2]  D. Robinson The mechanics of human smooth pursuit eye movement. , 1965, The Journal of physiology.

[3]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  宇野 洋二,et al.  Formation and control of optimal trajectory in human multijoint arm movement : minimum torque-change model , 1988 .

[5]  Daniel M. Wolpert,et al.  The Main Sequence of Saccades Optimizes Speed-accuracy Trade-off , 2006, Biological Cybernetics.

[6]  Lawrence K. Cormack,et al.  The effect of plaid orientation on pursuit of partially-predictable motion , 2010 .

[7]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[8]  M. Hayhoe,et al.  In what ways do eye movements contribute to everyday activities? , 2001, Vision Research.

[9]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[10]  D. Robinson,et al.  The upper limit of human smooth pursuit velocity , 1985, Vision Research.

[11]  D H Fender,et al.  Recognition of component differences in two-dimensional oculomotor tracking tasks. , 1973, Vision research.

[12]  G. Barnes,et al.  The mechanism of prediction in human smooth pursuit eye movements. , 1991, The Journal of physiology.

[13]  Casper J. Erkelens,et al.  Coordination of smooth pursuit and saccades , 2006, Vision Research.

[14]  D. Burr,et al.  Selective suppression of the magnocellular visual pathway during saccadic eye movements , 1994, Nature.

[15]  Michael F. Land,et al.  From eye movements to actions: how batsmen hit the ball , 2000, Nature Neuroscience.

[16]  Jeffrey S. Perry,et al.  Visual search: the role of peripheral information measured using gaze-contingent displays. , 2006, Journal of vision.

[17]  A. Terry Bahill,et al.  Smooth pursuit eye movements in response to predictable target motions , 1983, Vision Research.

[18]  J. Pelz,et al.  Oculomotor behavior and perceptual strategies in complex tasks , 2001, Vision Research.

[19]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[20]  K. Rayner,et al.  Eye Movements in Reading: Perceptual and Language Processes , 1985 .

[21]  G. Barnes,et al.  Cognitive processes involved in smooth pursuit eye movements , 2008, Brain and Cognition.

[22]  D. Wolpert,et al.  Motor learning , 2010, Current Biology.

[23]  Hrishikesh M. Rao,et al.  Incorporating Prediction in Models for Two-Dimensional Smooth Pursuit , 2010, PloS one.

[24]  Erhardt Barth,et al.  Gaze beats mouse: A case study on a gaze-controlled breakout , 2009, PsychNology J..

[25]  Bruce Bridgeman,et al.  Failure to detect displacement of the visual world during saccadic eye movements , 1975, Vision Research.

[26]  S. Bartley Perceptual and Motor Skills, 1982,55, 122. @ Perceptual and Motor Skills 1982 , 1982 .

[27]  Miguel P Eckstein,et al.  Attentional Cues in Real Scenes, Saccadic Targeting, and Bayesian Priors , 2005, Psychological science.

[28]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[29]  Tadahiko Fukuda,et al.  Visual Search Strategies of Baseball Batters: Eye Movements during the Preparatory Phase of Batting , 2002, Perceptual and motor skills.

[30]  A. Buizza,et al.  Velocity characteristics of smooth pursuit eye movements to different patterns of target motion , 2004, Experimental Brain Research.

[31]  M. Sigman,et al.  The neural code for written words: a proposal , 2005, Trends in Cognitive Sciences.

[32]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[33]  M. Missal,et al.  What triggers catch-up saccades during visual tracking? , 2002, Journal of Neurophysiology.

[34]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[35]  Jiri Najemnik,et al.  Eye movement statistics in humans are consistent with an optimal search strategy. , 2008, Journal of vision.

[36]  C. Rashbass,et al.  The relationship between saccadic and smooth tracking eye movements , 1961, The Journal of physiology.

[37]  M. Land Eye movements and the control of actions in everyday life , 2006, Progress in Retinal and Eye Research.

[38]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[39]  Kimihiro Inomata,et al.  Visual Search Strategies and Decision Making in Baseball Batting , 2009, Perceptual and motor skills.

[40]  Rajiv Ranganathan,et al.  Perception-Action Coupling and Anticipatory Performance in Baseball Batting , 2007, Journal of motor behavior.

[41]  N. Hogan An organizing principle for a class of voluntary movements , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[42]  Laurent Itti,et al.  An Integrated Model of Top-Down and Bottom-Up Attention for Optimizing Detection Speed , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[43]  Dennis R. Proffitt,et al.  Within striking distance: Task efficacy influences perceived size and distance , 2010 .

[44]  M F Land,et al.  The knowledge base of the oculomotor system. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[45]  D Regan,et al.  Visual factors in hitting and catching. , 1997, Journal of sports sciences.

[46]  H. Basford,et al.  Optimal eye movement strategies in visual search , 2005 .

[47]  D. Ringach,et al.  Dynamics of smooth pursuit maintenance. , 2009, Journal of neurophysiology.

[48]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[49]  L. Carney,et al.  THE NATURE OF NORMAL BLINKING PATTERNS , 1982, Acta ophthalmologica.

[50]  Jean-Jacques Orban de Xivry,et al.  Saccades and pursuit: two outcomes of a single sensorimotor process , 2007, The Journal of physiology.

[51]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.