Ocular tracking of occluded ballistic trajectories: Effects of visual context and of target law of motion.

In tracking a moving target, the visual context may provide cues for an observer to interpret the causal nature of the target motion and extract features to which the visual system is weakly sensitive, such as target acceleration. This information could be critical when vision of the target is temporarily impeded, requiring visual motion extrapolation processes. Here we investigated how visual context influences ocular tracking of motion either congruent or not with natural gravity. To this end, 28 subjects tracked computer-simulated ballistic trajectories either perturbed in the descending segment with altered gravity effects (0g/2g) or retaining natural-like motion (1g). Shortly after the perturbation (550 ms), targets disappeared for either 450 or 650 ms and became visible again until landing. Target motion occurred with either quasi-realistic pictorial cues or a uniform background, presented in counterbalanced order. We analyzed saccadic and pursuit movements after 0g and 2g target-motion perturbations and for corresponding intervals of unperturbed 1g trajectories, as well as after corresponding occlusions. Moreover, we considered the eye-to-target distance at target reappearance. Tracking parameters differed significantly between scenarios: With a neutral background, eye movements did not depend consistently on target motion, whereas with pictorial background they showed significant dependence, denoting better tracking of accelerated targets. These results suggest that oculomotor control is tuned to realistic properties of the visual scene.

[1]  A. Clarke,et al.  Listing's plane and the otolith-mediated gravity vector. , 2008, Progress in brain research.

[2]  Nicole David,et al.  The right temporoparietal junction plays a causal role in maintaining the internal representation of verticality. , 2015, Journal of neurophysiology.

[3]  Miriam Spering,et al.  Eye movement accuracy determines natural interception strategies. , 2016, Journal of vision.

[4]  Francesco Lacquaniti,et al.  Contributions of the Human Temporoparietal Junction and MT/V5+ to the Timing of Interception Revealed by Transcranial Magnetic Stimulation , 2008, The Journal of Neuroscience.

[5]  R. Krauzlis,et al.  Effects of learning on smooth pursuit during transient disappearance of a visual target. , 2003, Journal of neurophysiology.

[6]  Eileen Kowler,et al.  The effect of expectations on slow oculomotor control—IV. Anticipatory smooth eye movements depend on prior target motions , 1984, Vision Research.

[7]  K. Hoffmann,et al.  The influence of stationary and moving textured backgrounds on smooth-pursuit initiation and steady state pursuit in humans , 1997, Experimental Brain Research.

[8]  H. Bekkering,et al.  Gaze anchoring to a pointing target is present during the entire pointing movement and is driven by a non-visual signal. , 2001, Journal of neurophysiology.

[9]  Wael El-Deredy,et al.  Tracking visible and occluded targets: Changes in event related potentials during motion extrapolation , 2009, Neuropsychologia.

[10]  Richard Apps,et al.  An internal model of a moving visual target in the lateral cerebellum , 2009, The Journal of physiology.

[11]  L. Mitrani,et al.  Pursuit eye movements of a disappearing moving target , 1978, Vision Research.

[12]  G R Barnes,et al.  Evidence for a link between the extra-retinal component of random-onset pursuit and the anticipatory pursuit of predictable object motion. , 2008, Journal of neurophysiology.

[13]  Gunnar Blohm,et al.  Interaction between smooth anticipation and saccades during ocular orientation in darkness. , 2003, Journal of neurophysiology.

[14]  F. Lacquaniti,et al.  Representation of Visual Gravitational Motion in the Human Vestibular Cortex , 2005, Science.

[15]  Vincenzo Maffei,et al.  Visual gravity cues in the interpretation of biological movements: neural correlates in humans , 2015, NeuroImage.

[16]  D M Merfeld,et al.  Humans use internal models to estimate gravity and linear acceleration , 1999, Nature.

[17]  R. Müri,et al.  MRI and fMRI analysis of oculomotor function. , 2006, Progress in brain research.

[18]  Simon J. Bennett,et al.  Smooth ocular pursuit during the transient disappearance of an accelerating visual target: the role of reflexive and voluntary control , 2006, Experimental Brain Research.

[19]  Michael F. Land,et al.  From eye movements to actions: how batsmen hit the ball , 2000, Nature Neuroscience.

[20]  Dora E. Angelaki,et al.  Internal models and neural computation in the vestibular system , 2009, Experimental Brain Research.

[21]  尚 不二門,et al.  Saccadic eye movements evoked by microstimulation of lobule VII of the cerebellar vermis of macaque monkeys , 1988 .

[22]  Vincenzo Maffei,et al.  Filling gaps in visual motion for target capture , 2015, Front. Integr. Neurosci..

[23]  Ellen Poliakoff,et al.  The effect of previously viewed velocities on motion extrapolation , 2008, Vision Research.

[24]  J. F. Soechting,et al.  Predicting curvilinear target motion through an occlusion , 2007, Experimental Brain Research.

[25]  Hanspeter A. Mallot,et al.  Gaze movements and spatial working memory in collision avoidance: a traffic intersection task , 2013, Front. Behav. Neurosci..

[26]  P. J. Brancazio Looking into Chapman’s homer: The physics of judging a fly ball , 1985 .

[27]  Simon J Bennett,et al.  Predictive smooth ocular pursuit during the transient disappearance of a visual target. , 2004, Journal of neurophysiology.

[28]  Dora E. Angelaki,et al.  Neurons compute internal models of the physical laws of motion , 2004, Nature.

[29]  Philippe Lefèvre,et al.  Evidence for synergy between saccades and smooth pursuit during transient target disappearance. , 2006, Journal of neurophysiology.

[30]  Francesco Lacquaniti,et al.  Differential contributions to the interception of occluded ballistic trajectories by the temporoparietal junction, area hMT/V5+, and the intraparietal cortex. , 2017, Journal of neurophysiology.

[31]  Philippe Lefèvre,et al.  Target acceleration can be extracted and represented within the predictive drive to ocular pursuit. , 2007, Journal of neurophysiology.

[32]  Vincenzo Maffei,et al.  Vestibular nuclei and cerebellum put visual gravitational motion in context. , 2008, Journal of neurophysiology.

[33]  Francesco Lacquaniti,et al.  Catching What We Can't See: Manual Interception of Occluded Fly-Ball Trajectories , 2012, PloS one.

[34]  Uwe J. Ilg,et al.  Cancellation of self-induced retinal image motion during smooth pursuit eye movements , 2001, Vision Research.

[35]  R D Yee,et al.  Effects of an optokinetic background on pursuit eye movements. , 1983, Investigative ophthalmology & visual science.

[36]  H. Collewijn,et al.  Human smooth and saccadic eye movements during voluntary pursuit of different target motions on different backgrounds. , 1984, The Journal of physiology.

[37]  Vincenzo Maffei,et al.  Simulated Self-motion in a Visual Gravity Field: Sensitivity to Vertical and Horizontal , 2022 .

[38]  Vincent P Ferrera,et al.  Internally Generated Error Signals in Monkey Frontal Eye Field during an Inferred Motion Task , 2010, The Journal of Neuroscience.

[39]  C. Shagass,et al.  Eye-tracking performance and engagement of attention. , 1976, Archives of general psychiatry.

[40]  O. Grüsser,et al.  Is there a vestibular cortex? , 1998, Trends in Neurosciences.

[41]  D. Meyer,et al.  Eye-hand coordination: oculomotor control in rapid aimed limb movements. , 1990, Journal of experimental psychology. Human perception and performance.

[42]  Stefan Glasauer,et al.  Gain Control in Predictive Smooth Pursuit Eye Movements: Evidence for an Acceleration-Based Predictive Mechanism , 2017, eNeuro.

[43]  D. A. Suzuki,et al.  The role of the posterior vermis of monkey cerebellum in smooth-pursuit eye movement control. II. Target velocity-related Purkinje cell activity. , 1988, Journal of neurophysiology.

[44]  Frank Bremmer,et al.  Preattentive and Predictive Processing of Visual Motion , 2018, Scientific Reports.

[45]  Simon J. Bennett,et al.  Combined smooth and saccadic ocular pursuit during the transient occlusion of a moving visual object , 2005, Experimental Brain Research.

[46]  Karl R Gegenfurtner,et al.  Keep your eyes on the ball: smooth pursuit eye movements enhance prediction of visual motion. , 2011, Journal of neurophysiology.

[47]  H. J. Wyatt,et al.  Offset dynamics of human smooth pursuit eye movements: Effects of target presence and subject attention , 1997, Vision Research.

[48]  C. J. S. Collins,et al.  The occluded onset pursuit paradigm: prolonging anticipatory smooth pursuit in the absence of visual feedback , 2006, Experimental Brain Research.

[49]  Thomas Brandt,et al.  The bilateral central vestibular system: its pathways, functions, and disorders , 2015, Annals of the New York Academy of Sciences.

[50]  Simon J. Bennett,et al.  Timing the anticipatory recovery in smooth ocular pursuit during the transient disappearance of a visual target , 2005, Experimental Brain Research.

[51]  V. Ferrera,et al.  Modification of Saccades Evoked by Stimulation of Frontal Eye Field during Invisible Target Tracking , 2004, The Journal of Neuroscience.

[52]  Vincenzo Maffei,et al.  Multisensory Integration and Internal Models for Sensing Gravity Effects in Primates , 2014, BioMed research international.

[53]  P. Beek,et al.  Visuomotor transformation for interception: catching while fixating , 2009, Experimental Brain Research.

[54]  J. Maunsell,et al.  Neuronal correlates of inferred motion in primate posterior parietal cortex , 1995, Nature.

[55]  E. J. Morris,et al.  Different responses to small visual errors during initiation and maintenance of smooth-pursuit eye movements in monkeys. , 1987, Journal of neurophysiology.

[56]  Claude Prablanc,et al.  Integration of visual information for saccade production. , 2011, Human Movement Science.

[57]  Martin Faint,et al.  Does the brain model newton’s laws? , 2001 .

[58]  F. Bremmer,et al.  An fMRI study of optokinetic nystagmus and smooth-pursuit eye movements in humans , 2005, Experimental Brain Research.

[59]  Eileen Kowler Cognitive expectations, not habits, control anticipatory smooth oculomotor pursuit , 1989, Vision Research.

[60]  Francesco Lacquaniti,et al.  When Up Is Down in 0g: How Gravity Sensing Affects the Timing of Interceptive Actions , 2012, The Journal of Neuroscience.

[61]  Graham R Barnes,et al.  Predicting the Unpredictable: Weighted Averaging of Past Stimulus Timing Facilitates Ocular Pursuit of Randomly Timed Stimuli , 2009, The Journal of Neuroscience.

[62]  E. L. Keller,et al.  Smooth-pursuit initiation in the presence of a textured background in monkey , 1986, Vision Research.

[63]  Ralph Worfolk,et al.  Interaction of active and passive slow eye movement systems , 2004, Experimental Brain Research.

[64]  Joan López-Moliner,et al.  Flexible timing of eye movements when catching a ball. , 2016, Journal of vision.

[65]  A. Fuchs,et al.  Prediction in the oculomotor system: smooth pursuit during transient disappearance of a visual target , 2004, Experimental Brain Research.

[66]  Luc Proteau,et al.  Effects of stationary and moving textured backgrounds on the visuo-oculo-manual tracking in humans , 1995, Vision Research.

[67]  J. Assad,et al.  Dissociation of visual, motor and predictive signals in parietal cortex during visual guidance , 1999, Nature Neuroscience.

[68]  Vincenzo Maffei,et al.  Extrapolation of vertical target motion through a brief visual occlusion , 2010, Experimental Brain Research.

[69]  Francesco Lacquaniti,et al.  Gaze Behavior in One-Handed Catching and Its Relation with Interceptive Performance: What the Eyes Can't Tell , 2015, PloS one.

[70]  Eileen Kowler,et al.  Davida Teller Award Lecture 2013: the importance of prediction and anticipation in the control of smooth pursuit eye movements. , 2014, Journal of vision.

[71]  Philippe Lefèvre,et al.  A dynamic representation of target motion drives predictive smooth pursuit during target blanking. , 2008, Journal of vision.

[72]  Eli Brenner,et al.  Continuous visual control of interception. , 2011, Human movement science.

[73]  Nick Reed,et al.  How soccer players head the ball: A test of optic acceleration cancellation theory with virtual reality , 2008, Vision Research.

[74]  Francesco Lacquaniti,et al.  Neural Extrapolation of Motion for a Ball Rolling Down an Inclined Plane , 2014, PloS one.

[75]  T. Brandt,et al.  The Vestibular Cortex: Its Locations, Functions, and Disorders , 1999, Annals of the New York Academy of Sciences.

[76]  F. Lacquaniti,et al.  Internal models and prediction of visual gravitational motion , 2008, Vision Research.

[77]  Matthias Nagel,et al.  Parametric modulation of cortical activation during smooth pursuit with and without target blanking. An fMRI study , 2006, NeuroImage.

[78]  Guy Orban,et al.  Processing of targets in smooth or apparent motion along the vertical in the human brain: an fMRI study. , 2010, Journal of neurophysiology.

[79]  Tjeerd M. H. Dijkstra,et al.  Coordination of gaze and hand movements for tracking and tracing in 3D , 2009, Cortex.

[80]  A. Nobre,et al.  The Cerebellum Predicts the Timing of Perceptual Events , 2008, The Journal of Neuroscience.

[81]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[82]  Peter Thier,et al.  The influence of structured visual backgrounds on smooth-pursuit initiation, steady-state pursuit and smooth-pursuit termination , 1995, Biological Cybernetics.

[83]  Jody Tanabe,et al.  Brain Activation during Smooth-Pursuit Eye Movements , 2002, NeuroImage.

[84]  Marie-Laure Bocca,et al.  The saccadic component of ocular pursuit is influenced by the predictability of the target motion in humans , 2005, Experimental Brain Research.

[85]  Yong Wang,et al.  Eye-hand coordination during flexible manual interception of an abruptly appearing, moving target. , 2018, Journal of neurophysiology.

[86]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[87]  M. Hayhoe,et al.  The coordination of eye, head, and hand movements in a natural task , 2001, Experimental Brain Research.

[88]  Alessandro Moscatelli,et al.  Modeling psychophysical data at the population-level: the generalized linear mixed model. , 2012, Journal of vision.

[89]  E. J. Morris,et al.  Visual motion processing and sensory-motor integration for smooth pursuit eye movements. , 1987, Annual review of neuroscience.

[90]  F. Lacquaniti,et al.  The weight of time: gravitational force enhances discrimination of visual motion duration. , 2011, Journal of Vision.

[91]  J Fukushima,et al.  Predictive signals in the pursuit area of the monkey frontal eye fields. , 2008, Progress in brain research.

[92]  Mary Hayhoe,et al.  Memory and prediction in natural gaze control , 2013, Philosophical Transactions of the Royal Society B: Biological Sciences.

[93]  I. Howard,et al.  Visual pursuit over textured backgrounds in different depth planes , 2004, Experimental Brain Research.

[94]  F. Lacquaniti,et al.  Visuo-motor coordination and internal models for object interception , 2009, Experimental Brain Research.

[95]  B. Abernethy,et al.  Visual Strategies Underpinning the Development of Visual–Motor Expertise When Hitting a Ball , 2017, Journal of experimental psychology. Human perception and performance.

[96]  Antonella Maselli,et al.  Intercepting virtual balls approaching under different gravity conditions: evidence for spatial prediction. , 2017, Journal of neurophysiology.

[97]  Francesco Lacquaniti,et al.  Hand interception of occluded motion in humans: a test of model-based vs. on-line control. , 2015, Journal of neurophysiology.

[98]  Edward L. Keller,et al.  Cerebellar vermis involvement in monkey saccadic eye movements: Microstimulation , 1984, Experimental Neurology.

[99]  Eric L Groen,et al.  Orientation of Listing's plane after hypergravity in humans. , 2008, Journal of vestibular research : equilibrium & orientation.

[100]  R. Johansson,et al.  Eye–hand coordination in a sequential target contact task , 2009, Experimental Brain Research.

[101]  Karl R Gegenfurtner,et al.  Contextual effects on smooth-pursuit eye movements. , 2007, Journal of neurophysiology.

[102]  Vincent P Ferrera,et al.  Modulation of visual responses in macaque frontal eye field during covert tracking of invisible targets. , 2006, Cerebral cortex.

[103]  F A Miles,et al.  Role of the oculomotor vermis in generating pursuit and saccades: effects of microstimulation. , 1998, Journal of neurophysiology.

[104]  Francesco Lacquaniti,et al.  Eye movements and manual interception of ballistic trajectories: effects of law of motion perturbations and occlusions , 2014, Experimental Brain Research.

[105]  Francesco Lacquaniti,et al.  Coherence of structural visual cues and pictorial gravity paves the way for interceptive actions. , 2011, Journal of vision.

[106]  T. Haslwanter,et al.  The orientation of Listing’s Plane in microgravity , 2007, Vision Research.

[107]  S. Crespi,et al.  Spotting expertise in the eyes: billiards knowledge as revealed by gaze shifts in a dynamic visual prediction task. , 2012, Journal of vision.

[108]  Dirk Kerzel,et al.  Like a rolling stone: naturalistic visual kinematics facilitate tracking eye movements. , 2013, Journal of vision.

[109]  H Carnahan,et al.  The temporal organization of hand, eye, and head movements during reaching and pointing. , 1991, Journal of motor behavior.

[110]  Eli Brenner,et al.  Sources of variability in interceptive movements , 2009, Experimental Brain Research.

[111]  S de Brouwer,et al.  Role of retinal slip in the prediction of target motion during smooth and saccadic pursuit. , 2001, Journal of neurophysiology.

[112]  H. Bekkering,et al.  Ocular gaze is anchored to the target of an ongoing pointing movement. , 2000, Journal of neurophysiology.

[113]  A Berthoz,et al.  Gaze control in microgravity. 1. Saccades, pursuit, eye-head coordination. , 1993, Journal of vestibular research : equilibrium & orientation.

[114]  F. Lacquaniti,et al.  Gravity in the Brain as a Reference for Space and Time Perception. , 2015, Multisensory research.

[115]  D. Angelaki,et al.  Multisensory integration: resolving sensory ambiguities to build novel representations , 2010, Current Opinion in Neurobiology.

[116]  D Elliott,et al.  Eye-hand coordination in goal-directed aiming. , 2001, Human movement science.

[117]  Alan C. Evans,et al.  Functional neuroanatomy of smooth pursuit and predictive saccades , 2000, Neuroreport.

[118]  G. Barnes,et al.  Oculomotor prediction of accelerative target motion during occlusion: long-term and short-term effects , 2010, Experimental Brain Research.

[119]  Joan López-Moliner,et al.  Gravity as a Strong Prior: Implications for Perception and Action , 2017, Front. Hum. Neurosci..

[120]  Francesco Lacquaniti,et al.  Anticipating the effects of gravity when intercepting moving objects: differentiating up and down based on nonvisual cues. , 2005, Journal of neurophysiology.

[121]  P. McLeod,et al.  The generalized optic acceleration cancellation theory of catching. , 2006, Journal of experimental psychology. Human perception and performance.

[122]  P. Skudlarski,et al.  Neuronal representation of occluded objects in the human brain , 2004, Neuropsychologia.

[123]  K. Fukushima,et al.  Predictive responses of periarcuate pursuit neurons to visual target motion , 2002, Experimental Brain Research.

[124]  W. Helsen,et al.  Coupling of Eye, Finger, Elbow, and Shoulder Movements During Manual Aiming , 2000, Journal of motor behavior.

[125]  Miriam Spering,et al.  Context effects on smooth pursuit and manual interception of a disappearing target. , 2017, Journal of neurophysiology.

[126]  Vincent P. Ferrera,et al.  Estimating invisible target speed from neuronal activity in monkey frontal eye field , 2003, Nature Neuroscience.

[127]  Luca Passamonti,et al.  Sound-evoked vestibular stimulation affects the anticipation of gravity effects during visual self-motion , 2015, Experimental Brain Research.

[128]  Costas N. Stefanis,et al.  Predictive smooth eye pursuit in a population of young men: II. Effects of schizotypy, anxiety and depression , 2011, Experimental Brain Research.

[129]  Guldin Wo,et al.  Is there a vestibular cortex , 1998 .

[130]  Eileen Kowler,et al.  Anticipatory smooth pursuit eye movements evoked by probabilistic cues. , 2017, Journal of vision.

[131]  Mary Hayhoe,et al.  Saccades to future ball location reveal memory-based prediction in a virtual-reality interception task. , 2013, Journal of vision.

[132]  M. Missal,et al.  Quantitative analysis of catch-up saccades during sustained pursuit. , 2002, Journal of neurophysiology.

[133]  G. Barnes,et al.  Human ocular pursuit during the transient disappearance of a visual target. , 2003, Journal of neurophysiology.

[134]  F. Lacquaniti,et al.  Fast adaptation of the internal model of gravity for manual interceptions: evidence for event-dependent learning. , 2005, Journal of neurophysiology.

[135]  A. Terry Bahill,et al.  Model emulates human smooth pursuit system producing zero-latency target tracking , 1983, Biological Cybernetics.

[136]  Jean-Jacques Orban de Xivry,et al.  Saccades and pursuit: two outcomes of a single sensorimotor process , 2007, The Journal of physiology.

[137]  F. Lacquaniti,et al.  Internal models of target motion: expected dynamics overrides measured kinematics in timing manual interceptions. , 2004, Journal of neurophysiology.

[138]  Costas N. Stefanis,et al.  Predictive smooth eye pursuit in a population of young men: I. Effects of age, IQ, oculomotor and cognitive tasks , 2011, Experimental Brain Research.