Filling gaps in visual motion for target capture

A remarkable challenge our brain must face constantly when interacting with the environment is represented by ambiguous and, at times, even missing sensory information. This is particularly compelling for visual information, being the main sensory system we rely upon to gather cues about the external world. It is not uncommon, for example, that objects catching our attention may disappear temporarily from view, occluded by visual obstacles in the foreground. Nevertheless, we are often able to keep our gaze on them throughout the occlusion or even catch them on the fly in the face of the transient lack of visual motion information. This implies that the brain can fill the gaps of missing sensory information by extrapolating the object motion through the occlusion. In recent years, much experimental evidence has been accumulated that both perceptual and motor processes exploit visual motion extrapolation mechanisms. Moreover, neurophysiological and neuroimaging studies have identified brain regions potentially involved in the predictive representation of the occluded target motion. Within this framework, ocular pursuit and manual interceptive behavior have proven to be useful experimental models for investigating visual extrapolation mechanisms. Studies in these fields have pointed out that visual motion extrapolation processes depend on manifold information related to short-term memory representations of the target motion before the occlusion, as well as to longer term representations derived from previous experience with the environment. We will review recent oculomotor and manual interception literature to provide up-to-date views on the neurophysiological underpinnings of visual motion extrapolation.

[1]  Apostolos P. Georgopoulos,et al.  Intercepting real and path-guided apparent motion targets , 2004, Experimental Brain Research.

[2]  Heiko Hecht,et al.  The representational dynamics of remembered projectile locations. , 2013, Journal of experimental psychology. Human perception and performance.

[3]  F. Lacquaniti,et al.  Internal models and prediction of visual gravitational motion , 2008, Vision Research.

[4]  A. Nobre,et al.  The Cerebellum Predicts the Timing of Perceptual Events , 2008, The Journal of Neuroscience.

[5]  G. Barnes,et al.  Oculomotor prediction of accelerative target motion during occlusion: long-term and short-term effects , 2010, Experimental Brain Research.

[6]  S. Riek,et al.  Delayed inhibition of an anticipatory action during motion extrapolation , 2010, Behavioral and Brain Functions.

[7]  Hiromu Katsumata,et al.  Prospective versus predictive control in timing of hitting a falling ball , 2011, Experimental Brain Research.

[8]  Marina Pavlova,et al.  Timing Accuracy in Motion Extrapolation: Reverse Effects of Target Size and Visible Extent of Motion at Low and High Speeds , 2003, Perception.

[9]  Ellen Poliakoff,et al.  The effect of previously viewed velocities on motion extrapolation , 2008, Vision Research.

[10]  Welber Marinovic,et al.  Neural prediction of complex accelerations for object interception. , 2012, Journal of neurophysiology.

[11]  S. Bennett,et al.  Is Acceleration Used for Ocular Pursuit and Spatial Estimation during Prediction Motion? , 2013, PloS one.

[12]  D. Regan,et al.  Visually guided collision avoidance and collision achievement , 2000, Trends in Cognitive Sciences.

[13]  Peter M. Vishton,et al.  Timing of anticipatory muscle tensing control: responses before and after expected impact , 2010, Experimental Brain Research.

[14]  Stephen J Heinen,et al.  Perceptual and oculomotor evidence of limitations on processing accelerating motion. , 2003, Journal of vision.

[15]  Joan López-Moliner,et al.  Catching a gently thrown ball , 2010, Experimental Brain Research.

[16]  Francesco Lacquaniti,et al.  Correction and suppression of reaching movements in the cerebral cortex: Physiological and neuropsychological aspects , 2014, Neuroscience & Biobehavioral Reviews.

[17]  Caspar M. Schwiedrzik,et al.  Stimulus Predictability Reduces Responses in Primary Visual Cortex , 2010, The Journal of Neuroscience.

[18]  Vincent P Ferrera,et al.  Modulation of visual responses in macaque frontal eye field during covert tracking of invisible targets. , 2006, Cerebral cortex.

[19]  F. Lacquaniti,et al.  Visual perception and interception of falling objects: a review of evidence for an internal model of gravity , 2005, Journal of neural engineering.

[20]  Heiner Deubel,et al.  Mental extrapolation of motion modulates responsiveness to visual stimuli , 2006, Vision Research.

[21]  Apostolos P. Georgopoulos,et al.  Decoding of path-guided apparent motion from neural ensembles in posterior parietal cortex , 2005, Experimental Brain Research.

[22]  W Schiff,et al.  Accuracy of judging time to arrival: effects of modality, trajectory, and gender. , 1990, Journal of experimental psychology. Human perception and performance.

[23]  Boris Crassini,et al.  The effects of familiar size and object trajectories on time-to-contact judgements , 2010, Experimental Brain Research.

[24]  Romeo Chua,et al.  Use of visual information in the correction of interceptive actions , 2006, Experimental Brain Research.

[25]  J. F. Soechting,et al.  Predicting curvilinear target motion through an occlusion , 2007, Experimental Brain Research.

[26]  Welber Marinovic,et al.  The utilisation of visual information in the control of rapid interceptive actions. , 2009, Experimental psychology.

[27]  Apostolos P. Georgopoulos,et al.  Interception of real and apparent motion targets: psychophysics in humans and monkeys , 2003, Experimental Brain Research.

[28]  Her Mann Tsai,et al.  Effect of rounded edged dimple arrays on the boundary layer development , 2009, J. Vis..

[29]  Laurence R. Young,et al.  Visual-vestibular interaction , 1994 .

[30]  Ellen Poliakoff,et al.  Typical object velocity influences motion extrapolation , 2009, Experimental Brain Research.

[31]  M. Wexler,et al.  Movement prediction and movement production. , 2001, Journal of experimental psychology. Human perception and performance.

[32]  Eileen Kowler,et al.  The effect of expectations on slow oculomotor control—III. Guessing unpredictable target displacements , 1981, Vision Research.

[33]  J. Tresilian,et al.  Perceptual and cognitive processes in time-to-contact estimation: Analysis of prediction-motion and relative judgment tasks , 1995, Perception & psychophysics.

[34]  S de Brouwer,et al.  Role of retinal slip in the prediction of target motion during smooth and saccadic pursuit. , 2001, Journal of neurophysiology.

[35]  J. F. Soechting,et al.  Interception of targets using brief directional cues , 2004, Experimental Brain Research.

[36]  P. Werkhoven,et al.  Visual processing of optic acceleration , 1992, Vision Research.

[37]  H T Whiting,et al.  Exposure and occluded duration effects in a ball-catching skill. , 1974, Journal of motor behavior.

[38]  Heiko Hecht,et al.  Eye movements influence estimation of time-to-contact in prediction motion , 2010, Experimental Brain Research.

[39]  Joost C. Dessing,et al.  Adaptations of lateral hand movements to early and late visual occlusion in catching , 2009, Experimental Brain Research.

[40]  Simon J. Bennett,et al.  Combined smooth and saccadic ocular pursuit during the transient occlusion of a moving visual object , 2005, Experimental Brain Research.

[41]  Karl R Gegenfurtner,et al.  Keep your eyes on the ball: smooth pursuit eye movements enhance prediction of visual motion. , 2011, Journal of neurophysiology.

[42]  A. Georgopoulos,et al.  Neural responses in motor cortex and area 7a to real and apparent motion , 2004, Experimental Brain Research.

[43]  S. Riek,et al.  Corticospinal excitability during preparation for an anticipatory action is modulated by the availability of visual information. , 2011, Journal of neurophysiology.

[44]  Vincent P. Ferrera,et al.  Estimating invisible target speed from neuronal activity in monkey frontal eye field , 2003, Nature Neuroscience.

[45]  P R DeLucia,et al.  Cognitive motion extrapolation and cognitive clocking in prediction motion task. , 1998, Journal of experimental psychology. Human perception and performance.

[46]  Gary S. Settles,et al.  Full-scale schlieren visualization of supersonic bullet and muzzle blast from firing a .30-06 rifle , 2005, J. Vis..

[47]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[48]  Philippe Lefèvre,et al.  A dynamic representation of target motion drives predictive smooth pursuit during target blanking. , 2008, Journal of vision.

[49]  Eileen Kowler,et al.  The effect of expectations on slow oculomotor control—IV. Anticipatory smooth eye movements depend on prior target motions , 1984, Vision Research.

[50]  Dirk Kerzel,et al.  Mental extrapolation of target position is strongest with weak motion signals and motor responses , 2003, Vision Research.

[51]  Simon J. Bennett,et al.  Smooth ocular pursuit during the transient disappearance of an accelerating visual target: the role of reflexive and voluntary control , 2006, Experimental Brain Research.

[52]  Philippe Lefèvre,et al.  Evidence for synergy between saccades and smooth pursuit during transient target disappearance. , 2006, Journal of neurophysiology.

[53]  Philippe Lefèvre,et al.  Target acceleration can be extracted and represented within the predictive drive to ocular pursuit. , 2007, Journal of neurophysiology.

[54]  Francesco Lacquaniti,et al.  Catching What We Can't See: Manual Interception of Occluded Fly-Ball Trajectories , 2012, PloS one.

[55]  G. Orban,et al.  A Higher Order Motion Region in Human Inferior Parietal Lobule Evidence from fMRI , 2003, Neuron.

[56]  Francesco Lacquaniti,et al.  Neural Extrapolation of Motion for a Ball Rolling Down an Inclined Plane , 2014, PloS one.

[57]  Lars Muckli,et al.  TMS Over V5 Disrupts Motion Prediction , 2013, Cerebral cortex.

[58]  Dirk Kerzel,et al.  Attention maintains mental extrapolation of target position: irrelevant distractors eliminate forward displacement after implied motion , 2003, Cognition.

[59]  D. Lyon,et al.  Time course of visual extrapolation accuracy. , 1995, Acta psychologica.

[60]  F. Binkofski,et al.  Cortical mechanisms of smooth pursuit eye movements with target blanking. An fMRI study , 2004, The European journal of neuroscience.

[61]  Anne-Marie Brouwer,et al.  Hitting moving objects: is target speed used in guiding the hand? , 2002, Experimental Brain Research.

[62]  J. Assad,et al.  Dissociation of visual, motor and predictive signals in parietal cortex during visual guidance , 1999, Nature Neuroscience.

[63]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[64]  Philippe Lefèvre,et al.  During Smooth and Saccadic Pursuit Role of Retinal Slip in the Prediction of Target Motion , 2016 .

[65]  P. Thier,et al.  Visual tracking neurons in primate area MST are activated by smooth-pursuit eye movements of an "imaginary" target. , 2003, Journal of neurophysiology.

[66]  Simon J Bennett,et al.  Predictive smooth ocular pursuit during the transient disappearance of a visual target. , 2004, Journal of neurophysiology.

[67]  A. Georgopoulos,et al.  Neural responses during interception of real and apparent circularly moving stimuli in motor cortex and area 7a. , 2004, Cerebral cortex.

[68]  P Cavanagh,et al.  Attention-based motion perception. , 1992, Science.

[69]  H. J. Wyatt,et al.  Offset dynamics of human smooth pursuit eye movements: Effects of target presence and subject attention , 1997, Vision Research.

[70]  C. J. S. Collins,et al.  The occluded onset pursuit paradigm: prolonging anticipatory smooth pursuit in the absence of visual feedback , 2006, Experimental Brain Research.

[71]  Simon J. Bennett,et al.  Timing the anticipatory recovery in smooth ocular pursuit during the transient disappearance of a visual target , 2005, Experimental Brain Research.

[72]  V. Ferrera,et al.  Modification of Saccades Evoked by Stimulation of Frontal Eye Field during Invisible Target Tracking , 2004, The Journal of Neuroscience.

[73]  Remco J. Renken,et al.  Cerebral representations of space and time , 2009, NeuroImage.

[74]  Vincent P Ferrera,et al.  Internally Generated Error Signals in Monkey Frontal Eye Field during an Inferred Motion Task , 2010, The Journal of Neuroscience.

[75]  J. F. Soechting,et al.  Extrapolation of visual motion for manual interception. , 2008, Journal of neurophysiology.

[76]  H. Krist,et al.  When is the ball going to hit the ground? Duration estimates, eye movements, and mental imagery of object motion. , 2004, Journal of experimental psychology. Human perception and performance.

[77]  Mary Hayhoe,et al.  Saccades to future ball location reveal memory-based prediction in a virtual-reality interception task. , 2013, Journal of vision.

[78]  A Dubrowski,et al.  Target velocity effects on manual interception kinematics. , 2000, Acta psychologica.

[79]  G. Barnes,et al.  Human ocular pursuit during the transient disappearance of a visual target. , 2003, Journal of neurophysiology.

[80]  C. Von Hofsten,et al.  Visual-vestibular interaction in early infancy , 2000, Experimental Brain Research.

[81]  A. Georgopoulos,et al.  Neurophysiology of perceptual and motor aspects of interception. , 2006, Journal of neurophysiology.

[82]  W H Ehrenstein,et al.  Motion Extrapolation and Velocity Transposition , 1997, Perception.

[83]  P. Skudlarski,et al.  Neuronal representation of occluded objects in the human brain , 2004, Neuropsychologia.

[84]  K. Fukushima,et al.  Predictive responses of periarcuate pursuit neurons to visual target motion , 2002, Experimental Brain Research.

[85]  Kenji Kawano,et al.  Trial-by-trial updating of the gain in preparation for smooth pursuit eye movement based on past experience in humans. , 2008, Journal of neurophysiology.

[86]  J. Maunsell,et al.  Neuronal correlates of inferred motion in primate posterior parietal cortex , 1995, Nature.

[87]  E. J. Morris,et al.  Different responses to small visual errors during initiation and maintenance of smooth-pursuit eye movements in monkeys. , 1987, Journal of neurophysiology.

[88]  C. Von Hofsten,et al.  Predictive tracking over occlusions by 4-month-old infants. , 2007, Developmental science.

[89]  R. L. Gregory,et al.  Real and apparent movement nulled , 1984, Nature.

[90]  J Fukushima,et al.  Predictive signals in the pursuit area of the monkey frontal eye fields. , 2008, Progress in brain research.

[91]  Mary Hayhoe,et al.  Memory and prediction in natural gaze control , 2013, Philosophical Transactions of the Royal Society B: Biological Sciences.

[92]  F. Lacquaniti,et al.  Visuo-motor coordination and internal models for object interception , 2009, Experimental Brain Research.

[93]  G R Barnes,et al.  The influence of briefly presented randomized target motion on the extraretinal component of ocular pursuit. , 2008, Journal of neurophysiology.

[94]  Francesco Lacquaniti,et al.  Eye movements and manual interception of ballistic trajectories: effects of law of motion perturbations and occlusions , 2014, Experimental Brain Research.

[95]  Amanda L. Kaas,et al.  Imagery of a moving object: The role of occipital cortex and human MT/V5+ , 2010, NeuroImage.

[96]  Z L Lu,et al.  Three-systems theory of human visual motion perception: review and update. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[97]  Simon J. Bennett,et al.  Ocular pursuit and the estimation of time-to-contact with accelerating objects in prediction motion are controlled independently based on first-order estimates , 2010, Experimental Brain Research.

[98]  Patrick Cavanagh,et al.  Unilateral Right Parietal Damage Leads to Bilateral Deficit for High-Level Motion , 2001, Neuron.

[99]  R. Fendrich,et al.  Ocular pursuit of predicted motion trajectories , 2001, Experimental Brain Research.

[100]  Toshio Inui,et al.  Lateralization of the Posterior Parietal Cortex for Internal Monitoring of Self- versus Externally Generated Movements , 2007, Journal of Cognitive Neuroscience.

[101]  Ellen Poliakoff,et al.  Do Common Systems Control Eye Movements and Motion Extrapolation? , 2011, Quarterly journal of experimental psychology.

[102]  A P Georgopoulos,et al.  Neurophysiology of the parieto-frontal system during target interception. , 2004, Neurology & clinical neurophysiology : NCN.

[103]  Thomas Eggert,et al.  Predictive strategies in interception tasks: differences between eye and hand movements , 2004, Experimental Brain Research.

[104]  John F Soechting,et al.  Models for the extrapolation of target motion for manual interception. , 2009, Journal of neurophysiology.

[105]  J. M. Stephenson,et al.  Critical Time Intervals for Taking in Flight Information in a Ball-Catching Task , 1970 .

[106]  Francesco Lacquaniti,et al.  Familiar trajectories facilitate the interpretation of physical forces when intercepting a moving target , 2014, Experimental Brain Research.

[107]  Patricia R DeLucia,et al.  Time-to-contact judgments of an approaching object that is partially concealed by an occluder. , 2004, Journal of experimental psychology. Human perception and performance.

[108]  Steve Hansen,et al.  Facilitation of ocular pursuit during transient occlusion of externally-generated target motion by concurrent upper limb movement. , 2012, Journal of vision.

[109]  A. Fuchs,et al.  Prediction in the oculomotor system: smooth pursuit during transient disappearance of a visual target , 2004, Experimental Brain Research.

[110]  Clayton E. Curtis,et al.  Neural Substrates of Dynamic Object Occlusion , 2007, Journal of Cognitive Neuroscience.

[111]  L. Mitrani,et al.  Pursuit eye movements of a disappearing moving target , 1978, Vision Research.

[112]  U. Ilg Visual-tracking neurons in area MST are activated during anticipatory pursuit eye movements , 2003, Neuroreport.

[113]  Vincenzo Maffei,et al.  Extrapolation of vertical target motion through a brief visual occlusion , 2010, Experimental Brain Research.

[114]  Adonis Moschovakis,et al.  Arm movement metrics influence saccade metrics when looking and pointing towards a memorized target location , 2008, Experimental Brain Research.

[115]  Francesco Lacquaniti,et al.  Contributions of the Human Temporoparietal Junction and MT/V5+ to the Timing of Interception Revealed by Transcranial Magnetic Stimulation , 2008, The Journal of Neuroscience.

[116]  R. Krauzlis,et al.  Effects of learning on smooth pursuit during transient disappearance of a visual target. , 2003, Journal of neurophysiology.

[117]  Hugo Merchant,et al.  Behavioral and neurophysiological aspects of target interception. , 2009, Advances in experimental medicine and biology.

[118]  A. Faisal,et al.  Near Optimal Combination of Sensory and Motor Uncertainty in Time During a Naturalistic Perception-Action Task , 2008, Journal of neurophysiology.

[119]  Eli Brenner,et al.  Precise timing when hitting falling balls , 2014, Front. Hum. Neurosci..

[120]  Dirk Kerzel,et al.  Like a rolling stone: naturalistic visual kinematics facilitate tracking eye movements. , 2013, Journal of vision.

[121]  Wael El-Deredy,et al.  Tracking visible and occluded targets: Changes in event related potentials during motion extrapolation , 2009, Neuropsychologia.

[122]  Richard Apps,et al.  An internal model of a moving visual target in the lateral cerebellum , 2009, The Journal of physiology.

[123]  David N. Lee,et al.  Plummeting gannets: a paradigm of ecological optics , 1981, Nature.

[124]  Matthias Nagel,et al.  Parametric modulation of cortical activation during smooth pursuit with and without target blanking. An fMRI study , 2006, NeuroImage.

[125]  Guy Orban,et al.  Processing of targets in smooth or apparent motion along the vertical in the human brain: an fMRI study. , 2010, Journal of neurophysiology.

[126]  Vincenzo Maffei,et al.  Visual gravitational motion and the vestibular system in humans , 2013, Front. Integr. Neurosci..

[127]  A P Georgopoulos,et al.  Effects of optic flow in motor cortex and area 7a. , 2001, Journal of neurophysiology.