Integration of speed and time for estimating time to contact

Significance Existing theories suggest that reacting to dynamic stimuli is made possible by relying on internal estimates of kinematic variables. For example, to catch a bouncing ball the brain relies on the position and speed of the ball. However, when kinematic information is unreliable one may additionally rely on temporal cues. In the bouncing ball example, when visibility is low one may benefit from the temporal information provided by the sound of the bounces. Our work provides evidence that humans rely on such temporal cues and automatically integrate them with kinematic information to optimize their performance. This finding reveals a hitherto unappreciated role of the brain’s timing mechanisms in sensorimotor function. To coordinate movements with events in a dynamic environment the brain has to anticipate when those events occur. A classic example is the estimation of time to contact (TTC), that is, when an object reaches a target. It is thought that TTC is estimated from kinematic variables. For example, a tennis player might use an estimate of distance (d) and speed (v) to estimate TTC (TTC = d/v). However, the tennis player may instead estimate TTC as twice the time it takes for the ball to move from the serve line to the net line. This latter strategy does not rely on kinematics and instead computes TTC solely from temporal cues. Which of these two strategies do humans use to estimate TTC? Considering that both speed and time estimates are inherently uncertain and the ability of the human brain to combine different sources of information, we hypothesized that humans estimate TTC by integrating speed information with temporal cues. We evaluated this hypothesis systematically using psychophysics and Bayesian modeling. Results indicated that humans rely on both speed information and temporal cues and integrate them to optimize their TTC estimates when both cues are present. These findings suggest that the brain’s timing mechanisms are actively engaged when interacting with dynamic stimuli.

[1]  Hugo Merchant,et al.  Interval Tuning in the Primate Medial Premotor Cortex as a General Timing Mechanism , 2013, The Journal of Neuroscience.

[2]  R M Church,et al.  Scalar Timing in Memory , 1984, Annals of the New York Academy of Sciences.

[3]  Leslie Welch,et al.  The perception of moving plaids reveals two motion-processing stages , 1989, Nature.

[4]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[5]  F. Lacquaniti,et al.  The role of preparation in tuning anticipatory and reflex responses during catching , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  D. Wolpert,et al.  Changing your mind: a computational mechanism of vacillation , 2009, Nature.

[7]  John F Soechting,et al.  Models for the extrapolation of target motion for manual interception. , 2009, Journal of neurophysiology.

[8]  M. Miyazaki,et al.  Testing Bayesian models of human coincidence timing. , 2005, Journal of neurophysiology.

[9]  L. Pinneo On noise in the nervous system. , 1966, Psychological review.

[10]  D. Knill,et al.  The brain uses adaptive internal models of scene statistics for sensorimotor estimation and planning , 2013, Proceedings of the National Academy of Sciences.

[11]  V Cavallo,et al.  Visual Information and Skill Level in Time-To-Collision Estimation , 1988, Perception.

[12]  Eli Brenner,et al.  How people achieve their amazing temporal precision in interception. , 2015, Journal of vision.

[13]  Ryan V. Ringer,et al.  Impairing the useful field of view in natural scenes: Tunnel vision versus general interference. , 2016, Journal of vision.

[14]  M. Sahani,et al.  Observers Exploit Stochastic Models of Sensory Change to Help Judge the Passage of Time , 2011, Current Biology.

[15]  P. Montague,et al.  Ready…Go: Amplitude of the fMRI Signal Encodes Expectation of Cue Arrival Time , 2009, PLoS biology.

[16]  Anne-Marie Brouwer,et al.  Hitting moving objects: is target speed used in guiding the hand? , 2002, Experimental Brain Research.

[17]  Daniel M Wolpert,et al.  Role of uncertainty in sensorimotor control. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[18]  Murray L Lawson,et al.  Global and local attention in the attentional blink. , 2007, Journal of vision.

[19]  Daniel M Wolpert,et al.  Bayesian integration in force estimation. , 2004, Journal of neurophysiology.

[20]  John H. R. Maunsell,et al.  Attentional modulation of visual motion processing in cortical areas MT and MST , 1996, Nature.

[21]  Heiko Hecht,et al.  Gravitational acceleration as a cue for absolute size and distance? , 1996, Perception & psychophysics.

[22]  Daniel D. Lee,et al.  Dynamic belief state representations , 2014, Current Opinion in Neurobiology.

[23]  F. Lacquaniti,et al.  Does the brain model Newton's laws? , 2001, Nature Neuroscience.

[24]  Heiko Hecht,et al.  Chapter 1 Theories of time-to-contact judgment , 2004 .

[25]  Sergei Gepshtein,et al.  The lawful perception of apparent motion. , 2007, Journal of vision.

[26]  Andrea H. Mason,et al.  Target viewing time and velocity effects on prehension , 1999, Experimental Brain Research.

[27]  Joan López-Moliner,et al.  Interceptive timing: prior knowledge matters. , 2007, Journal of vision.

[28]  E Brenner,et al.  Is Judging Time-to-Contact Based on ‘Tau’? , 1996, Perception.

[29]  Kazutoshi Kudo,et al.  Motor planning under temporal uncertainty is suboptimal when the gain function is asymmetric , 2015, Front. Comput. Neurosci..

[30]  G. Pellizzer,et al.  Motor planning: effect of directional uncertainty with continuous spatial cues , 2003, Experimental Brain Research.

[31]  Brent R Beutter,et al.  Human discrimination of visual direction of motion with and without smooth pursuit eye movements. , 2003, Journal of vision.

[32]  S. Gori,et al.  How the visual aspects can be crucial in reading acquisition? The intriguing case of crowding and developmental dyslexia. , 2015, Journal of vision.

[33]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[34]  D. Burr,et al.  Optimal Encoding of Interval Timing in Expert Percussionists , 2011, The Journal of Neuroscience.

[35]  F A Mussa-Ivaldi,et al.  Central representation of time during motor learning. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Michael N. Shadlen,et al.  A Neural Mechanism for Sensing and Reproducing a Time Interval , 2015, Current Biology.

[37]  Luigi Acerbi,et al.  Internal Representations of Temporal Statistics and Feedback Calibrate Motor-Sensory Interval Timing , 2012, PLoS Comput. Biol..

[38]  J. Tresilian Visually timed action: time-out for ‘tau’? , 1999, Trends in Cognitive Sciences.

[39]  James M. Hillis,et al.  Combining Sensory Information: Mandatory Fusion Within, but Not Between, Senses , 2002, Science.

[40]  J. F. Soechting,et al.  Target Interception: Hand–Eye Coordination and Strategies , 2007, The Journal of Neuroscience.

[41]  R A Scheidt,et al.  Learning to move amid uncertainty. , 2001, Journal of neurophysiology.

[42]  F. Lacquaniti,et al.  Visuo-motor coordination and internal models for object interception , 2009, Experimental Brain Research.

[43]  Jörn Diedrichsen,et al.  Dissociating Timing and Coordination as Functions of the Cerebellum , 2007, The Journal of Neuroscience.

[44]  Jun Kunimatsu,et al.  Alteration of the timing of self‐initiated but not reactive saccades by electrical stimulation in the supplementary eye field , 2012, The European journal of neuroscience.

[45]  P R DeLucia,et al.  Cognitive motion extrapolation and cognitive clocking in prediction motion task. , 1998, Journal of experimental psychology. Human perception and performance.

[46]  M. Shadlen,et al.  A representation of the hazard rate of elapsed time in macaque area LIP , 2005, Nature Neuroscience.

[47]  Miriam Spering,et al.  Eye movement accuracy determines natural interception strategies. , 2016, Journal of vision.

[48]  Eli Brenner,et al.  Intercepting moving objects: do eye-movements matter? , 2010 .

[49]  J. Gibbon,et al.  Scalar expectancy theory and peak-interval timing in humans. , 1998, Journal of experimental psychology. Animal behavior processes.

[50]  Francesco Lacquaniti,et al.  Catching What We Can't See: Manual Interception of Occluded Fly-Ball Trajectories , 2012, PloS one.

[51]  Stephen M. Rao,et al.  Neural modulation of temporal encoding, maintenance, and decision processes. , 2010, Cerebral cortex.

[52]  David N. Lee,et al.  Visual Timing in Hitting An Accelerating Ball , 1983, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[53]  S. McKee,et al.  Precise velocity discrimination despite random variations in temporal frequency and contrast , 1986, Vision Research.

[54]  H. Rodman,et al.  Coding of visual stimulus velocity in area MT of the macaque , 1987, Vision Research.

[55]  Mehrdad Jazayeri,et al.  Late Bayesian inference in sensorimotor behavior , 2017, bioRxiv.

[56]  Michael S Landy,et al.  Combining Priors and Noisy Visual Cues in a Rapid Pointing Task , 2006, The Journal of Neuroscience.

[57]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[58]  Mary Hayhoe,et al.  Saccades to future ball location reveal memory-based prediction in a virtual-reality interception task. , 2013, Journal of vision.

[59]  A Dubrowski,et al.  Target velocity effects on manual interception kinematics. , 2000, Acta psychologica.

[60]  R. Jacobs,et al.  Experience-dependent integration of texture and motion cues to depth , 1999, Vision Research.

[61]  Michael N. Shadlen,et al.  Temporal context calibrates interval timing , 2010, Nature Neuroscience.

[62]  R J Bootsma,et al.  Visual information about time-to-collision between two objects. , 1993, Journal of experimental psychology. Human perception and performance.

[63]  Nori Jacoby,et al.  Integer Ratio Priors on Musical Rhythm Revealed Cross-culturally by Iterated Reproduction , 2017, Current Biology.

[64]  Joan López-Moliner,et al.  Hitting moving targets with a continuously changing temporal window , 2015, Experimental Brain Research.

[65]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[66]  J. Tresilian,et al.  Perceptual and cognitive processes in time-to-contact estimation: Analysis of prediction-motion and relative judgment tasks , 1995, Perception & psychophysics.

[67]  Pawan Sinha,et al.  The effects of scene clutter on the M170 face response , 2010 .

[68]  W. Newsome,et al.  Motion selectivity in macaque visual cortex. I. Mechanisms of direction and speed selectivity in extrastriate area MT. , 1986, Journal of neurophysiology.

[69]  D Regan,et al.  Accuracy of estimating time to collision using binocular and monocular information , 1998, Vision Research.

[70]  G. J. Savelsbergh,et al.  Grasping tau. , 1991, Journal of experimental psychology. Human perception and performance.

[71]  J. Tanji,et al.  Interval time coding by neurons in the presupplementary and supplementary motor areas , 2009, Nature Neuroscience.

[72]  Eli Brenner,et al.  Sources of variability in interceptive movements , 2009, Experimental Brain Research.

[73]  J. F. Soechting,et al.  Interception of targets using brief directional cues , 2004, Experimental Brain Research.