Vision affects how fast we hear sounds move.

There is a growing body of knowledge about the behavioral and neural correlates of cross-modal interactions in the perception of motion direction, as well as about the computations that underlie unimodal visual speed processing. Yet, the multisensory contributions to the perception of motion speed remain largely uncharted. Here we show that visual motion information exerts a profound influence on the perception of auditory speed. Moreover, our results suggest that this influence is specifically caused by visual velocity rather than by earlier, more local, frequency-based components of visual motion. The way in which visual speed information affects how fast we hear a sound move can be well described by a weighted average model that takes into account the visual speed signal in the computation of auditory speed.

[1]  Nicholas J. Priebe,et al.  Tuning for Spatiotemporal Frequency and Speed in Directionally Selective Neurons of Macaque Striate Cortex , 2006, The Journal of Neuroscience.

[2]  Andrew B. Watson,et al.  A look at motion in the frequency domain , 1983 .

[3]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[4]  A. T. Smith,et al.  The separability of temporal frequency and velocity , 1991, Vision Research.

[5]  Alexander Thiele,et al.  Speed skills: measuring the visual speed analyzing properties of primate MT neurons , 2001, Nature Neuroscience.

[6]  Nicholas J. Priebe,et al.  Estimating Target Speed from the Population Response in Visual Area MT , 2004, The Journal of Neuroscience.

[7]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[8]  H. Riquimaroux,et al.  Sound controls velocity perception of visual apparent motion , 2000 .

[9]  Sophie M. Wuerger,et al.  Low-level integration of auditory and visual motion signals requires spatial co-localisation , 2005, Experimental Brain Research.

[10]  Karl R Gegenfurtner,et al.  Velocity tuned mechanisms in human motion processing , 1999, Vision Research.

[11]  G F Meyer,et al.  The integration of auditory and visual motion signals at threshold , 2003, Perception & psychophysics.

[12]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[13]  Alan Kingstone,et al.  Cross-modal dynamic capture: congruency effects in the perception of motion across sensory modalities. , 2004, Journal of experimental psychology. Human perception and performance.

[14]  David Alais,et al.  No direction-specific bimodal facilitation for audiovisual motion detection. , 2004, Brain research. Cognitive brain research.

[15]  S. Carlile,et al.  Discrimination of sound source velocity in human listeners. , 2002, The Journal of the Acoustical Society of America.

[16]  D. M. Green,et al.  Sound localization by human listeners. , 1991, Annual review of psychology.

[17]  D. Burr,et al.  Combining visual and auditory information. , 2006, Progress in brain research.

[18]  Alexander Thiele,et al.  A model of speed tuning in MT neurons , 2002, Vision Research.

[19]  Lights can reverse illusory directional hearing , 2005, Neuroscience Letters.

[20]  H E Bedell,et al.  The precision of velocity discrimination across spatial frequency , 1998, Perception & psychophysics.

[21]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[22]  B. Stein,et al.  The Merging of the Senses , 1993 .

[23]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[24]  S. Wuerger,et al.  Cross-modal integration of auditory and visual motion signals , 2001, Neuroreport.

[25]  C. Spence,et al.  Multisensory contributions to the perception of motion , 2003, Neuropsychologia.