Direction of Visual Apparent Motion Driven Solely by Timing of a Static Sound

In temporal ventriloquism, auditory events can illusorily attract perceived timing of a visual onset [1-3]. We investigated whether timing of a static sound can also influence spatio-temporal processing of visual apparent motion, induced here by visual bars alternating between opposite hemifields. Perceived direction typically depends on the relative interval in timing between visual left-right and right-left flashes (e.g., rightwards motion dominating when left-to-right interflash intervals are shortest [4]). In our new multisensory condition, interflash intervals were equal, but auditory beeps could slightly lag the right flash, yet slightly lead the left flash, or vice versa. This auditory timing strongly influenced perceived visual motion direction, despite providing no spatial auditory motion signal whatsoever. Moreover, prolonged adaptation to such auditorily driven apparent motion produced a robust visual motion aftereffect in the opposite direction, when measured in subsequent silence. Control experiments argued against accounts in terms of possible auditory grouping, or possible attention capture. We suggest that the motion arises because the sounds change perceived visual timing, as we separately confirmed. Our results provide a new demonstration of multisensory influences on sensory-specific perception [5], with timing of a static sound influencing spatio-temporal processing of visual motion direction.

[1]  J. Vroomen,et al.  Temporal ventriloquism: sound modulates the flash-lag effect. , 2004, Journal of experimental psychology. Human perception and performance.

[2]  A. Billard,et al.  Auditory motion affects visual biological motion processing , 2007, Neuropsychologia.

[3]  Alan Kingstone,et al.  The ventriloquist in motion: illusory capture of dynamic information across sensory modalities. , 2002, Brain research. Cognitive brain research.

[4]  G H MOWBRAY,et al.  On discriminating the rate of visual flicker and auditory flutter. , 1959, The American journal of psychology.

[5]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[6]  D. H. Warren,et al.  Immediate perceptual response to intersensory discrepancy. , 1980, Psychological bulletin.

[7]  M. V. von Grünau A motion aftereffect for long-range stroboscopic apparent motion. , 1986, Perception & psychophysics.

[8]  George Sperling,et al.  Attention-generated apparent motion , 1995, Nature.

[9]  P Cavanagh,et al.  Attention-based motion perception. , 1992, Science.

[10]  P. Bertelson,et al.  Cross-modal bias and perceptual fusion with auditory-visual spatial discordance , 1981, Perception & psychophysics.

[11]  S. Shimojo,et al.  Illusions: What you see is what you hear , 2000, Nature.

[12]  C. Spence,et al.  Multisensory perception: Beyond modularity and convergence , 2000, Current Biology.

[13]  C. Spence,et al.  Multisensory contributions to the perception of motion , 2003, Neuropsychologia.

[14]  D C Donderi,et al.  The effect of sound on visual apparent movement. , 1983, The American journal of psychology.

[15]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[16]  Michael von Grünau,et al.  A motion aftereffect for long-range troboscopic apparent motion , 1986 .

[17]  R. Sekuler,et al.  Sound alters visual motion perception , 1997, Nature.

[18]  Norimichi Kitagawa,et al.  Hearing visual motion in depth , 2002, Nature.

[19]  N. F. Dixon,et al.  The Detection of Auditory Visual Desynchrony , 1980, Perception.

[20]  Frans A. J. Verstraten,et al.  Independent Aftereffects of Attention and Motion , 2000, Neuron.

[21]  Mowbray Gh,et al.  On discriminating the rate of visual flicker and auditory flutter. , 1959 .

[22]  S. Wuerger,et al.  Cross-modal integration of auditory and visual motion signals , 2001, Neuroreport.

[23]  A. Kingstone,et al.  Auditory capture of vision: examining temporal ventriloquism. , 2003, Brain research. Cognitive brain research.

[24]  Stephan Getzmann,et al.  The Effect of Brief Auditory Stimuli on Visual Apparent Motion , 2007, Perception.

[25]  Darren R Gitelman,et al.  ILAB: A program for postexperimental eye movement analysis , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.