Sounds Move a Static Visual Object

Background Vision provides the most salient information with regard to stimulus motion, but audition can also provide important cues that affect visual motion perception. Here, we show that sounds containing no motion or positional cues can induce illusory visual motion perception for static visual objects. Methodology/Principal Findings Two circles placed side by side were presented in alternation producing apparent motion perception and each onset was accompanied by a tone burst of a specific and unique frequency. After exposure to this visual apparent motion with tones for a few minutes, the tones became drivers for illusory motion perception. When the flash onset was synchronized to tones of alternating frequencies, a circle blinking at a fixed location was perceived as lateral motion in the same direction as the previously exposed apparent motion. Furthermore, the effect lasted at least for a few days. The effect was well observed at the retinal position that was previously exposed to apparent motion with tone bursts. Conclusions/Significance The present results indicate that strong association between sound sequence and visual motion is easily formed within a short period and that, after forming the association, sounds are able to trigger visual motion perception for a static visual object.

[1]  Yukio Iwaya,et al.  Alternation of Sound Location Induces Visual Motion Perception of a Static Object , 2009, PloS one.

[2]  R. Sekuler,et al.  Sound alters visual motion perception , 1997, Nature.

[3]  E. DeYoe,et al.  A comparison of visual and auditory motion processing in human cerebral cortex. , 2000, Cerebral cortex.

[4]  S. Shimojo,et al.  When Sound Affects Vision: Effects of Auditory Grouping on Visual Motion Perception , 2001, Psychological science.

[5]  Alan Kingstone,et al.  Cross-modal dynamic capture: congruency effects in the perception of motion across sensory modalities. , 2004, Journal of experimental psychology. Human perception and performance.

[6]  M C Corballis,et al.  Motion Perception: A Color-Contingent Aftereffect , 1972, Science.

[7]  J. Saunders,et al.  Demonstration of cue recruitment: change in visual appearance by means of Pavlovian conditioning. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[8]  M. Cynader,et al.  A contingent aftereffect in the auditory system , 1999, Nature Neuroscience.

[9]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[10]  O. Hikosaka,et al.  Visual Motion Sensation Yielded by Non-visually Driven Attention , 1997, Vision Research.

[11]  S. Wuerger,et al.  Cross-modal integration of auditory and visual motion signals , 2001, Neuroreport.

[12]  David Alais,et al.  No direction-specific bimodal facilitation for audiovisual motion detection. , 2004, Brain research. Cognitive brain research.

[13]  Aaron R. Seitz,et al.  A common framework for perceptual learning , 2007, Current Opinion in Neurobiology.

[14]  Benjamin T. Backus,et al.  Competition between newly recruited and pre-existing visual cues during the construction of visual appearance , 2007, Vision Research.

[15]  Jean Vroomen,et al.  Visual Motion Influences the Contingent Auditory Motion Aftereffect , 2003, Psychological science.

[16]  W. Singer,et al.  Capture of Auditory Motion by Vision Is Represented by an Activation Shift from Auditory to Visual Motion Cortex , 2008, The Journal of Neuroscience.

[17]  Yukio Iwaya,et al.  Visual motion perception induced by sounds in vertical plane , 2010, Neuroscience Letters.

[18]  Aaron R. Seitz,et al.  Benefits of multisensory learning , 2008, Trends in Cognitive Sciences.

[19]  Jon Driver,et al.  Direction of Visual Apparent Motion Driven Solely by Timing of a Static Sound , 2008, Current Biology.