When does visual perceptual grouping affect multisensory integration?

Several studies have shown that the direction in which a visual apparent motion stream moves can influence the perceived direction of an auditory apparent motion stream (an effect known as crossmodal dynamic capture). However, little is known about the role that intramodal perceptual grouping processes play in the multisensory integration of motion information. The present study was designed to investigate the time course of any modulation of the cross-modal dynamic capture effect by the nature of the perceptual grouping taking place within vision. Participants were required to judge the direction of an auditory apparent motion stream while trying to ignore visual apparent motion streams presented in a variety of different configurations. Our results demonstrate that the cross-modal dynamic capture effect was influenced more by visual perceptual grouping when the conditions for intramodal perceptual grouping were set up prior to the presentation of the audiovisual apparent motion stimuli. However, no such modulation occurred when the visual perceptual grouping manipulation was established at the same time as or after the presentation of the audiovisual stimuli. These results highlight the importance of the unimodal perceptual organization of sensory information to the manifestation of multisensory integration.

[1]  M. Posner.  Chronometric explorations of mind : the third Paul M. Fitts lectures, delivered at the University of Michigan, September 1976 , 1978 .

[2]  S. Mateeff,et al.  Dynamic Visual Capture: Apparent Auditory Motion Induced by a Moving Visual Target , 1985, Perception.

[3]  C. Spence,et al.  The Handbook of Multisensory Processing , 2004 .

[4]  S. Soto-Faraco.  Multisensory integration of dynamic information , 2004 .

[5]  Stephen E Palmer,et al.  Top-down influences on perceptual grouping. , 2002, Journal of experimental psychology. Human perception and performance.

[6]  C. Spence,et al.  Multisensory perception: Beyond modularity and convergence , 2000, Current Biology.

[7]  B. Stein,et al.  The Merging of the Senses , 1993 .

[8]  Rolf Nelson,et al.  When does grouping happen? , 2003, Acta psychologica.

[9]  Alan Kingstone,et al.  The ventriloquist in motion: illusory capture of dynamic information across sensory modalities. , 2002, Brain research. Cognitive brain research.

[10]  R. Näätänen,et al.  Foreperiod and simple reaction time. , 1981 .

[11]  M. Roth,et al.  Phosphatidylinositol 4,5-bisphosphate induces actin-based movement of raft-enriched vesicles through WASP-Arp2/3 , 2000, Current Biology.

[12]  D P Phillips,et al.  Spatial and temporal factors in auditory saltation. , 2001, The Journal of the Acoustical Society of America.

[13]  D C Donderi,et al.  The effect of sound on visual apparent movement. , 1983, The American journal of psychology.

[14]  M. Wertheimer.  Laws of organization in perceptual forms. , 1938 .

[15]  J. Driver,et al.  Audiovisual links in exogenous covert spatial orienting , 1997, Perception & psychophysics.

[16]  I. Howard,et al.  Human Spatial Orientation , 1966 .

[17]  M. Kilgard,et al.  Anticipated stimuli across skin , 1995, Nature.

[18]  C. Spence,et al.  Multisensory contributions to the perception of motion , 2003, Neuropsychologia.

[19]  G. Essick,et al.  Tactile motion activates the human middle temporal/V5 (MT/V5) complex , 2002, The European journal of neuroscience.

[20]  S E Hall,et al.  Auditory saltation: a new measure for an old illusion. , 1998, The Journal of the Acoustical Society of America.

[21]  P. Bertelson,et al.  The psychology of multimodal perception , 2004 .

[22]  M. Kubovy,et al.  Auditory and visual objects , 2001, Cognition.

[23]  W H Ehrenstein,et al.  A Cross-Modal Aftereffect: Auditory Displacement following Adaptation to Visual Motion , 1996, Perceptual and motor skills.

[24]  O. Reiser,et al.  Principles Of Gestalt Psychology , 1936 .

[25]  S. Grossberg,et al.  Cortical dynamics of form and motion integration: Persistence, apparent motion, and illusory contours , 1996, Vision Research.

[26]  G. Lockhead,et al.  Saltation through the blind spot , 1980, Perception & psychophysics.

[27]  P. A. Kolers,et al.  Sensory specificity of apparent motion. , 1981, Journal of experimental psychology. Human perception and performance.

[28]  Charles Spence,et al.  Intramodal perceptual grouping modulates multisensory integration: evidence from the crossmodal dynamic capture task , 2005, Neuroscience Letters.

[29]  F A Geldard,et al.  The saltatory effect in vision. , 1976, Sensory processes.

[30]  S. Shimojo,et al.  When Sound Affects Vision: Effects of Auditory Grouping on Visual Motion Perception , 2001, Psychological science.

[31]  G. C. Zapparoli,et al.  The apparent movement between visual and acoustic stimulus and the problem of intermodal relations. , 1969, Acta psychologica.

[32]  G F Meyer,et al.  The integration of auditory and visual motion signals at threshold , 2003, Perception & psychophysics.

[33]  S. Palmer.  Perceptual Grouping: It's Later Than You Think , 2002 .

[34]  Alan Kingstone,et al.  Cross-modal dynamic capture: congruency effects in the perception of motion across sensory modalities. , 2004, Journal of experimental psychology. Human perception and performance.

[35]  de Gelder.  Sound Enhances Visual Perception: Cross-Modal Effects of Auditory Organization on Vision , 2001 .