Cross-Modal Training Induces Changes in Spatial Representations Early in the Auditory Processing Pathway

In the ventriloquism aftereffect, brief exposure to a consistent spatial disparity between auditory and visual stimuli leads to a subsequent shift in subjective sound localization toward the positions of the visual stimuli. Such rapid adaptive changes probably play an important role in maintaining the coherence of spatial representations across the various sensory systems. In the research reported here, we used event-related potentials (ERPs) to identify the stage in the auditory processing stream that is modulated by audiovisual discrepancy training. Both before and after exposure to synchronous audiovisual stimuli that had a constant spatial disparity of 15°, participants reported the perceived location of brief auditory stimuli that were presented from central and lateral locations. In conjunction with a sound localization shift in the direction of the visual stimuli (the behavioral ventriloquism aftereffect), auditory ERPs as early as 100 ms poststimulus (N100) were systematically modulated by the disparity training. These results suggest that cross-modal learning was mediated by a relatively early stage in the auditory cortical processing stream.

[1]  M. Scherg,et al.  Intracerebral Sources of Human Auditory-Evoked Potentials , 1999, Audiology and Neurotology.

[2]  G. Recanzone.  Rapidly induced auditory plasticity: the ventriloquism aftereffect. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Paul Bertelson,et al.  The aftereffects of ventriloquism: are they sound-frequency specific? , 2003, Acta psychologica.

[4]  S. Hillyard,et al.  Neural Basis of the Ventriloquist Illusion , 2007, Current Biology.

[5]  J. Lewald.  Rapid adaptation to auditory-visual spatial disparity. , 2002, Learning & memory.

[6]  John C. Middlebrooks,et al.  Auditory Cortex Spatial Sensitivity Sharpens During Task Performance , 2010, Nature Neuroscience.

[7]  Aaron R. Seitz,et al.  Benefits of multisensory learning , 2008, Trends in Cognitive Sciences.

[8]  B. Shinn-Cunningham,et al.  Reference Frame of the Ventriloquism Aftereffect , 2009, The Journal of Neuroscience.

[9]  T. Elbert,et al.  Specific tonotopic organizations of different areas of the human auditory cortex revealed by simultaneous magnetic and electric recordings. , 1995, Electroencephalography and clinical neurophysiology.

[10]  H. Huynh,et al.  Estimation of the Box Correction for Degrees of Freedom from Sample Data in Randomized Block and Split-Plot Designs , 1976 .

[11]  E I Knudsen,et al.  Capacity for plasticity in the adult owl auditory system expanded by juvenile experience. , 1998, Science.

[12]  I. Winkler,et al.  The concept of auditory stimulus representation in cognitive neuroscience. , 1999, Psychological bulletin.

[13]  Andrew J. King,et al.  Visual influences on auditory spatial learning , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[14]  J. Driver,et al.  Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments , 2008, Neuron.

[15]  Brigitte Röder,et al.  Tactile capture of auditory localization: an event‐related potential study , 2010, The European journal of neuroscience.

[16]  G. Recanzone.  Interactions of auditory and visual stimuli in space and time , 2009, Hearing Research.

[17]  Brigitte Röder,et al.  Tactile capture of auditory localization is modulated by hand posture. , 2010, Experimental psychology.

[18]  Paul Bertelson,et al.  The aftereffects of ventriloquism: generalization across sound-frequencies. , 2005, Acta psychologica.

[19]  E Donchin,et al.  A new method for off-line removal of ocular artifact. , 1983, Electroencephalography and clinical neurophysiology.

[20]  F. Perrin,et al.  Tonotopic organization of the human auditory cortex: N100 topography and multiple dipole model analysis. , 1995, Electroencephalography and clinical neurophysiology.