No effect of auditory–visual spatial disparity on temporal recalibration

It is known that the brain adaptively recalibrates itself to small (∼100 ms) auditory–visual (AV) temporal asynchronies so as to maintain intersensory temporal coherence. Here we explored whether spatial disparity between a sound and light affects AV temporal recalibration. Participants were exposed to a train of asynchronous AV stimulus pairs (sound-first or light-first) with sounds and lights emanating from either the same or a different location. Following a short exposure phase, participants were tested on an AV temporal order judgement (TOJ) task. Temporal recalibration manifested itself as a shift of subjective simultaneity in the direction of the adapted audiovisual lag. The shift was equally big when exposure and test stimuli were presented from the same or different locations. These results provide strong evidence for the idea that spatial co-localisation is not a necessary constraint for intersensory pairing to occur.

[1]  H. Heffner,et al.  Visual factors in sound localization in mammals , 1992, The Journal of comparative neurology.

[2]  R Fendrich,et al.  The temporal cross-capture of audition and vision , 2001, Perception & psychophysics.

[3]  Robert B. Welch,et al.  Contributions of audition and vision to temporal rate perception , 1986, Perception & psychophysics.

[4]  M. Kubovy,et al.  Auditory and visual objects , 2001, Cognition.

[5]  Felix Arnold,et al.  Lectures on the Elementary Psychology of Feeling and Attention. , 1908 .

[6]  John K. Tsotsos,et al.  Neurobiology of Attention , 2005 .

[7]  C. Spence,et al.  Audiovisual temporal order judgments , 2003, Experimental Brain Research.

[8]  R. Welch.  Chapter 15 Meaning, attention, and the “unity assumption” in the intersensory bias of spatial and temporal perceptions , 1999 .

[9]  C. Spence,et al.  Visual Prior Entry , 2001, Psychological science.

[10]  T. Bachmann,et al.  Cognitive contributions to the perception of spatial and temporal events (Advances in Psychology, Vol. 129) , 1999 .

[11]  Charles Spence,et al.  Multisensory temporal order judgments: the role of hemispheric redundancy. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[12]  R. Baddeley,et al.  Multisensory temporal order judgments: When two locations are better than one , 2003, Perception & psychophysics.

[13]  C. Spence,et al.  Audiovisual prior entry , 2003, Neuroscience Letters.

[14]  R. Lynn,et al.  A secular decline in the strength of Spearman’s g in Japan , 1994 .

[15]  M. Radeau.  Auditory-visual spatial interaction and modularity , 1994, Current psychology of cognition = Cahiers de psychologie cognitive : CPC.

[16]  Charles Spence,et al.  Adaptation to audiotactile asynchrony , 2007, Neuroscience Letters.

[17]  C. Spence,et al.  CHAPTER 15 – Prior Entry , 2005 .

[18]  Steven A. Hillyard,et al.  Effects of Spatial Congruity on Audio-Visual Multimodal Integration , 2005, Journal of Cognitive Neuroscience.

[19]  P Bertelson,et al.  Cognitive factors and adaptation to auditory-visual discordance , 1978, Perception & psychophysics.

[20]  A. Kingstone,et al.  Auditory capture of vision: examining temporal ventriloquism. , 2003, Brain research. Cognitive brain research.

[21]  G. Recanzone,et al.  Temporal and spatial dependency of the ventriloquism effect , 2001, Neuroreport.

[22]  R. Welch.  Perceptual modification : adapting to altered sensory environments / Robert B. Welch , 1978 .

[23]  J. Vroomen,et al.  An event-related potential investigation of the time-course of temporal ventriloquism , 2005, Neuroreport.

[24]  P. Bertelson,et al.  Recalibration of temporal order perception by exposure to audio-visual asynchrony. , 2004, Brain research. Cognitive brain research.

[25]  Christoph M. Michel,et al.  Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging , 2004, NeuroImage.

[26]  Sidney S. Simon,et al.  Merging of the Senses , 2008, Front. Neurosci..

[27]  C. Spence,et al.  Audio-visual simultaneity judgments , 2005, Perception & psychophysics.

[28]  M. Godfroy,et al.  Spatial Variations of Visual—Auditory Fusion Areas , 2003, Perception.

[29]  D. Bavelier,et al.  Components of visual prior entry , 2003, Cognitive Psychology.

[30]  W. B. Pillsbury.  Lectures or the Elementary Psychology of Feeling and Attention , 1909 .

[31]  D. H. Warren,et al.  Immediate perceptual response to intersensory discrepancy. , 1980, Psychological bulletin.

[32]  P. Bertelson,et al.  Cross-modal bias and perceptual fusion with auditory-visual spatial discordance , 1981, Perception & psychophysics.

[33]  Jean Vroomen,et al.  The role of spatial disparity and hemifields in audio-visual temporal order judgments , 2005, Experimental Brain Research.

[34]  C. Spence,et al.  Multisensory prior entry. , 2001, Journal of experimental psychology. General.

[35]  C. Spence,et al.  Crossmodal Space and Crossmodal Attention , 2004 .

[36]  D. C. Higgins.  Human Spatial Orientation , 1967, The Yale Journal of Biology and Medicine.

[37]  Felice L. Bedford,et al.  Constraints on learning new mappings between perceptual dimensions , 1989 .

[38]  R. Sekuler,et al.  Sound alters visual motion perception , 1997, Nature.

[39]  G. Aschersleben,et al.  Temporal ventriloquism: crossmodal interaction on the time dimension. 1. Evidence from auditory-visual temporal order judgment. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[40]  P. Bertelson.  Chapter 14 Ventriloquism: A case of crossmodal perceptual grouping , 1999 .

[41]  Jean Vroomen,et al.  The spatial constraint in intersensory pairing: no role in temporal ventriloquism. , 2006, Journal of experimental psychology. Human perception and performance.

[42]  Jean Vroomen,et al.  Auditory grouping occurs prior to intersensory pairing: evidence from temporal ventriloquism , 2007, Experimental Brain Research.

[43]  A. Bregman.  Auditory Scene Analysis , 2008 .

[44]  J. Vroomen,et al.  Temporal ventriloquism: sound modulates the flash-lag effect. , 2004, Journal of experimental psychology. Human perception and performance.

[45]  S. Nishida,et al.  Recalibration of audiovisual simultaneity , 2004, Nature Neuroscience.