A Matched Comparison Across Three Different Sensory Pairs of Cross-Modal Temporal Recalibration From Sustained and Transient Adaptation

Sustained exposure to an asynchronous multisensory signal causes perceived simultaneity to shift in the direction of the leading component of the adapting stimulus. This is known as temporal recalibration, and recent evidence suggests that it can occur very rapidly, even after a single asynchronous audiovisual (AV) stimulus. However, this form of rapid recalibration appears to be unique to AV stimuli, in contrast to recalibration following sustained asynchronies which occurs with audiotactile (AT) and visuotactile (VT) stimuli. This study examines temporal recalibration to AV, VT and AT asynchrony with spatially collocated stimuli using a design that produces both sustained and inter-trial recalibration by combining the traditional sustained adaptation approach with an inter-trial analysis of sequential dependencies in an extended test period. Thus, we compare temporal recalibration to both sustained and transient asynchrony in three crossmodal combinations using the same design, stimuli and observers. The results reveal that prolonged exposure to asynchrony produced equivalent temporal recalibration for all combinations: AV, AT and VT. The pattern for rapid, inter-trial recalibration was very different. Rapid recalibration occurred strongly for AV stimuli, weakly for AT and did not occur at all for VT. For all sensory pairings, recalibration from sustained asynchrony decayed to baseline during the test phase while inter-trial recalibration was present and stable throughout testing, suggesting different mechanisms may underlie adaptation at long and short timescales.

[1]  M. García-Pérez,et al.  Converging evidence that common timing processes underlie temporal-order and simultaneity judgments: a model-based analysis , 2015, Attention, perception & psychophysics.

[2]  D. Whitaker,et al.  Recalibration of perceived time across sensory modalities , 2008, Experimental Brain Research.

[3]  Charles Spence,et al.  Adaptation to audiotactile asynchrony , 2007, Neuroscience Letters.

[4]  D. Whitney,et al.  Serial Dependence in the Perception of Faces , 2014, Current Biology.

[5]  L. Harris,et al.  The effect of exposure to asynchronous audio, visual, and tactile stimulus combinations on the perception of simultaneity , 2008, Experimental Brain Research.

[6]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[7]  Marc O. Ernst,et al.  Multisensory simultaneity recalibration: storage of the aftereffect in the absence of counterevidence , 2012, Experimental Brain Research.

[8]  Massimiliano Di Luca,et al.  Recalibration of multisensory simultaneity: cross-modal transfer coincides with a change in perceptual latency. , 2009, Journal of vision.

[9]  David Alais,et al.  Linear Summation of Repulsive and Attractive Serial Dependencies: Orientation and Motion Dependencies Sum in Motion Perception , 2017, The Journal of Neuroscience.

[10]  P. Mamassian,et al.  Multisensory processing in review: from physiology to behaviour. , 2010, Seeing and perceiving.

[11]  Warrick Roseboom,et al.  Adaptation for multisensory relative timing , 2016, Current Opinion in Behavioral Sciences.

[12]  David Alais,et al.  Audiovisual temporal recalibration occurs independently at two different time scales , 2015, Scientific Reports.

[13]  J. Vroomen,et al.  Temporal recalibration to tactile–visual asynchronous stimuli , 2008, Neuroscience Letters.

[14]  Derek H. Arnold,et al.  Shifts of criteria or neural timing? The assumptions underlying timing perception studies , 2011, Consciousness and Cognition.

[15]  David Alais,et al.  Rapid temporal recalibration occurs crossmodally without stimulus specificity but is absent unimodally , 2014, Brain Research.

[16]  B. Stein,et al.  Adult Plasticity in Multisensory Neurons: Short-Term Experience-Dependent Changes in the Superior Colliculus , 2009, The Journal of Neuroscience.

[17]  Katsumi Watanabe,et al.  Realignment of temporal simultaneity between vision and touch , 2008, Neuroreport.

[18]  D. Alais,et al.  Rapid Recalibration to Audiovisual Asynchrony , 2013, The Journal of Neuroscience.

[19]  Charles Spence,et al.  Exposure to asynchronous audiovisual speech extends the temporal window for audiovisual integration. , 2005, Brain research. Cognitive brain research.

[20]  P. Bertelson,et al.  Recalibration of temporal order perception by exposure to audio-visual asynchrony. , 2004, Brain research. Cognitive brain research.

[21]  D. Bavelier,et al.  Exercising your brain: a review of human brain plasticity and training-induced learning. , 2008, Psychology and aging.

[22]  D. Alais,et al.  Rapid temporal recalibration is unique to audiovisual stimuli , 2014, Experimental Brain Research.

[23]  D. Whitney,et al.  Serial dependence in visual perception , 2011 .

[24]  Jean Vroomen,et al.  No effect of auditory–visual spatial disparity on temporal recalibration , 2007, Experimental Brain Research.

[25]  Derek H. Arnold,et al.  Spatial grouping resolves ambiguity to drive temporal recalibration. , 2011, Journal of experimental psychology. Human perception and performance.

[26]  D. Burr,et al.  Compressive mapping of number to space reflects dynamic encoding mechanisms, not static logarithmic transform , 2014, Proceedings of the National Academy of Sciences.

[27]  L. Harris,et al.  Simultaneity constancy: detecting events with touch and vision , 2005, Experimental Brain Research.

[28]  Charles Spence,et al.  Temporal recalibration during asynchronous audiovisual speech perception , 2007, Experimental Brain Research.

[29]  M. García-Pérez,et al.  On the discrepant results in synchrony judgment and temporal-order judgment tasks: a quantitative model , 2012, Psychonomic bulletin & review.

[30]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[31]  David Alais,et al.  Auditory frequency perception adapts rapidly to the immediate past , 2015, Attention, perception & psychophysics.

[32]  D. Alais,et al.  Visuotactile Temporal Recalibration Transfers Across Different Locations. , 2015, Multisensory research.

[33]  Derek H. Arnold,et al.  Twice Upon a Time , 2011, Psychological science.

[34]  D. Alais,et al.  Love at second sight: Sequential dependence of facial attractiveness in an on-line dating paradigm , 2016, Scientific Reports.

[35]  Benjamin A Rowland,et al.  Organization and plasticity in multisensory integration: early and late experience affects its governing principles. , 2011, Progress in brain research.

[36]  David Alais,et al.  Different coding strategies for the perception of stable and changeable facial attributes , 2016, Scientific Reports.

[37]  S. Nishida,et al.  Recalibration of audiovisual simultaneity , 2004, Nature Neuroscience.

[38]  S. Nishida,et al.  Sensory adaptation for timing perception , 2015, Proceedings of the Royal Society B: Biological Sciences.

[39]  D. Burr,et al.  Combining visual and auditory information. , 2006, Progress in brain research.