Exposure to delayed visual feedback of the hand changes motor-sensory synchrony perception

We examined whether the brain can adapt to temporal delays between a self-initiated action and the naturalistic visual feedback of that action. During an exposure phase, participants tapped with their index finger while seeing their own hand in real time (~0 ms delay) or delayed at 40, 80, or 120 ms. Following exposure, participants were tested with a simultaneity judgment (SJ) task in which they judged whether the video of their hand was synchronous or asynchronous with respect to their finger taps. The locations of the seen and the real hand were either different (Experiment 1) or aligned (Experiment 2). In both cases, the point of subjective simultaneity (PSS) was uniformly shifted in the direction of the exposure lags while sensitivity to visual-motor asynchrony decreased with longer exposure delays. These findings demonstrate that the brain is quite flexible in adjusting the timing relation between a motor action and the otherwise naturalistic visual feedback that this action engenders.

[1]  S. Nishida,et al.  Recalibration of audiovisual simultaneity , 2004, Nature Neuroscience.

[2]  J. Lackner,et al.  Adaptation to delayed auditory feedback , 1977 .

[3]  Charles Spence,et al.  Temporal recalibration during asynchronous audiovisual speech perception , 2007, Experimental Brain Research.

[4]  R. Shapley,et al.  Light adaptation in the primate retina: Analysis of changes in gain and dynamics of monkey retinal ganglion cells , 1990, Visual Neuroscience.

[5]  J. Vroomen,et al.  Neural correlates of motor–sensory temporal recalibration , 2011, Brain Research.

[6]  G. Aschersleben.  Temporal Control of Movements in Sensorimotor Synchronization , 2002, Brain and Cognition.

[7]  Laurence R. Harris,et al.  The relative timing of active and passive touch , 2008, Brain Research.

[8]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[9]  Massimiliano Di Luca,et al.  Recalibration of multisensory simultaneity: cross-modal transfer coincides with a change in perceptual latency. , 2009, Journal of vision.

[10]  Jean Vroomen,et al.  No effect of auditory–visual spatial disparity on temporal recalibration , 2007, Experimental Brain Research.

[11]  P. Montague,et al.  Motor-Sensory Recalibration Leads to an Illusory Reversal of Action and Sensation , 2006, Neuron.

[12]  Bernard S. Lee.  Some Effects of Side‐Tone Delay , 1950 .

[13]  J. Vroomen,et al.  Perception of Synchrony between the Senses , 2012 .

[14]  Derek H. Arnold,et al.  Shifts of criteria or neural timing? The assumptions underlying timing perception studies , 2011, Consciousness and Cognition.

[15]  W. B. Pillsbury.  Lectures or the Elementary Psychology of Feeling and Attention , 1909 .

[16]  B. Repp.  Sensorimotor synchronization: A review of the tapping literature , 2005, Psychonomic bulletin & review.

[17]  Ilja Frissen,et al.  The aftereffects of ventriloquism: the time course of the visual recalibration of auditory localization. , 2012, Seeing and perceiving.

[18]  A. Cravo,et al.  Voluntary action and causality in temporal binding , 2009, Experimental Brain Research.

[19]  L. C. Ward,et al.  Nerve conduction velocity varies inversely with height , 1981, Muscle & nerve.

[20]  Derek H. Arnold,et al.  Spatial grouping resolves ambiguity to drive temporal recalibration. , 2011, Journal of experimental psychology. Human perception and performance.

[21]  D. Wolpert,et al.  Why can't you tickle yourself? , 2000, Neuroreport.

[22]  J. Mollon,et al.  Latency characteristics of the short-wavelength-sensitive cones and their associated pathways. , 2009, Journal of vision.

[23]  D. Whitaker,et al.  Effect before Cause: Supramodal Recalibration of Sensorimotor Timing , 2009, PloS one.

[24]  M. Buehner,et al.  Causal Binding of Actions to Their Effects , 2009, Psychological science.

[25]  Andreas Wohlschläger,et al.  Intentions and expectations in temporal binding , 2007, Consciousness and Cognition.

[26]  D. Cunningham,et al.  Sensorimotor Adaptation to Violations of Temporal Contiguity , 2001, Psychological science.

[27]  D. Wegner,et al.  Modulating the sense of agency with external cues , 2009, Consciousness and Cognition.

[28]  Bernard S. Lee.  Effects of delayed speech feedback , 1950 .

[29]  P. Haggard,et al.  Who is causing what? The sense of agency is relational and efferent-triggered , 2008, Cognition.

[30]  J. Vroomen,et al.  Temporal recalibration to tactile–visual asynchronous stimuli , 2008, Neuroscience Letters.

[31]  W. Prinz.  Common mechanisms in perception and action. , 2002 .

[32]  David R. Wozny,et al.  Recalibration of Auditory Space following Milliseconds of Cross-Modal Discrepancy , 2011, The Journal of Neuroscience.

[33]  John Schlag,et al.  Transfer of learned perception of sensorimotor simultaneity , 2006, Experimental Brain Research.

[34]  P. Haggard,et al.  Voluntary action and conscious awareness , 2002, Nature Neuroscience.

[35]  Charles Spence,et al.  Adaptation to audiotactile asynchrony , 2007, Neuroscience Letters.

[36]  Jean Vroomen,et al.  Adaptation to motor-visual and motor-auditory temporal lags transfer across modalities , 2009, Experimental Brain Research.

[37]  J. Vroomen,et al.  Perception of intersensory synchrony: A tutorial review , 2010, Attention, perception & psychophysics.

[38]  M. Ernst,et al.  Does audiovisual temporal recalibration store without stimulation , 2010 .

[39]  V. Torre,et al.  Sensory Transduction , 1990, NATO ASI Series.

[40]  P. Bertelson,et al.  Recalibration of temporal order perception by exposure to audio-visual asynchrony. , 2004, Brain research. Cognitive brain research.

[41]  C. Spence,et al.  Adaptation to audiovisual asynchrony modulates the speeded detection of sound , 2009, Proceedings of the National Academy of Sciences.

[42]  D. Wolpert,et al.  Abnormalities in the awareness and control of action. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[43]  C. Spence,et al.  Audiovisual temporal adaptation of speech: temporal order versus simultaneity judgments , 2008, Experimental Brain Research.

[44]  Wolfgang Prinz,et al.  Action, binding and awareness , 2002 .

[45]  L. Harris,et al.  Simultaneity Constancy , 2004, Perception.

[46]  D. Whitaker,et al.  Recalibration of perceived time across sensory modalities , 2008, Experimental Brain Research.

[47]  Charles Spence,et al.  Exposure to asynchronous audiovisual speech extends the temporal window for audiovisual integration. , 2005, Brain research. Cognitive brain research.