Combining multisensory temporal information for movement synchronisation

The ability to synchronise actions with environmental events is a fundamental skill supporting a variety of group activities. In such situations, multiple sensory cues are usually available for synchronisation, yet previous studies have suggested that auditory cues dominate those from other modalities. We examine the control of rhythmic action on the basis of auditory and haptic cues and show that performance is sensitive to both sources of information for synchronisation. Participants were required to tap the dominant hand index finger in synchrony with a metronome defined by periodic auditory tones, imposed movements of the non-dominant index finger, or both cues together. Synchronisation was least variable with the bimodal metronome as predicted by a maximum likelihood estimation (MLE) model. However, increases in timing variability of the auditory cue resulted in some departures from the MLE model. Our findings indicate the need for further investigation of the MLE account of the integration of multisensory signals in the temporal control of action.

[1]  A. Semjen,et al.  Timing goals in bimanual coordination , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[2]  Alan M. Wing,et al.  Chapter 4 Modeling variability and dependence in timing , 1996 .

[3]  J. J. Denier van der Gon,et al.  Integration of proprioceptive and visual position-information , 1999 .

[4]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[5]  Paul Bertelson,et al.  Temporal ventriloquism: crossmodal interaction on the time dimension. 2. Evidence from sensorimotor synchronization. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[6]  G. Stelmach,et al.  Tutorials in Motor Behavior , 1980 .

[7]  G. Aschersleben Temporal Control of Movements in Sensorimotor Synchronization , 2002, Brain and Cognition.

[8]  M. Landy,et al.  Weighted linear cue combination with possibly correlated error , 2003, Vision Research.

[9]  B H Repp,et al.  Compensation for subliminal timing perturbations in perceptual-motor synchronization , 2000, Psychological research.

[10]  A. Kristofferson,et al.  Response delays and the timing of discrete motor responses , 1973 .

[11]  A. Wing Voluntary Timing and Brain Function: An Information Processing Approach , 2002, Brain and Cognition.

[12]  Peter J Beek,et al.  Unraveling interlimb interactions underlying bimanual coordination. , 2005, Journal of neurophysiology.

[13]  B H Repp,et al.  Phase correction, phase resetting, and phase shifts after subliminal timing perturbations in sensorimotor synchronization. , 2001, Journal of experimental psychology. Human perception and performance.

[14]  G. Aschersleben,et al.  Temporal ventriloquism: crossmodal interaction on the time dimension. 1. Evidence from auditory-visual temporal order judgment. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[15]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[16]  P A Kolers,et al.  Rhythms and responses. , 1985, Journal of experimental psychology. Human perception and performance.

[17]  A. Wing,et al.  The coordination and consistency of rowers in a racing eight. , 1995, Journal of sports sciences.

[18]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[19]  Alan M. Wing,et al.  The dynamics of ensemble: the case for flamenco , 2007 .

[20]  Alan M Wing,et al.  Timing and trajectory in rhythm production. , 2007, Journal of experimental psychology. Human perception and performance.

[21]  Bruno H. Repp,et al.  Auditory dominance in temporal processing: new evidence from synchronization with simultaneous visual and auditory sequences. , 2002, Journal of experimental psychology. Human perception and performance.

[22]  A. M. Wing,et al.  Being discrete helps keep to the beat , 2009, Experimental Brain Research.

[23]  P. Mamassian Overconfidence in an Objective Anticipatory Motor Task , 2008, Psychological science.

[24]  Dirk Vorberg,et al.  Linear phase-correction in synchronization: predictions, parameter estimation, and simulations , 2002 .