Rate Limits in Sensorimotor Synchronization With Auditory and Visual Sequences: The Synchronization Threshold and the Benefits and Costs of Interval Subdivision

Abstract Synchronization of finger taps with an isochronous event sequence becomes difficult when the event rate exceeds a certain limit. In Experiment 1, the synchronization threshold was reached at interonset intervals (IOIs) above 100 ms with auditory tone sequences (in a 1:4 tapping task) but at IOIs above 400 ms with visual flash sequences (1:1 tapping). Using IOIs above those limits, the author investigated in Experiment 2 the reduction in the variability of asynchronies that tends to occur when the intervals between target events are subdivided by additional identical events (1:1 vs 1:n tapping). The subdivision benefit was found to decrease with IOI duration and to turn into a cost at IOIs of 200–250 ms in auditory sequences and at IOIs of 450–500 ms in visual sequences. The auditory results are relevant to the limits of metrical subdivision and beat rate in music. The visual results demonstrate the remarkably weak rhythmicity of (nonmoving) visual stimuli.

[1]  Bruno H Repp,et al.  Auditory dominance in temporal processing: new evidence from synchronization with simultaneous visual and auditory sequences. , 2002, Journal of experimental psychology. Human perception and performance.

[2]  P A Kolers,et al.  Rhythms and responses. , 1985, Journal of experimental psychology. Human perception and performance.

[3]  A Semjen,et al.  Timing precision in continuation and synchronization tapping , 2000, Psychological research.

[4]  M. Peters.  The relationship between variability of intertap intervals and interval duration , 1989 .

[5]  G Aschersleben,et al.  Synchronizing actions with events: The role of sensory information , 1995, Perception & psychophysics.

[6]  Andreas Wohlschläger,et al.  Synchronization error: an error in time perception , 1999 .

[7]  P. V. Wieringen,et al.  Coupling strength in tapping a 2:3 polyrhythm , 1995 .

[8]  V. Iyer.  Embodied Mind, Situated Cognition, and Expressive Microtiming in African-American Music , 2002 .

[9]  E. Large,et al.  The dynamics of attending: How people track time-varying events. , 1999 .

[10]  R M Church,et al.  Scalar Timing in Memory , 1984, Annals of the New York Academy of Sciences.

[11]  Peter J. Beek,et al.  Are frequency-induced transitions in rhythmic coordination mediated by a drop in amplitude? , 1998, Biological Cybernetics.

[12]  J. Mates,et al.  Temporal Integration in Sensorimotor Synchronization , 1994, Journal of Cognitive Neuroscience.

[13]  Simon Grondin,et al.  Duration discrimination of empty and filled intervals marked by auditory and visual signals , 1993, Perception & psychophysics.

[14]  C. Krumhansl,et al.  Mental representations for musical meter. , 1990, Journal of experimental psychology. Human perception and performance.

[15]  Stephen Handel,et al.  The contextual nature of rhythmic interpretation , 1983, Perception & psychophysics.

[16]  E T Klemmer,et al.  Sequences of responses to signals encoded in time only. , 1967, Acta psychologica.

[17]  Simon Grondin,et al.  About optimal timing and stability of Weber fraction for duration discrimination , 2001 .

[18]  Pressing,et al.  Error Correction Processes in Temporal Pattern Production. , 1998, Journal of mathematical psychology.

[19]  Knight Dunlap,et al.  Reaction to rhythmic stimuli with attempt to synchronize. , 1910 .

[20]  L. D. Goodfellow,et al.  An Empirical Comparison of Audition, Vision, and Touch in the Discrimination of Short Intervals of Time , 1934 .

[21]  Paul Fraisse,et al.  II. - Rythmes auditifs et rythmes visuels , 1948 .

[22]  E. Large.  On synchronizing movements to music , 2000 .

[23]  E. Lechelt.  Temporal numerosity discrimination: intermodal comparisons revisited. , 1975, British journal of psychology.

[24]  Alan M. Wing,et al.  Modeling variability and dependence in timing , 1996 .

[25]  W R GARNER.  The accuracy of counting repeated short tones. , 1951, Journal of experimental psychology.

[26]  R. H. Wimmers,et al.  Phase transitions in rhythmic tracking movements: A case of unilateral coupling , 1992 .

[27]  Johan Sundberg,et al.  TIME DISCRIMINATION IN A MONOTONIC, ISOCHRONOUS SEQUENCE , 1995 .

[28]  P. Fitts,et al.  The frequency response of skilled subjects in a pursuit tracking task. , 1955, Journal of experimental psychology.

[29]  G. Madison,et al.  Variability in isochronous tapping: higher order dependencies as a function of intertap interval. , 2001, Journal of experimental psychology. Human perception and performance.

[30]  Robert Edward Taubman,et al.  Studies in Judged Number: II. The Judgment of Visual Number , 1950 .

[31]  R. Chua,et al.  Asymmetries in Coupling Dynamics of Perception and Action. , 1995, Journal of motor behavior.

[32]  Garner Wr.  The accuracy of counting repeated short tones. , 1951 .

[33]  Paul Fraisse,et al.  Sur les repères sensoriels qui permettent de contrôler les mouvements d'accompagnement de stimuli périodiques , 1958 .

[34]  A. Chapanis,et al.  Counting repeated light flashes as a function of their number, their rate of presentation and retinal location stimulated. , 1958, Journal of experimental psychology.

[35]  N. R. Bartlett,et al.  Synchronization of a motor response with an anticipated sensory event. , 1959, Psychological review.

[36]  Jeff A. Bilmes,et al.  Timing is of the essence : perceptual and computational techniques for representing, learning, and reproducing expressive timing in percussive rhythm , 1993 .

[37]  Robert Rousseau,et al.  Duration discrimination of empty time intervals marked by intermodal pulses , 1983, Perception & psychophysics.

[38]  F. Macar,et al.  Sensory effects on judgments of short time-intervals , 1998, Psychological research.

[39]  Robert Edward Taubman,et al.  Studies in Judged Number: I. The Judgment of Auditory Number , 1950 .

[40]  S. Grondin,et al.  Judging the relative duration of multimodal short empty time intervals , 1991, Perception & psychophysics.

[41]  R. Parncutt.  A Perceptual Model of Pulse Salience and Metrical Accent in Musical Rhythms , 1994 .

[42]  J. Gibbon,et al.  Timing and time perception. , 1984, Annals of the New York Academy of Sciences.

[43]  C T WHITE,et al.  Temporal numerosity. III. Auditory perception of number. , 1954, Journal of experimental psychology.

[44]  H. Yabe,et al.  Temporal window of integration revealed by MMN to sound omission , 1997, Neuroreport.

[45]  D W Massaro,et al.  Perceiving and counting sounds. , 1976, Journal of experimental psychology. Human perception and performance.

[46]  Robert H. Gault,et al.  An Empirical Comparison of Audition, Vision, and Touch in the Discrimination of Temporal Patterns and Ability to Reproduce them , 1938 .

[47]  Justin London,et al.  Cognitive Constraints on Metric Systems: Some Observations and Hypotheses , 2002 .

[48]  L. V. Noorden,et al.  Resonance in the Perception of Musical Pulse , 1999 .

[49]  C. Drake,et al.  Reproduction of musical rhythms by children, adult musicians, and adult nonmusicians , 1993, Perception & psychophysics.