The influence of a conductor and co-performer on auditory-motor synchronisation, temporal prediction, and ancillary entrainment in a musical drumming task.

Interpersonal coordination is exemplified in ensemble musicians, who coordinate their actions deliberately in order to achieve temporal synchronisation in their performances. However, musicians also move parts of their bodies unintentionally or spontaneously, sometimes in ways that do not directly produce sound from their instruments. Musicians' movements-intentional or otherwise-provide visual signals to co-performers, which might facilitate temporal synchronisation. In large ensembles, a conductor also provides a visual cue, which has been shown to enhance synchronisation. In the present study, we tested how visual cues from a co-performer and a conductor affect processes of temporal anticipation, synchronisation, and ancillary movements in a sample of primarily non-musicians. We used a dyadic synchronisation drumming task, in which paired participants drummed to the beat of tempo-changing music. We manipulated visual access between partners and a virtual conductor. Results showed that the conductor improved synchronisation with the music, but synchrony with the music did not improve when partners could see each other. Temporal prediction was improved when partners saw the conductor, but not each other. Ancillary movements of the head were more synchronised between partners when they could see each other, and greater ancillary synchrony at beat-related frequencies of movement was associated with greater drumming synchrony. These results suggest that compatible audio-visual cues can improve intentional synchronisation, that ancillary movements are affected by seeing a partner, and that attended vs. incidental visual cues thus have partially dissociable effects on temporal coordination during joint action.

[1]  Alan M Wing,et al.  Timing and trajectory in rhythm production. , 2007, Journal of experimental psychology. Human perception and performance.

[2]  P. Keller,et al.  Working memory and auditory imagery predict sensorimotor synchronisation with expressively timed music , 2018, Quarterly journal of experimental psychology.

[3]  A. M. Wing,et al.  Being discrete helps keep to the beat , 2009, Experimental Brain Research.

[4]  L. Craighero,et al.  Leadership in Orchestra Emerges from the Causal Relationships of Movement Kinematics , 2012, PloS one.

[5]  Pressing,et al.  Error Correction Processes in Temporal Pattern Production. , 1998, Journal of mathematical psychology.

[6]  Benoît G. Bardy,et al.  Continuity of Visual and Auditory Rhythms Influences Sensorimotor Coordination , 2012, PloS one.

[7]  Laurence R. Harris,et al.  The primal role of the vestibular system in determining musical rhythm , 2009, Cortex.

[8]  Tuomas Eerola,et al.  Shared periodic performer movements coordinate interactions in duo improvisations , 2018, Royal Society Open Science.

[9]  N. Todd,et al.  The sensory-motor theory of rhythm and beat induction 20 years on: a new synthesis and future perspectives , 2015, Front. Hum. Neurosci..

[10]  Michael J. Hove,et al.  The perception of prototypical motion: synchronization is enhanced with quantitatively morphed gestures of musical conductors. , 2012, Journal of experimental psychology. Human perception and performance.

[11]  M. Clayton,et al.  Observing entrainment in music performance: Video-based observational analysis of Indian musicians' tanpura playing and beat marking , 2007 .

[12]  Michael J Richardson,et al.  What would be Usain Bolt's 100-meter sprint world record without Tyson Gay? Unintentional interpersonal synchronization between the two sprinters. , 2015, Journal of experimental psychology. Human perception and performance.

[13]  P. Keller,et al.  The role of temporal prediction abilities in interpersonal sensorimotor synchronization , 2010, Experimental Brain Research.

[14]  Geoff Luck,et al.  EXPLORING THE SPATIO-TEMPORAL PROPERTIES OF SIMPLE CONDUCTING GESTURES USING A SYNCHRONIZATION TASK , 2008 .

[15]  B. Repp A microcosm of musical expression. I. Quantitative analysis of pianists' timing in the initial measures of Chopin's Etude in E major. , 1998, The Journal of the Acoustical Society of America.

[16]  W. Goebl,et al.  Beating time: How ensemble musicians’ cueing gestures communicate beat position and tempo , 2017, Psychology of music.

[17]  Arnout van de Rijt All-sense-all networks are suboptimal for sensorimotor synchronization. , 2018 .

[18]  J. Sloboda,et al.  Spatio-Temporal Cues for Visually Mediated Synchronization , 2009 .

[19]  B. Repp Sensorimotor synchronization: A review of the tapping literature , 2005, Psychonomic bulletin & review.

[20]  T. Vicsek,et al.  Self-organizing processes: The sound of many hands clapping , 2000, Nature.

[21]  Manuel Varlet,et al.  The influence of visual cues on temporal anticipation and movement synchronization with musical sequences. , 2018, Acta psychologica.

[22]  Alfons Schnitzler,et al.  Perception in action: the impact of sensory information on sensorimotor synchronization in musicians and non-musicians. , 2010, Acta psychologica.

[23]  F. Bailes,et al.  Synchronization in Singing Duo Performances: The Roles of Visual Contact and Leadership Instruction , 2018, Front. Psychol..

[24]  J. Davidson Bodily movement and facial actions in expressive musical performance by solo and duo instrumentalists: Two distinctive case studies , 2012 .

[25]  B. Repp,et al.  Sensorimotor synchronization: A review of recent research (2006–2012) , 2013, Psychonomic Bulletin & Review.

[26]  R. Tibshirani,et al.  An introduction to the bootstrap , 1993 .

[27]  C Athena Aktipis,et al.  The ecology of entrainment: Foundations of coordinated rhythmic movement. , 2010, Music perception.

[28]  Anthony Chemero,et al.  Improvisation and the self-organization of multiple musical bodies , 2015, Front. Psychol..

[29]  Michael J. Richardson,et al.  Effects of visual and verbal interaction on unintentional interpersonal coordination. , 2005, Journal of experimental psychology. Human perception and performance.

[30]  Peter E. Keller,et al.  Mutual Adaptive Timing in Interpersonal Action Coordination , 2013 .

[31]  P. Keller,et al.  Individual Differences, Auditory Imagery, and the Coordination of Body Movements and Sounds in Musical Ensembles , 2010 .

[32]  Marcelo M. Wanderley,et al.  Music and Motion: How Music-Related Ancillary Body Movements Contribute to the Experience of Music , 2009 .

[33]  Hui-Ya Chen,et al.  The synchronisation of lower limb responses with a variable metronome: the effect of biomechanical constraints on timing. , 2005, Gait & posture.

[34]  Michael J. Richardson,et al.  Articulatory constraints on interpersonal postural coordination. , 2007, Journal of experimental psychology. Human perception and performance.

[35]  Michael J. Hove,et al.  Rhythm in joint action: psychological and neurophysiological mechanisms for real-time interpersonal coordination , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[36]  L. Trainor,et al.  Vestibular influence on auditory metrical interpretation , 2008, Brain and Cognition.

[37]  Jennifer MacRitchie,et al.  Inferring musical structure through bodily gestures , 2013 .

[38]  P. Keller,et al.  Modulation of individual auditory-motor coordination dynamics through interpersonal visual coupling , 2017, Scientific Reports.

[39]  Johann Issartel,et al.  Sensorimotor synchronization with audio-visual stimuli: limited multisensory integration , 2014, Experimental Brain Research.

[40]  Michael J. Spivey,et al.  Compatibility of motion facilitates visuomotor synchronization. , 2010, Journal of experimental psychology. Human perception and performance.

[41]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[42]  R. Schmidt,et al.  Evaluating the Dynamics of Unintended Interpersonal Coordination , 1997 .

[43]  Sara J Gilliland,et al.  Interpersonal synchronization during side by side treadmill walking is influenced by leg length differential and altered sensory feedback. , 2009, Human movement science.

[44]  C. Palmer,et al.  Synchronization of Timing and Motion 435 , 2022 .

[45]  W. Goebl,et al.  Communication for coordination: gesture kinematics and conventionality affect synchronization success in piano duos , 2017, Psychological Research.

[46]  S. Kawase Gazing behavior and coordination during piano duo performance , 2013, Attention, Perception, & Psychophysics.

[47]  Tatsuyuki Ohtsuki,et al.  Coordination modes in sensorimotor synchronization of whole-body movement: a study of street dancers and non-dancers. , 2011, Human movement science.

[48]  Luciano Fadiga,et al.  Measuring social interaction in music ensembles , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[49]  Kris N Kirby,et al.  BootES: An R package for bootstrap confidence intervals on effect sizes , 2013, Behavior research methods.

[50]  Michael J. Richardson,et al.  Influence of stimulus velocity profile on rhythmic visuomotor coordination. , 2014, Journal of experimental psychology. Human perception and performance.

[51]  Andreas Daffertshofer,et al.  Keeping with the beat: movement trajectories contribute to movement timing , 2004, Experimental Brain Research.

[52]  B. Repp,et al.  Synchronization with competing visual and auditory rhythms: bouncing ball meets metronome , 2013, Psychological research.

[53]  Bruno H Repp,et al.  Phase correction in sensorimotor synchronization: nonlinearities in voluntary and involuntary responses to perturbations. , 2002, Human movement science.

[54]  J. Grahn See what I hear? Beat perception in auditory and visual rhythms , 2012, Experimental Brain Research.

[55]  R. Schubotz Prediction of external events with our motor system: towards a new framework , 2007, Trends in Cognitive Sciences.

[56]  C. Frith,et al.  Follow you, Follow me: Continuous Mutual Prediction and Adaptation in Joint Tapping , 2010, Quarterly journal of experimental psychology.

[57]  M. T. Elliott,et al.  Multisensory cues improve sensorimotor synchronisation , 2010, The European journal of neuroscience.

[58]  B. Repp On the nature of phase attraction in sensorimotor synchronization with interleaved auditory sequences. , 2004, Human movement science.

[59]  S H Strogatz,et al.  Coupled oscillators and biological synchronization. , 1993, Scientific American.

[60]  Michael J Richardson,et al.  Influence of stimulus amplitude on unintended visuomotor entrainment. , 2012, Human movement science.

[61]  Vivek Kant,et al.  Toward a dynamical theory of body movement in musical performance , 2014, Front. Psychol..

[62]  Michael J. Hove,et al.  Spatiotemporal relations and movement trajectories in visuomotor synchronization , 2010 .

[63]  Michael J. Richardson,et al.  Rocking together: dynamics of intentional and unintentional interpersonal coordination. , 2007, Human movement science.

[64]  B. Schultz,et al.  Individual Differences in Temporal Anticipation and Adaptation During Sensorimotor Synchronization , 2015 .

[65]  Sy-Miin Chow,et al.  An Unscented Kalman Filter Approach to the Estimation of Nonlinear Dynamical Systems Models , 2007, Multivariate behavioral research.

[66]  Michael J. Richardson,et al.  Informational constraints on spontaneous visuomotor entrainment. , 2015, Human movement science.

[67]  G. Luck,et al.  Ensemble Musicians’ Synchronization With Conductors’ Gestures: An Automated Feature-Extraction Analysis , 2006 .

[68]  Peter E. Keller,et al.  Synchronizing with auditory and visual rhythms: An fMRI assessment of modality differences and modality appropriateness , 2013, NeuroImage.

[69]  Michael J Richardson,et al.  Visual tracking and entrainment to an environmental rhythm. , 2007, Journal of experimental psychology. Human perception and performance.

[70]  Bruno H Repp,et al.  Rate Limits in Sensorimotor Synchronization With Auditory and Visual Sequences: The Synchronization Threshold and the Benefits and Costs of Interval Subdivision , 2003, Journal of motor behavior.

[71]  A. Saygin,et al.  The role of appearance and motion in action prediction , 2012, Psychological research.

[72]  W. Goebl,et al.  When they listen and when they watch: Pianists’ use of nonverbal audio and visual cues during duet performance , 2015, Musicae scientiae : the journal of the European Society for the Cognitive Sciences of Music.

[73]  N. Sebanz,et al.  Psychological research on joint action: Theory and data , 2011 .

[74]  P. Keller,et al.  Knowing too little or too much: the effects of familiarity with a co-performer's part on interpersonal coordination in musical ensembles , 2013, Front. Psychol..