Tutorial and simulations with ADAM: an adaptation and anticipation model of sensorimotor synchronization

Interpersonal coordination of movements often involves precise synchronization of action timing, particularly in expert domains such as ensemble music performance. According to the adaptation and anticipation model (ADAM) of sensorimotor synchronization, precise yet flexible interpersonal coordination is supported by reactive error correction mechanisms and anticipatory mechanisms that exploit systematic patterns in stimulus timing to plan future actions. Here, we provide a tutorial introduction to the computational architecture of ADAM and present a series of single- and dual-virtual agent simulations that examine the model parameters that produce ideal synchronization performance in different tempo conditions. In the single-agent simulations, a virtual agent synchronized responses to steady tempo sequence or a sequence containing gradual tempo changes. Parameters controlling basic reactive error (phase) correction were sufficient for producing ideal synchronization performance at the steady tempo, whereas parameters controlling anticipatory mechanisms were necessary for ideal performance with a tempo-changing sequence. In the dual-agent simulations, two interacting virtual agents produced temporal sequences from either congruent or incongruent internal performance templates specifying a steady tempo or tempo changes. Ideal performance was achieved with reactive error correction alone when both agents implemented the same performance template (either steady tempo or tempo change). In contrast, anticipatory mechanisms played a key role when one agent implemented a steady tempo template and the other agent implemented a tempo change template. These findings have implications for understanding the interplay between reactive and anticipatory mechanisms when agents possess compatible versus incompatible representations of task goals during human–human and human–machine interaction.

[1]  C. Frith,et al.  Follow you, Follow me: Continuous Mutual Prediction and Adaptation in Joint Tapping , 2010, Quarterly journal of experimental psychology.

[2]  Peter E. Keller,et al.  Adaptation to tempo changes in sensorimotor synchronization: Effects of intention, attention, and awareness , 2004, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[3]  A. Wing,et al.  Optimal feedback correction in string quartet synchronization , 2014, Journal of The Royal Society Interface.

[4]  Ivana Konvalinka,et al.  Synchronised and complementary coordination mechanisms in an asymmetric joint aiming task , 2014, Experimental Brain Research.

[5]  Philip W. Fink,et al.  Local and global stabilization of coordination by sensory information , 2000, Experimental Brain Research.

[6]  Peter E. Keller,et al.  Gait improvement via rhythmic stimulation in Parkinson’s disease is linked to rhythmic skills , 2017, Scientific Reports.

[7]  Ramesh Balasubramaniam,et al.  Two different processes for sensorimotor synchronization in continuous and discontinuous rhythmic movements , 2009, Experimental Brain Research.

[8]  T. Vicsek,et al.  Self-organizing processes: The sound of many hands clapping , 2000, Nature.

[9]  A. Gabrielsson Music Performance Research at the Millennium , 2003 .

[10]  P. Keller,et al.  Interpersonal visual interaction induces local and global stabilisation of rhythmic coordination , 2018, Neuroscience Letters.

[11]  Caroline Palmer,et al.  Temporal coordination and adaptation to rate change in music performance. , 2011, Journal of experimental psychology. Human perception and performance.

[12]  P. Keller,et al.  Working memory and auditory imagery predict sensorimotor synchronisation with expressively timed music , 2018, Quarterly journal of experimental psychology.

[13]  J. A. Scott Kelso,et al.  Virtual Partner Interaction (VPI): Exploring Novel Behaviors via Coordination Dynamics , 2009, PloS one.

[14]  E. Large,et al.  Neural Networks for Beat Perception in Musical Rhythm , 2015, Front. Syst. Neurosci..

[15]  J. Devin McAuley,et al.  Modeling effects of rhythmic context on perceived duration: a comparison of interval and entrainment approaches to short-interval timing. , 2003, Journal of experimental psychology. Human perception and performance.

[16]  Peter E. Keller,et al.  Mutual Adaptive Timing in Interpersonal Action Coordination , 2013 .

[17]  Peter E Keller,et al.  Sensorimotor synchronization with adaptively timed sequences. , 2008, Human movement science.

[18]  Giacomo Novembre,et al.  Motor simulation and the coordination of self and other in real-time joint action. , 2014, Social cognitive and affective neuroscience.

[19]  Dirk Vorberg,et al.  Linear phase-correction in synchronization: predictions, parameter estimation, and simulations , 2002 .

[20]  Peter E Keller,et al.  Auditory Pitch Imagery and Its Relationship to Musical Synchronization , 2009, Annals of the New York Academy of Sciences.

[21]  F. Hettinga,et al.  Oxford and Cambridge Boat Race: Performance, Pacing and Tactics Between 1890 and 2014 , 2016, Sports Medicine.

[22]  Michael J. Hove,et al.  Interactive Rhythmic Auditory Stimulation Reinstates Natural 1/f Timing in Gait of Parkinson's Patients , 2012, PloS one.

[23]  D Hary,et al.  On the performance and stability of human metronome-synchronization strategies. , 1987, The British journal of mathematical and statistical psychology.

[24]  B. Schultz,et al.  Individual Differences in Temporal Anticipation and Adaptation During Sensorimotor Synchronization , 2015 .

[25]  P. Keller Musical ensemble performance : A theoretical framework and empirical findings on interpersonal coordination , 2013 .

[26]  J. Kelso,et al.  The Metastable Brain , 2014, Neuron.

[27]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[28]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[29]  Merav Ahissar,et al.  Parameter estimation of linear sensorimotor synchronization models : phase correction, period correction, and ensemble synchronization , 2015 .

[30]  B. Repp,et al.  Sensorimotor synchronization: A review of recent research (2006–2012) , 2013, Psychonomic Bulletin & Review.

[31]  Dirk Vorberg,et al.  Keeping Synchrony While Tempo Changes: Accelerando and Ritardando , 2005 .

[32]  C Athena Aktipis,et al.  The ecology of entrainment: Foundations of coordinated rhythmic movement. , 2010, Music perception.

[33]  John A. Michon,et al.  Timing in temporal tracking , 1967 .

[34]  G. Knoblich,et al.  Action coordination in groups and individuals: learning anticipatory control. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[35]  Alan M. Wing The uncertain motor system: perspectives on the variability of movement , 1993 .

[36]  Laurel D. Riek,et al.  Movement Coordination in Human–Robot Teams: A Dynamical Systems Approach , 2016, IEEE Transactions on Robotics.

[37]  B. Repp,et al.  Self versus other in piano performance: detectability of timing perturbations depends on personal playing style , 2010, Experimental Brain Research.

[38]  Peter E. Keller,et al.  The ADaptation and Anticipation Model (ADAM) of sensorimotor synchronization , 2013, Front. Hum. Neurosci..

[39]  Enzo Tagliazucchi,et al.  Small perturbations in a finger-tapping task reveal inherent nonlinearities of the underlying error correction mechanism. , 2013, Human movement science.

[40]  Jeff Pressing,et al.  The referential dynamics of cognition and action , 1999 .

[41]  Natalie Sebanz,et al.  Prediction in Joint Action: What, When, and Where , 2009, Top. Cogn. Sci..

[42]  Sarah-Jayne Blakemore,et al.  The role of motor contagion in the prediction of action , 2005, Neuropsychologia.

[43]  B. Repp Sensorimotor synchronization: A review of the tapping literature , 2005, Psychonomic bulletin & review.

[44]  Peter E. Keller,et al.  Musical ensemble performance : representing self, other, and joint action outcomes , 2016 .

[45]  Nori Jacoby,et al.  A general linear framework for the comparison and evaluation of models of sensorimotor synchronization , 2012, Biological Cybernetics.

[46]  Michael J. Hove,et al.  Rhythm in joint action: psychological and neurophysiological mechanisms for real-time interpersonal coordination , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[47]  P. Keller,et al.  Neural correlates of auditory temporal predictions during sensorimotor synchronization , 2011, Front. Hum. Neurosci..

[48]  P. Keller,et al.  The role of temporal prediction abilities in interpersonal sensorimotor synchronization , 2010, Experimental Brain Research.

[49]  B. Repp,et al.  Quantifying phase correction in sensorimotor synchronization: empirical comparison of three paradigms. , 2012, Acta psychologica.

[50]  Steffen A. Herff,et al.  Negotiating between individual and joint goals in ensemble musical performance , 2018, Quarterly journal of experimental psychology.

[51]  P. Keller,et al.  Knowing too little or too much: the effects of familiarity with a co-performer's part on interpersonal coordination in musical ensembles , 2013, Front. Psychol..

[52]  P. Janata,et al.  Being and feeling in sync with an adaptive virtual partner: brain mechanisms underlying dynamic cooperativity. , 2013, Cerebral cortex.

[53]  Viktor Müller,et al.  Interactive brains, social minds , 2011, Communicative & integrative biology.

[54]  Peter E. Keller,et al.  Embodied expression through entrainment and co-representation in musical ensemble performance , 2017 .

[55]  S. Kotz,et al.  Modeling effects of cerebellar and basal ganglia lesions on adaptation and anticipation during sensorimotor synchronization , 2015, Annals of the New York Academy of Sciences.

[56]  Nienke Meulman,et al.  An ERP study on L2 syntax processing: When do learners fail? , 2014, Front. Psychol..

[57]  P. Keller,et al.  Sensorimotor synchronization with tempo-changing auditory sequences: Modeling temporal adaptation and anticipation , 2015, Brain Research.

[58]  C. Stevens,et al.  The E-music box: an empirical method for exploring the universal capacity for musical production and for social interaction through music , 2015, Royal Society Open Science.

[59]  Jirí Mates,et al.  A model of synchronization of motor acts to a stimulus sequence , 1994, Biological Cybernetics.

[60]  Martin J. Pickering,et al.  Edinburgh Research Explorer A cognitive architecture for the coordination of utterances , 2022 .

[61]  A. Kristofferson,et al.  Response delays and the timing of discrete motor responses , 1973 .

[62]  Peter E. Keller,et al.  Leading the follower: An fMRI investigation of dynamic cooperativity and leader–follower strategies in synchronization with an adaptive virtual partner , 2014, NeuroImage.

[63]  A. Schiavio,et al.  Playing together without communicating? A pre-reflective and enactive account of joint musical performance , 2015 .

[64]  Alan M. Wing,et al.  Modeling variability and dependence in timing , 1996 .

[65]  J. Kelso,et al.  The human dynamic clamp as a paradigm for social interaction , 2014, Proceedings of the National Academy of Sciences.

[66]  M. Thaut,et al.  Neurobiological foundations of neurologic music therapy: rhythmic entrainment and the motor system , 2015, Front. Psychol..

[67]  Edward W Large,et al.  Fractal Tempo Fluctuation and Pulse Prediction. , 2009, Music perception.

[68]  Peter E. Keller,et al.  Joint action in music performance , 2008 .

[69]  Peter E. Keller,et al.  Neural alpha oscillations index the balance between self-other integration and segregation in real-time joint action , 2016, Neuropsychologia.