Distinct Kinematic Markers of Demonstration and Joint Action Coordination? Evidence From Virtual Xylophone Playing

When performing joint actions, people modulate instrumental actions to provide additional information for a coactor (Pezzulo, Donnarumma, & Dindo, 2013). Similarly, demonstrators adjust instrumental actions to make them more informative for novice learners (Brand, Baldwin, & Ashburn, 2002). It is unknown whether the kinematic modulations performed to facilitate prediction in joint action coordination and the modulations performed to transmit information about the structure of novel actions are unique, or whether a general type of modulation can take on multiple functions. The present study therefore investigated whether there are unique kinematic markers for demonstration and for different types of joint action. In three experiments participants performed a virtual xylophone task, where they played simple xylophone melodies either alone, for a learner watching them, or together with another participant, while their movements were recorded. Participants increased movement amplitude during joint action and during demonstration. However, during joint action, participants modulated specific velocity parameters depending on whether their joint action partner knew or did not know the action sequence to be performed. The results demonstrate that there are specific kinematic cues to communicate the time and location of upcoming actions to a joint action partner but that there are no unique kinematic cues expressing the “pedagogical” intentions of a demonstrator.

[1]  K. Doya,et al.  A unifying computational framework for motor control and social interaction. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[2]  G. Csibra,et al.  Beyond rational imitation: learning arbitrary means actions from communicative demonstrations. , 2013, Journal of experimental child psychology.

[3]  U. Castiello,et al.  Does the intention to communicate affect action kinematics? , 2009, Consciousness and Cognition.

[4]  Dan Sperber,et al.  Pragmatics, modularity and mindreading , 2002 .

[5]  J. Iverson,et al.  Investigating motionese: The effect of infant-directed action on infants' attention and object exploration. , 2009, Infant behavior & development.

[6]  M. Candidi,et al.  Kinematics fingerprints of leader and follower role-taking during cooperative joint actions , 2013, Experimental Brain Research.

[7]  Cristina Becchio,et al.  Decoding intentions from movement kinematics , 2016, Scientific Reports.

[8]  Rebecca J. Brand,et al.  Infants prefer motionese to adult-directed action. , 2008, Developmental science.

[9]  Katharina J. Rohlfing,et al.  Computational Analysis of Motionese Toward Scaffolding Robot Action Learning , 2009, IEEE Transactions on Autonomous Mental Development.

[10]  A. Fernald,et al.  Expanded Intonation Contours in Mothers' Speech to Newborns. , 1984 .

[11]  D. Wolpert,et al.  Motor prediction , 2001, Current Biology.

[12]  U. Castiello,et al.  The kinematic signature of voluntary actions , 2014, Neuropsychologia.

[13]  Asli Ozyurek,et al.  Iconicity as a communicative strategy: Recipient design in multimodal demonstrations for adults and children , 2013 .

[14]  M. Jeannerod,et al.  The motor theory of social cognition: a critique , 2005, Trends in Cognitive Sciences.

[15]  G. Csibra,et al.  Natural pedagogy , 2009, Trends in Cognitive Sciences.

[16]  N. Sebanz,et al.  Our actions in my mind: Motor imagery of joint action , 2014, Neuropsychologia.

[17]  Cordula Vesper,et al.  Are you ready to jump? Predictive mechanisms in interpersonal coordination. , 2013, Journal of experimental psychology. Human perception and performance.

[18]  B. Rogoff,et al.  Firsthand learning through intent participation. , 2003, Annual review of psychology.

[19]  N. Sebanz,et al.  The role of shared visual information for joint action coordination , 2016, Cognition.

[20]  Cordula Vesper,et al.  Co-Representation of Others’ Task Constraints in Joint Action , 2017, Journal of experimental psychology. Human perception and performance.

[21]  J. Zacks,et al.  Using movement and intentions to understand human activity , 2009, Cognition.

[22]  Natalie Sebanz,et al.  Attention Allocation and Task Representation during Joint Action Planning , 2014, Journal of Cognitive Neuroscience.

[23]  W. Prinz,et al.  How two share a task: corepresenting stimulus-response mappings. , 2005, Journal of experimental psychology. Human perception and performance.

[24]  G. Pezzulo,et al.  Human Sensorimotor Communication: A Theory of Signaling in Online Social Interactions , 2013, PloS one.

[25]  Michael J. Richardson,et al.  Strategic communication and behavioral coupling in asymmetric joint action , 2014, Experimental Brain Research.

[26]  Dare A. Baldwin,et al.  Evidence for ‘motionese’: modifications in mothers’ infant-directed action , 2002 .

[27]  A. Gopnik,et al.  Inferring Action Structure and Causal Relationships in Continuous Sequences of Human Action Cognitive Psychology , 2022 .