Incomplete information about the partner affects the development of collaborative strategies in joint action

Physical interaction with a partner plays an essential role in our life experience and is the basis of many daily activities. When two physically coupled humans have different and partly conflicting goals, they face the challenge of negotiating some type of collaboration. This requires that both subjects understand their opponent’s state and current actions. But, how would the collaboration be affected if information about their opponent were unreliable or incomplete? Here we show that incomplete information about the partner affects not only the speed at which a collaborative strategy is achieved (less information, slower learning), but also the modality of the collaboration. In particular, incomplete or unreliable information leads to an interaction strategy characterized by alternating leader-follower roles. In contrast, more reliable information leads to a more synchronous behavior, in which no specific roles can be identified. Simulations based on a combination of game theory and Bayesian estimation suggested that synchronous behaviors denote optimal interaction (Nash equilibrium). Roles emerge as sub-optimal forms of interaction, which minimize the need to know about the partner. These findings suggest that physical interaction strategies are shaped by the trade-off of between the task requirements and the uncertainty of the information available about the opponent. Author summary Many activities in daily life involve physical interaction with a partner or opponent. In many situations they have conflicting goals. Therefore, they need to negotiate some form of collaboration. Although very common, these situations have rarely been studied empirically. In this study, we specifically address what is a ‘optimal’ collaboration and how it can be achieved. We also address how developing a collaboration is affected by uncertainty about the partner. Through a combination of empirical studies and computer simulations based on game theory, we show that subject pairs (dyads) are capable of developing stable collaborations, but the learned collaboration strategy depends on the reliability of the information about the partner. High-information dyads converge to the optimal strategies in game-theoretic sense. Low-information dyads converge to strategies that minimize the need to know about the partner. These findings are consistent with a game theoretic learning model which relies on estimates of partner actions, but not partner goals. This similarity sheds some light on the minimal computational machinery which is necessary to an intelligent agent in order to develop stable physical collaborations.

[1]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[2]  R C Miall,et al.  System Identification Applied to a Visuomotor Task: Near-Optimal Human Performance in a Noisy Changing Task , 2003, The Journal of Neuroscience.

[3]  M. Ernst,et al.  The statistical determinants of adaptation rate in human reaching. , 2008, Journal of vision.

[4]  S. Vajda,et al.  GAMES AND DECISIONS; INTRODUCTION AND CRITICAL SURVEY. , 1958 .

[5]  M. Cripps The theory of learning in games. , 1999 .

[6]  Mitsuo Kawato,et al.  Physically interacting individuals estimate the partner’s goal to enhance their movements , 2017, Nature Human Behaviour.

[7]  T. Başar,et al.  Dynamic Noncooperative Game Theory, 2nd Edition , 1998 .

[8]  K. Shapiro,et al.  The contingent negative variation (CNV) event-related potential (ERP) predicts the attentional blink , 2008 .

[9]  O. H. Brownlee,et al.  ACTIVITY ANALYSIS OF PRODUCTION AND ALLOCATION , 1952 .

[10]  U. Alon,et al.  The mirror game as a paradigm for studying the dynamics of two people improvising motion together , 2011, Proceedings of the National Academy of Sciences.

[11]  Junya Masumoto,et al.  Two heads are better than one: both complementary and synchronous strategies facilitate joint action. , 2013, Journal of neurophysiology.

[12]  Kyle B. Reed,et al.  Physical Collaboration of Human-Human and Human-Robot Teams , 2008, IEEE Transactions on Haptics.

[13]  M. Kawato,et al.  Two is better than one: Physical interactions improve motor performance in humans , 2014, Scientific Reports.

[14]  P. Mermelstein,et al.  Opposite Effects of mGluR1a and mGluR5 Activation on Nucleus Accumbens Medium Spiny Neuron Dendritic Spine Density , 2016, PloS one.

[15]  Etienne Burdet,et al.  Dissociating Variability and Effort as Determinants of Coordination , 2009, PLoS Comput. Biol..

[16]  J. Robinson AN ITERATIVE METHOD OF SOLVING A GAME , 1951, Classics in Game Theory.

[17]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[18]  Helen J. Wall,et al.  No evidence for shared representations of task sets in joint task switching , 2016, Psychological Research.

[19]  J. Krakauer,et al.  A computational neuroanatomy for motor control , 2008, Experimental Brain Research.

[20]  Cordula Vesper,et al.  A minimal architecture for joint action , 2010, Neural Networks.

[21]  R. Ivry,et al.  The coordination of movement: optimal feedback control and beyond , 2010, Trends in Cognitive Sciences.

[22]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[23]  Etienne Burdet,et al.  Motion Plan Changes Predictably in Dyadic Reaching , 2016, PloS one.

[24]  Daniel A. Braun,et al.  Motor coordination: when two have to act as one , 2011, Experimental Brain Research.

[25]  Daniel A. Braun,et al.  Nash Equilibria in Multi-Agent Motor Interactions , 2009, PLoS Comput. Biol..

[26]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[27]  G. Rizzolatti,et al.  Neural and Computational Mechanisms of Action Processing: Interaction between Visual and Motor Representations , 2015, Neuron.

[28]  Robert J. van Beers,et al.  How does our motor system determine its learning rate , 2012 .

[29]  Robrecht P R D van der Wel,et al.  Let the force be with us: dyads exploit haptic coupling for coordination. , 2011, Journal of experimental psychology. Human perception and performance.

[30]  H. Raiffa,et al.  GAMES AND DECISIONS; INTRODUCTION AND CRITICAL SURVEY. , 1958 .

[31]  Cagatay Basdogan,et al.  Supporting Negotiation Behavior with Haptics-Enabled Human-Computer Interfaces , 2012, IEEE Transactions on Haptics.

[32]  L. Sentis,et al.  The CHAI Libraries , 2003 .

[33]  Junya Masumoto,et al.  A leader–follower relationship in joint action on a discrete force production task , 2014, Experimental Brain Research.

[34]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[35]  Eric van Damme,et al.  Non-Cooperative Games , 2000 .

[36]  Peter M. Vishton,et al.  Haptically Linked Dyads , 2006, Psychological science.

[37]  Daniel A. Braun,et al.  The effect of model uncertainty on cooperation in sensorimotor interactions , 2013, Journal of The Royal Society Interface.

[38]  E. Burdet,et al.  Interpersonal strategies for disturbance attenuation during a rhythmic joint motor action , 2015, Physiology & Behavior.

[39]  Etienne Burdet,et al.  Haptic communication between humans is tuned by the hard or soft mechanics of interaction , 2018, PLoS Comput. Biol..

[40]  Raymond H. Cuijpers,et al.  Joint Action: Neurocognitive Mechanisms Supporting Human Interaction , 2009, Top. Cogn. Sci..

[41]  W. Prinz,et al.  How two share a task: corepresenting stimulus-response mappings. , 2005, Journal of experimental psychology. Human perception and performance.

[42]  D. Rosenbaum,et al.  Etiquette and Effort , 2011, Psychological science.

[43]  Robert J. van Beers,et al.  How Does Our Motor System Determine Its Learning Rate? , 2012, PloS one.

[44]  C. Frith,et al.  Follow you, Follow me: Continuous Mutual Prediction and Adaptation in Joint Tapping , 2010, Quarterly journal of experimental psychology.

[45]  Konrad P. Körding,et al.  Uncertainty of Feedback and State Estimation Determines the Speed of Motor Adaptation , 2009, Front. Comput. Neurosci..

[46]  Helen J. Wall,et al.  Sharing tasks or sharing actions? Evidence from the joint Simon task , 2016, Psychological research.