Resonating Minds—Emergent Collaboration Through Hierarchical Active Inference

Working together on complex collaborative tasks requires agents to coordinate their actions. Doing this explicitly or completely prior to the actual interaction is not always possible nor sufficient. Agents also need to continuously understand the current actions of others and quickly adapt their own behavior appropriately. Here we investigate how efficient, automatic coordination processes at the level of mental states (intentions, goals), which we call belief resonance, can lead to collaborative situated problem-solving. We present a model of hierarchical active inference for collaborative agents (HAICA). It combines efficient Bayesian Theory of Mind processes with a perception–action system based on predictive processing and active inference. Belief resonance is realized by letting the inferred mental states of one agent influence another agent’s predictive beliefs about its own goals and intentions. This way, the inferred mental states influence the agent’s own task behavior without explicit collaborative reasoning. We implement and evaluate this model in the Overcooked domain, in which two agents with varying degrees of belief resonance team up to fulfill meal orders. Our results demonstrate that agents based on HAICA achieve a team performance comparable to recent state-of-the-art approaches, while incurring much lower computational costs. We also show that belief resonance is especially beneficial in settings where the agents have asymmetric knowledge about the environment. The results indicate that belief resonance and active inference allow for quick and efficient agent coordination and thus can serve as a building block for collaborative cognitive agents.

[1]  Anca D. Dragan,et al.  On the Utility of Learning about Humans for Human-AI Coordination , 2019, NeurIPS.

[2]  Gal A. Kaminka,et al.  Online goal recognition through mirroring: humans and agents , 2016 .

[3]  Candace L. Sidner,et al.  Collaborative Discourse, Engagement and Always-On Relational Agents , 2010, AAAI Fall Symposium: Dialog with Robots.

[4]  Chris L. Baker,et al.  Rational quantitative attribution of beliefs, desires and percepts in human mentalizing , 2017, Nature Human Behaviour.

[5]  Bilge Mutlu,et al.  Coordination Mechanisms in Human-Robot Collaboration , 2013 .

[6]  David V. Pynadath,et al.  Modeling Theory of Mind and Cognitive Appraisal with Decision-Theoretic Agents , 2011 .

[7]  Stefan Kopp,et al.  A Predictive Processing Model of Perception and Action for Self-Other Distinction , 2018, Front. Psychol..

[8]  Feng Wu,et al.  Online planning for multi-agent systems with bounded communication , 2011, Artif. Intell..

[9]  W. Prinz,et al.  Perceptual resonance: action-induced modulation of perception , 2007, Trends in Cognitive Sciences.

[10]  Karl J. Friston,et al.  Canonical Microcircuits for Predictive Coding , 2012, Neuron.

[11]  Karl J. Friston,et al.  Predictive coding: an account of the mirror neuron system , 2007, Cognitive Processing.

[12]  Mathijs de Weerdt,et al.  Introduction to planning in multiagent systems , 2009, Multiagent Grid Syst..

[13]  H. Francis Song,et al.  Machine Theory of Mind , 2018, ICML.

[14]  Joshua B. Tenenbaum,et al.  The Naïve Utility Calculus as a unified, quantitative framework for action understanding , 2020, Cognitive Psychology.

[15]  Chris L. Baker,et al.  Action understanding as inverse planning , 2009, Cognition.

[16]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[17]  N. Chater,et al.  Unwritten rules: virtual bargaining underpins social interaction, culture, and society , 2014, Trends in Cognitive Sciences.

[18]  Karl J. Friston,et al.  Action and behavior: a free-energy formulation , 2010, Biological Cybernetics.

[19]  Sarit Kraus,et al.  Ad Hoc Autonomous Agent Teams: Collaboration without Pre-Coordination , 2010, AAAI.

[20]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[21]  Eva Onaindia,et al.  Cooperative Multi-Agent Planning , 2017, ACM Comput. Surv..

[22]  Karl J. Friston,et al.  A Duet for one , 2015, Consciousness and Cognition.

[23]  Sebastian Sardiña,et al.  Cost-Based Goal Recognition for Path-Planning , 2017, AAMAS.

[24]  Adam See,et al.  Does the Chimpanzee Have Theory of Mind? , 2021, Encyclopedia of Evolutionary Psychological Science.

[25]  Karl Henrik Johansson,et al.  Event-triggered control for multi-agent systems , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[26]  Paul Cisek,et al.  Cortical mechanisms of action selection: the affordance competition hypothesis , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[27]  Johan Kwisthout,et al.  A computational-level explanation of the speed of goal inference , 2013 .

[28]  Sari R. R. Nijssen,et al.  Joint Action: Mental Representations, Shared Information and General Mechanisms for Coordinating with Others , 2017, Front. Psychol..

[29]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[30]  Thomas Lukasiewicz,et al.  Diversity-Driven Extensible Hierarchical Reinforcement Learning , 2018, AAAI.

[31]  Martin Volker Butz,et al.  Towards the Advantages of Hierarchical Anticipatory Behavioral Control , 2005 .

[32]  Andrea Lockerd Thomaz,et al.  Effects of responding to, initiating and ensuring joint attention in human-robot interaction , 2011, 2011 RO-MAN.

[33]  Joshua B. Tenenbaum,et al.  Too Many Cooks: Bayesian Inference for Coordinating Multi-Agent Collaboration , 2020, Top. Cogn. Sci..

[34]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[35]  Karl J. Friston,et al.  Predictive coding under the free-energy principle , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[36]  Karl J. Friston,et al.  Predictions not commands: active inference in the motor system , 2012, Brain Structure and Function.

[37]  Siddhartha S. Srinivasa,et al.  Human-robot mutual adaptation in collaborative tasks: Models and experiments , 2017, Int. J. Robotics Res..

[38]  Geoffrey J. Gordon,et al.  Bounded real-time dynamic programming: RTDP with monotone upper bounds and performance guarantees , 2005, ICML.

[39]  Sebastian Kahl,et al.  Social Motorics - a predictive processing model for efficient embodied communication , 2020 .

[40]  N. Sebanz,et al.  Psychological research on joint action: Theory and data , 2011 .

[41]  Jie Zhang,et al.  ATSIS: Achieving the Ad hoc Teamwork by Sub-task Inference and Selection , 2019, IJCAI.

[42]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[43]  Sebastian Sardiña,et al.  Cost-Based Goal Recognition for the Path-Planning Domain , 2018, IJCAI.

[44]  Christopher G. Lucas,et al.  People learn other people’s preferences through inverse decision-making , 2017, Cognition.

[45]  G. Csibra,et al.  Teleological reasoning in infancy: the naı̈ve theory of rational action , 2003, Trends in Cognitive Sciences.

[46]  Sarit Kraus,et al.  Making friends on the fly: Cooperating with new teammates , 2017, Artif. Intell..

[47]  Stefan Kopp,et al.  Satisficing Models of Bayesian Theory of Mind for Explaining Behavior of Differently Uncertain Agents: Socially Interactive Agents Track , 2018, AAMAS.

[48]  Tibor Bosse,et al.  A RECURSIVE BDI AGENT MODEL FOR THEORY OF MIND AND ITS APPLICATIONS , 2011, Appl. Artif. Intell..

[49]  L. Schilbach,et al.  The Interactive Self – A Review on Simulating Social Interactions to Understand the Mechanisms of Social Agency , 2019, i-com.

[50]  M. Tomasello,et al.  Understanding and sharing intentions: The origins of cultural cognition , 2005, Behavioral and Brain Sciences.

[51]  Karl J. Friston,et al.  A Free Energy Principle for Biological Systems. , 2012, Entropy.

[52]  Subramanian Ramamoorthy,et al.  Ad hoc coordination in multiagent systems with applications to human-machine interaction , 2013, AAMAS.

[53]  Karl J. Friston A Free Energy Principle for Biological Systems , 2012, Entropy.

[54]  Joshua B. Tenenbaum,et al.  Bayesian Theory of Mind: Modeling Joint Belief-Desire Attribution , 2011, CogSci.