On the Role of Mobility and Interaction Topologies in Social Dilemmas

Numerous studies have developed and analysed strategies for maximising utility in social dilemmas from both an individual agent’s perspective and more generally from the viewpoint of a society. In this paper we bring this body of work together by investigating the success of a wide range of strategies in environments with varying characteristics, comparing their success. In particular we study within agent-based simulations, different interaction topologies, agents with and without mobility, and strategies with and without adaptation in the form of reinforcement learning, in both competitive and cooperative settings represented by the Prisoner’s Dilemma and the Stag Hunt, respectively. The results of our experiments show that allowing agents mobility decreases the level of cooperation in the society of agents, due to singular interactions with individual opponents that limit the possibility for direct reciprocity. Unstructured environments similarly support a greater number of singular interactions and thus higher levels of defection in the Prisoner’s Dilemma. In the Stag Hunt, strategies that prioritise risk taking show a greater level of success regardless of environment topology. Our range of experiments yield new insights into the role that mobility and interaction topologies play in the study of cooperation in agent societies.

[1]  Gerhard Weiss,et al.  Valuation of Cooperation and Defection in Small-World Networks : A Behavioral Robotic Approach , 2014 .

[2]  R. Mulet,et al.  Evolutionary prisoner’s dilemma in random graphs , 2003 .

[3]  F. C. Santos,et al.  Scale-free networks provide a unifying framework for the emergence of cooperation. , 2005, Physical review letters.

[4]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[5]  Y. Loewenstein,et al.  The role of first impression in operant learning. , 2013, Journal of experimental psychology. General.

[6]  Katie Atkinson,et al.  Environmental effects on simulated emotional and moody agents , 2017, The Knowledge Engineering Review.

[7]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[8]  Katie Atkinson,et al.  Mood modelling within reinforcement learning , 2017, ECAL.

[9]  Attila Szolnoki,et al.  Resolving social dilemmas on evolving random networks , 2009, 0910.1905.

[10]  E. Fehr A Theory of Fairness, Competition and Cooperation , 1998 .

[11]  K. Tuyls,et al.  Mobility effects on the evolution of co-operation in emotional robotic agents , 2016 .

[12]  Gary E. Bolton,et al.  Social Interaction Promotes Risk Taking in a Stag Hunt Game , 2016 .

[13]  Trevor J. M. Bench-Capon,et al.  Emotion as an Enabler of Co-operation , 2012, ICAART.

[14]  Nicholas C. Wormald,et al.  Generating Random Regular Graphs Quickly , 1999, Combinatorics, Probability and Computing.

[15]  Katie Atkinson,et al.  The Effect of Mobility and Emotion on Interactions in Multi-Agent Systems , 2016, STAIRS.

[16]  Martin A. Nowak,et al.  Evolutionary dynamics on graphs , 2005, Nature.

[17]  Paul Erdös,et al.  On random graphs, I , 1959 .

[18]  Richard Vaughan,et al.  Massively multi-robot simulation in stage , 2008, Swarm Intelligence.

[19]  F. C. Santos,et al.  Social diversity promotes the emergence of cooperation in public goods games , 2008, Nature.

[20]  Albert-László Barabási,et al.  Scale-Free Networks: A Decade and Beyond , 2009, Science.

[21]  Yamir Moreno,et al.  Coordination and growth: the Stag Hunt game on evolutionary networks , 2011 .

[22]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[23]  Van H. Vu,et al.  Generating Random Regular Graphs , 2003, STOC '03.

[24]  G. Szabó,et al.  Cooperation in the noisy case: Prisoner's dilemma game on two types of regular random graphs. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  M. Nowak,et al.  A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game , 1993, Nature.

[26]  Francesco Mondada,et al.  The e-puck, a Robot Designed for Education in Engineering , 2009 .

[27]  Gerhard Weiss,et al.  Influencing Social Networks: An Optimal Control Study , 2014, ECAI.