Metastrategies in Large-Scale Bargaining Settings

This article presents novel methods for representing and analyzing a special class of multiagent bargaining settings that feature multiple players, large action spaces, and a relationship among players’ goals, tasks, and resources. We show how to reduce these interactions to a set of bilateral normal-form games in which the strategy space is significantly smaller than the original settings while still preserving much of their structural relationship. The method is demonstrated using the Colored Trails (CT) framework, which encompasses a broad family of games and has been used in many past studies. We define a set of heuristics (metastrategies) in multiplayer CT games that make varying assumptions about players’ strategies, such as boundedly rational play and social preferences. We show how these CT settings can be decomposed into canonical bilateral games such as the Prisoners’ Dilemma, Stag Hunt, and Ultimatum games in a way that significantly facilitates their analysis. We demonstrate the feasibility of this approach in separate CT settings involving one-shot and repeated bargaining scenarios, which are subsequently analyzed using evolutionary game-theoretic techniques. We provide a set of necessary conditions for CT games for allowing this decomposition. Our results have significance for multiagent systems researchers in mapping large multiplayer CT task settings to smaller, well-known bilateral normal-form games while preserving some of the structure of the original setting.

[1]  Simon Parsons,et al.  A novel method for automatic strategy acquisition in N-player non-zero-sum games , 2006, AAMAS '06.

[2]  Karl Tuyls,et al.  Fairness in multi-agent systems , 2008, Knowl. Eng. Rev..

[3]  Tilman Börgers,et al.  Learning Through Reinforcement and Replicator Dynamics , 1997 .

[4]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[5]  Simon Parsons,et al.  Survival of the Chartist: An Evolutionary Agent-Based Analysis of Stock Market Trading , 2015, AAMAS.

[6]  Jörgen W. Weibull,et al.  Evolutionary Game Theory , 1996 .

[7]  D. M. V. Hesteren Evolutionary Game Theory , 2017 .

[8]  J. M. Smith The theory of games and the evolution of animal conflicts. , 1974, Journal of theoretical biology.

[9]  Ya'akov Gal,et al.  Modeling User Perception of Interaction Opportunities for Effective Teamwork , 2009, 2009 International Conference on Computational Science and Engineering.

[10]  John Dickhaut,et al.  Price Formation in Double Auctions , 2001, E-Commerce Agents.

[11]  William H. Sandholm,et al.  Population Games And Evolutionary Dynamics , 2010, Economic learning and social evolution.

[12]  Rajarshi Das,et al.  Choosing Samples to Compute Heuristic-Strategy Nash Equilibrium , 2003, AMEC.

[13]  R. Maheswaran,et al.  The Social Ultimatum Game , 2012 .

[14]  Jan Ramon,et al.  An evolutionary game-theoretic analysis of poker strategies , 2009, Entertain. Comput..

[15]  Michael P. Wellman,et al.  Scaling simulation-based game analysis through deviation-preserving reduction , 2012, AAMAS.

[16]  Kurt Driessens,et al.  Bayes-Relational Learning of Opponent Models from Incomplete Information in No-Limit Poker , 2008, AAAI.

[17]  Simon Parsons,et al.  Auction Analysis by Normal Form Game Approximation , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[18]  P. Taylor,et al.  Evolutionarily Stable Strategies and Game Dynamics , 1978 .

[19]  W. Güth,et al.  An experimental analysis of ultimatum bargaining , 1982 .

[20]  Hai Yang,et al.  ACM Transactions on Intelligent Systems and Technology - Special Section on Urban Computing , 2014 .

[21]  Tatiana V. Guy,et al.  Decision Making with Imperfect Decision Makers , 2011 .

[22]  Maarten Peeters,et al.  Learning Automata as a Basis for Multi Agent Reinforcement Learning , 2005, EUMAS.

[23]  Sarit Kraus,et al.  Learning Human Negotiation Behavior Across Cultures , 2010 .

[24]  Sarit Kraus,et al.  The influence of social dependencies on decision-making: initial investigations with a new game , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[25]  Steven de Jong,et al.  Fairness in multi-agent systems , 2008, The Knowledge Engineering Review.

[26]  David M. Messick,et al.  INDIVIDUAL ADAPTATIONS AND STRUCTURAL-CHANGE AS SOLUTIONS TO SOCIAL DILEMMAS , 1983 .

[27]  Stuart M. Shieber,et al.  Agent decision-making in open mixed networks , 2010, Artif. Intell..

[28]  Elizabeth Sklar,et al.  Auctions, Evolution, and Multi-agent Learning , 2007, Adaptive Agents and Multi-Agents Systems.

[29]  Colin Camerer,et al.  Foundations of Human Sociality - Economic Experiments and Ethnographic: Evidence From Fifteen Small-Scale Societies , 2004 .

[30]  E. Fehr A Theory of Fairness, Competition and Cooperation , 1998 .

[31]  Ya'akov Gal,et al.  Human-Computer Negotiation in Three-Player Market Settings , 2014, ECAI.

[32]  Mark A. Neerincx,et al.  MICRO-SCALE SOCIAL NETWORK ANALYSIS FOR ULTRA-LONG SPACE FLIGHTS , 2009, IJCAI 2009.

[33]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[34]  Ya'akov Gal,et al.  Modeling Reciprocal Behavior in Human Bilateral Negotiation , 2007, AAAI.

[35]  M. L. Tsetlin On the Behavior of Finite Automata in Random Media , 1961 .

[36]  J. Weibull What have we learned from Evolutionary Game Theory so far , 1998 .

[37]  Simon Parsons,et al.  Evolutionary advantage of foresight in markets , 2012, GECCO '12.

[38]  Tom Lenaerts,et al.  A selection-mutation model for q-learning in multi-agent systems , 2003, AAMAS '03.

[39]  Brit Grosskopf Reinforcement and Directional Learning in the Ultimatum Game with Responder Competition , 2003 .

[40]  G. Tesauro,et al.  Analyzing Complex Strategic Interactions in Multi-Agent Systems , 2002 .

[41]  H. Oosterbeek,et al.  Cultural Differences in Ultimatum Game Experiments: Evidence from a Meta-Analysis , 2001 .

[42]  François Charpillet,et al.  Computing the Equilibria of Bimatrix Games Using Dominance Heuristics , 2006, 2006 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'06).

[43]  Sarit Kraus,et al.  GENIUS: AN INTEGRATED ENVIRONMENT FOR SUPPORTING THE DESIGN OF GENERIC AUTOMATED NEGOTIATORS , 2012, Comput. Intell..