Overlapping Coalition Formation via Probabilistic Topic Modeling

Research in cooperative games often assumes that agents know the coalitional values with certainty, and that they can belong to one coalition only. By contrast, this work assumes that the value of a coalition is based on an underlying collaboration structure emerging due to existing but unknown relations among the agents; and that agents can form overlapping coalitions. Specifically, we first propose Relational Rules, a novel representation scheme for cooperative games with overlapping coalitions, which encodes the aforementioned relations, and which extends the well-known MC-nets representation to this setting. We then present a novel decision-making method for decentralized overlapping coalition formation, which exploits probabilistic topic modeling, and in particular, online Latent Dirichlet Allocation. By interpreting formed coalitions as documents, agents can effectively learn topics that correspond to profitable collaboration structures.

[1]  Yair Zick.  Arbitration and Stability in Cooperative Games with Overlapping Coalitions , 2013, IJCAI.

[2]  Michael P. Wellman,et al.  Nash Q-Learning for General-Sum Stochastic Games , 2003, J. Mach. Learn. Res..

[3]  Georgios Chalkiadakis,et al.  Probability Bounds for Overlapping Coalition Formation , 2017, IJCAI.

[4]  Gerhard Weiss,et al.  Multiagent Learning: Basics, Challenges, and Prospects , 2012, AI Mag..

[5]  Michael I. Jordan,et al.  Hierarchical Dirichlet Processes , 2006 .

[6]  Francis R. Bach,et al.  Online Learning for Latent Dirichlet Allocation , 2010, NIPS.

[7]  Michael P. Wellman,et al.  Multiagent Reinforcement Learning: Theoretical Framework and an Algorithm , 1998, ICML.

[8]  Sarit Kraus,et al.  Coalition formation with uncertain heterogeneous information , 2003, AAMAS '03.

[9]  Nicholas R. Jennings,et al.  Overlapping Coalition Formation for Efficient Data Fusion in Multi-Sensor Networks , 2006, AAAI.

[10]  Michael Wooldridge,et al.  Computational Aspects of Cooperative Game Theory , 2011, KES-AMSTA.

[11]  Jean-Pierre Aubin,et al.  Cooperative Fuzzy Games , 1981, Math. Oper. Res..

[12]  Yoav Shoham,et al.  Bayesian Coalitional Games , 2008, AAAI.

[13]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[14]  Edith Elkind,et al.  Arbitrators in overlapping coalition formation games , 2011, AAMAS.

[15]  Karl Tuyls,et al.  Replicator Dynamics for Multi-agent Learning: An Orthogonal Approach , 2009, ALA.

[16]  Anja De Waegenaere,et al.  Cooperative games with stochastic payoffs , 1999, Eur. J. Oper. Res..

[17]  Edith Elkind,et al.  Overlapping coalition formation games: charting the tractability frontier , 2012, AAMAS 2012.

[18]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[19]  Simon Parsons,et al.  What evolutionary game theory tells us about multiagent learning , 2007, Artif. Intell..

[20]  Craig Boutilier,et al.  The Dynamics of Reinforcement Learning in Cooperative Multiagent Systems , 1998, AAAI/IAAI.

[21]  Nicholas R. Jennings,et al.  Coalition structure generation: A survey , 2015, Artif. Intell..

[22]  Nicholas R. Jennings,et al.  Cooperative Games with Overlapping Coalitions , 2010, J. Artif. Intell. Res..

[23]  Craig Boutilier,et al.  Bayesian reinforcement learning for coalition formation under uncertainty , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[24]  J. Nash,et al.  NON-COOPERATIVE GAMES , 1951, Classics in Game Theory.

[25]  Michael I. Jordan,et al.  An Introduction to Variational Methods for Graphical Models , 1999, Machine-mediated learning.

[26]  Michael I. Jordan.  Learning in Graphical Models , 1999, NATO ASI Series.

[27]  Jianguo Jiang,et al.  Searching for overlapping coalitions in multiple virtual organizations , 2010, Inf. Sci..

[28]  D. Fudenberg,et al.  The Theory of Learning in Games , 1998 .

[29]  Sarit Kraus,et al.  Methods for Task Allocation via Agent Coalition Formation , 1998, Artif. Intell..

[30]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[31]  Maria-Florina Balcan,et al.  Learning Cooperative Games , 2015, IJCAI.

[32]  David B. Dunson,et al.  Probabilistic topic models , 2011, KDD '11 Tutorials.

[33]  Yoav Shoham,et al.  Marginal contribution nets: a compact representation scheme for coalitional games , 2005, EC '05.

[34]  Michael L. Littman,et al.  Markov Games as a Framework for Multi-Agent Reinforcement Learning , 1994, ICML.

[35]  Sarit Kraus,et al.  The advantages of compromising in coalition formation with incomplete information , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..