Coalition structure generation: A survey

The coalition structure generation problem is a natural abstraction of one of the most important challenges in multi-agent systems: How can a number of agents divide themselves into groups in order to improve their performance? More precisely, the coalition structure generation problem focuses on partitioning the set of agents into mutually disjoint coalitions so that the total reward from the resulting coalitions is maximized. This problem is computationally challenging, even under quite restrictive assumptions. This has prompted researchers to develop a range of algorithms and heuristic approaches for solving the problem efficiently. This article presents a survey of these approaches. In particular, it surveys the main dynamic-programming approaches and anytime algorithms developed for coalition structure generation, and considers techniques specifically developed for a range of compact representation schemes for coalitional games. It also considers settings where there are constraints on the coalitions that are allowed to form, as well as settings where the formation of one coalition could influence the performance of other co-existing coalitions.

[1]  Sarit Kraus,et al.  Formation of overlapping coalitions for precedence-ordered task-execution among autonomous agents * , 1996 .

[2]  N. D. Bruijn Asymptotic methods in analysis , 1958 .

[3]  Nicholas R. Jennings,et al.  On representing coalitional games with externalities , 2009, EC '09.

[4]  Michael Finus,et al.  New developments in coalition theory : An application to the case of global pollution , 2003 .

[5]  Nicholas R. Jennings,et al.  A Hybrid Algorithm for Coalition Structure Generation , 2012, AAAI.

[6]  Abdul Sattar,et al.  Partial Weighted MaxSAT for Optimal Planning , 2010, PRICAI.

[7]  F. Y. Edgeworth Mathematical Psychics: An Essay on the Application of Mathematics to the Moral Sciences , 2007 .

[8]  Nicholas R. Jennings,et al.  Coalitional Games via Network Flows , 2013, IJCAI.

[9]  Kyomin Jung,et al.  Coalitional Structure Generation in Skill Games , 2010, AAAI.

[10]  Shin-ichi Minato,et al.  Zero-Suppressed BDDs for Set Manipulation in Combinatorial Problems , 1993, 30th ACM/IEEE Design Automation Conference.

[11]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[12]  Sarvapali D. Ramchurn,et al.  An Anytime Algorithm for Optimal Coalition Structure Generation , 2014, J. Artif. Intell. Res..

[13]  Michael Wooldridge,et al.  Computational Aspects of Cooperative Game Theory (Synthesis Lectures on Artificial Inetlligence and Machine Learning) , 2011 .

[14]  Nicholas R. Jennings,et al.  Coalition Structure Generation in Multi-Agent Systems with Positive and Negative Externalities , 2009, IJCAI.

[15]  Stefano Ferilli,et al.  Coalition Structure Generation with GRASP , 2010, AIMSA.

[16]  Alan Scheller-Wolf,et al.  Combinatorial Coalition Formation for multi-item group-buying with heterogeneous customers , 2010, Decis. Support Syst..

[17]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[18]  Haris Aziz,et al.  Complexity of coalition structure generation , 2011, AAMAS.

[19]  Nicholas R. Jennings,et al.  Representation of coalitional games with algebraic decision diagrams , 2011, AAMAS.

[20]  Yoav Shoham,et al.  Multiagent Systems - Algorithmic, Game-Theoretic, and Logical Foundations , 2009 .

[21]  I. Cock Encyclopedia of Life Support Systems (EOLSS) , 2011 .

[22]  Miyuki Koshimura,et al.  MaxSAT Encoding for MC-Net-Based Coalition Structure Generation Problem with Externalities , 2014, IEICE Trans. Inf. Syst..

[23]  Nicholas R. Jennings,et al.  An algorithm for distributing coalitional value calculations among cooperating agents , 2007, Artif. Intell..

[24]  Boi Faltings,et al.  A Scalable Method for Multiagent Constraint Optimization , 2005, IJCAI.

[25]  Tomasz P. Michalak,et al.  Optimal Coalition Structure Generation In Partition Function Games , 2008, ECAI.

[26]  Makoto Yokoo,et al.  Handling negative value rules in MC-net-based coalition structure generation , 2012, AAMAS.

[27]  Yoav Shoham,et al.  Marginal contribution nets: a compact representation scheme for coalitional games , 2005, EC '05.

[28]  Sarvapali D. Ramchurn,et al.  On coalition formation with sparse synergies , 2012, AAMAS.

[29]  Simina Brânzei,et al.  Implementation and Computation of a Value for Generalized Characteristic Function Games , 2014, TEAC.

[30]  Shlomo Zilberstein,et al.  Using Anytime Algorithms in Intelligent Systems , 1996, AI Mag..

[31]  Nicholas R. Jennings,et al.  Minimum Search to Establish Worst-Case Guarantees in Coalition Structure Generation , 2011, IJCAI.

[32]  Matti Latva-aho,et al.  On selfish and altruistic coalition formation in cognitive radio networks , 2010, 2010 Proceedings of the Fifth International Conference on Cognitive Radio Oriented Wireless Networks and Communications.

[33]  Georg Gottlob,et al.  Hypertree decompositions and tractable queries , 1998, PODS '99.

[34]  Jeffrey S. Rosenschein,et al.  Coalition, Cryptography, and Stability: Mechanisms for Coalition Formation in Task Oriented Domains , 2018, AAAI.

[35]  Daniel Le Berre,et al.  The Sat4j library, release 2.2 , 2010, J. Satisf. Boolean Model. Comput..

[36]  R. Cornes,et al.  The theory of externalities, public goods, and club goods: Externalities and private information , 1996 .

[37]  Sarit Kraus,et al.  Task Allocation Via Coalition Formation Among Autonomous Agents , 1995, IJCAI.

[38]  Onn Shehory,et al.  Coalition structure generation with worst case guarantees , 2022 .

[39]  Miyuki Koshimura,et al.  Extending MaxSAT to Solve the Coalition Structure Generation Problem with Externalities Based on Agent Relations , 2014, IEICE Trans. Inf. Syst..

[40]  Bernhard Korte,et al.  Optimization and Operations Research , 1976 .

[41]  Sarit Kraus,et al.  Coalition Formation Among Autonomous Agents: Strategies and Complexity , 1993, MAAMAW.

[42]  Philip Wolfe,et al.  Contributions to the theory of games , 1953 .

[43]  Clement A. Tisdell,et al.  On the Theory of Externalities , 1970 .

[44]  Nicholas R. Jennings,et al.  A hybrid exact algorithm for complete set partitioning , 2016, Artif. Intell..

[45]  Victor R. Lesser,et al.  A survey of multi-agent organizational paradigms , 2004, The Knowledge Engineering Review.

[46]  Julie A. Adams,et al.  Constant factor approximation algorithms for coalition structure generation , 2011, Autonomous Agents and Multi-Agent Systems.

[47]  Morteza Zadimoghaddam,et al.  Optimal Coalition Structure Generation in Cooperative Graph Games , 2013, AAAI.

[48]  Tomasz P. Michalak An Exact Algorithm for Coalition Structure Generation and Complete Set Partitioning , 2013 .

[49]  Makoto Yokoo,et al.  A Compact Representation Scheme of Coalitional Games Based on Multi-Terminal Zero-Suppressed Binary Decision Diagrams , 2011, PRIMA.

[50]  Makoto Yokoo,et al.  Concise Characteristic Function Representations in Coalitional Games Based on Agent Types , 2011, IJCAI.

[51]  Nicholas R. Jennings,et al.  An improved dynamic programming algorithm for coalition structure generation , 2008, AAMAS.

[52]  Nicholas R. Jennings,et al.  Anytime coalition structure generation in multi-agent systems with positive or negative externalities , 2012, Artif. Intell..

[53]  Jeffrey S. Rosenschein,et al.  Coalitional skill games , 2008, AAMAS.

[54]  Nicholas R. Jennings,et al.  Generating coalition structures with finite bound from the optimal guarantees , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[55]  B. Peleg,et al.  Introduction to the Theory of Cooperative Games , 1983 .

[56]  Vincent Conitzer,et al.  Coalition Structure Generation Utilizing Compact Characteristic Function Representations , 2009, CP.

[57]  Pravin Varaiya,et al.  Optimal sharing of quantity risk for a coalition of wind power producers facing nodal prices , 2012, 2012 American Control Conference (ACC).

[58]  Sarvapali D. Ramchurn,et al.  C-Link: A Hierarchical Clustering Approach to Large-scale Near-optimal Coalition Formation , 2013, IJCAI.

[59]  Rudolf Berghammer,et al.  On the use of binary decision diagrams for solving problems on simple games , 2012, Eur. J. Oper. Res..

[60]  Vincent Conitzer,et al.  Complexity of constructing solutions in the core based on synergies among coalitions , 2006, Artif. Intell..

[61]  Peter Norvig,et al.  Artificial intelligence - a modern approach, 2nd Edition , 2003, Prentice Hall series in artificial intelligence.

[62]  Andreas Björklund,et al.  Set Partitioning via Inclusion-Exclusion , 2009, SIAM J. Comput..

[63]  Nicholas R. Jennings,et al.  An Efficient Vector-Based Representation for Coalitional Games , 2013, IJCAI.

[64]  Nicholas R. Jennings,et al.  Cooperative Games with Overlapping Coalitions , 2010, J. Artif. Intell. Res..

[65]  Steven P. Ketchpel Coalition Formation Among Autonomous Agents , 1993, MAAMAW.

[66]  D. Yun Yeh,et al.  A Dynamic Programming Approach to the Complete Set Partitioning Problem , 1986, BIT.

[67]  David Zuckerman,et al.  Electronic Colloquium on Computational Complexity, Report No. 100 (2005) Linear Degree Extractors and the Inapproximability of MAX CLIQUE and CHROMATIC NUMBER , 2005 .

[68]  Rina Dechter,et al.  Tree Clustering for Constraint Networks , 1989, Artif. Intell..

[69]  Sarvapali D. Ramchurn,et al.  Anytime coalition structure generation on synergy graphs , 2014, AAMAS.

[70]  C. Carraro The Endogenous Formation of Economic Coalitions , 2003 .

[71]  Zhu Han,et al.  Coalition Games with Cooperative Transmission: A Cure for the Curse of Boundary Nodes in Selfish Packet-Forwarding Wireless Networks , 2007, 2007 5th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks and Workshops.

[72]  Nicole Immorlica,et al.  Coalition Formation and Price of Anarchy in Cournot Oligopolies , 2010, WINE.

[73]  Helena Keinänen,et al.  Simulated Annealing for Multi-agent Coalition Formation , 2009, KES-AMSTA.

[74]  Nicholas R. Jennings,et al.  A distributed algorithm for anytime coalition structure generation , 2010, AAMAS.

[75]  Stephen F. Smith,et al.  Multiagent social learning in large repeated games , 2009 .

[76]  Makoto Yokoo,et al.  Coalition Structure Generation based on Distributed Constraint Optimization , 2010, AAAI.

[77]  Roger B. Myerson,et al.  Graphs and Cooperation in Games , 1977, Math. Oper. Res..

[78]  Xiaotie Deng,et al.  On the Complexity of Cooperative Solution Concepts , 1994, Math. Oper. Res..

[79]  Sarvapali D. Ramchurn,et al.  Anytime Optimal Coalition Structure Generation , 2007, AAAI.

[80]  Nicholas R. Jennings,et al.  A logic-based representation for coalitional games with externalities , 2010, AAMAS.

[81]  John Augustine,et al.  Dynamics of Profit-Sharing Games , 2010, IJCAI.

[82]  Ana L. C. Bazzan,et al.  Distributed Coalition Structure Generation with Positive and Negative Externalities , 2013, EPIA.

[83]  Guido Moerkotte,et al.  Analysis of two existing and one new dynamic programming algorithm for the generation of optimal bushy join trees without cross products , 2006, VLDB.

[84]  Miyuki Koshimura,et al.  Solving the Coalition Structure Generation Problem with MaxSAT , 2012, 2012 IEEE 24th International Conference on Tools with Artificial Intelligence.

[85]  Peter Värbrand,et al.  A strongly polynomial algorithm for a concave production-transportation problem with a fixed number of nonlinear variables , 1996, Math. Program..

[86]  S. Finch Integer partitions , 2021 .

[87]  Mauricio G. C. Resende,et al.  Greedy Randomized Adaptive Search Procedures , 1995, J. Glob. Optim..

[88]  Nicholas R. Jennings,et al.  Coalition Structure Generation : Dynamic Programming Meets Anytime Optimization , 2008 .

[89]  David Zuckerman Linear Degree Extractors and the Inapproximability of Max Clique and Chromatic Number , 2007, Theory Comput..

[90]  Sandip Sen,et al.  Searching for optimal coalition structures , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[91]  Piotr Faliszewski,et al.  Constrained Coalition Formation , 2011, AAAI.

[92]  Makoto Yokoo,et al.  Extension of MC-net-based coalition structure generation: handling negative rules and externalities , 2011, AAMAS.

[93]  Michael Wooldridge,et al.  Computational Aspects of Cooperative Game Theory , 2011, KES-AMSTA.

[94]  Sarvapali D. Ramchurn,et al.  Near-Optimal Anytime Coalition Structure Generation , 2006, IJCAI.

[95]  Paul E. Dunne,et al.  Multiagent Resource Allocation in the Presence of Externalities , 2005, CEEMAS.

[96]  Nicholas R. Jennings,et al.  Coalition Structure Generation over Graphs , 2012, J. Artif. Intell. Res..

[97]  Sarit Kraus,et al.  Methods for Task Allocation via Agent Coalition Formation , 1998, Artif. Intell..

[98]  Tuomas Sandholm,et al.  Algorithm for optimal winner determination in combinatorial auctions , 2002, Artif. Intell..

[99]  Vincent Conitzer,et al.  A Compact Representation Scheme for Coalitional Games in Open Anonymous Environments , 2006, AAAI.

[100]  Wei-Min Shen,et al.  Distributed constraint optimization for multiagent systems , 2003 .

[101]  Nicholas R. Jennings,et al.  Efficient Computation of the Shapley Value for Game-Theoretic Network Centrality , 2014, J. Artif. Intell. Res..

[102]  Bikramjit Banerjee,et al.  Coalition structure generation in multi-agent systems with mixed externalities , 2010, AAMAS.

[103]  W. Lucas,et al.  N‐person games in partition function form , 1963 .

[104]  Donald B. Gillies,et al.  3. Solutions to General Non-Zero-Sum Games , 1959 .