A hierarchical clustering approach to large-scale near-optimal coalition formation with quality guarantees

Abstract Coalition formation is a fundamental approach to multi-agent coordination, and a key challenge in this context is the coalition structure generation problem, where a set of agents must be partitioned into the best set of coalitions. This problem is NP-hard and typical optimal algorithms do not scale to more than 50 agents: efficient approximate solutions are therefore needed for hundreds or thousands of agents. In this paper we propose a novel heuristic, based on ideas and tools used in the data clustering domain. In particular, we present a coalition formation algorithm inspired by the well known class of hierarchical agglomerative clustering techniques (Linkage algorithms). We present different variants of the algorithm, which we call Coalition Linkage (C-Link) and demonstrate how such algorithm can be adapted to graph restricted coalition formation problems (where an interaction graph defined among the agents restricts the set of feasible coalitions). Moreover, we discuss how we can provide an upper bound on the value of the optimal coalition structure, and we show that for specific characteristic functions we can provide such bounds while maintaining polynomial computational costs and memory requirements. We empirically evaluate the different variants of the C-Link algorithm on two synthetic benchmark data-sets, as well as in two real world scenarios, involving a collective energy purchasing and a ride-sharing application. In these settings C-Link achieves promising results providing high quality solutions and solving problem involving thousands of agents in few minutes.

[1]  Vincent Conitzer,et al.  Coalition Structure Generation Utilizing Compact Characteristic Function Representations , 2011 .

[2]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[3]  Nicholas R. Jennings,et al.  A Hybrid Algorithm for Coalition Structure Generation , 2012, AAAI.

[4]  Evangelos Markakis,et al.  Characteristic function games with restricted agent interactions: Core-stability and coalition structures , 2016, Artif. Intell..

[5]  Onn Shehory,et al.  Coalition structure generation with worst case guarantees , 2022 .

[6]  Edward A. Billard,et al.  Probabilistic coalition formation in distributed knowledge environments , 1995, IEEE Trans. Syst. Man Cybern..

[7]  Eric Horvitz,et al.  Collaboration and shared plans in the open world: studies of ridesharing , 2009, IJCAI 2009.

[8]  Sarvapali D. Ramchurn,et al.  On coalition formation with sparse synergies , 2012, AAMAS.

[9]  Ana L. C. Bazzan,et al.  Distributed clustering for group formation and task allocation in multiagent systems: A swarm intelligence approach , 2012, Appl. Soft Comput..

[10]  Stefano Ferilli,et al.  Coalition Structure Generation with GRASP , 2010, AIMSA.

[11]  Sarvapali D. Ramchurn,et al.  Coalition formation with spatial and temporal constraints , 2010, AAMAS.

[12]  Sarvapali D. Ramchurn,et al.  C-Link: A Hierarchical Clustering Approach to Large-scale Near-optimal Coalition Formation , 2013, IJCAI.

[13]  Nicholas R. Jennings,et al.  Generating coalition structures with finite bound from the optimal guarantees , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[14]  Shai Ben-David,et al.  Characterization of Linkage-based Clustering , 2010, COLT.

[15]  Isabelle Guyon,et al.  Clustering: Science or Art? , 2009, ICML Unsupervised and Transfer Learning.

[16]  Julie A. Adams,et al.  Approximate Coalition Structure Generation , 2010, AAAI.

[17]  Benoît Montreuil,et al.  A multi-agent-based approach for personnel scheduling in assembly centers , 2009, Eng. Appl. Artif. Intell..

[18]  Sarvapali D. Ramchurn,et al.  Anytime coalition structure generation on synergy graphs , 2014, AAMAS.

[19]  A. Farinelli,et al.  Coalitional energy purchasing in the smart grid , 2012, 2012 IEEE International Energy Conference and Exhibition (ENERGYCON).

[20]  Ronald L. Rivest,et al.  Introduction to Algorithms, Second Edition , 2001 .

[21]  Sandip Sen,et al.  Searching for optimal coalition structures , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[22]  Piotr Faliszewski,et al.  Constrained Coalition Formation , 2011, AAAI.

[23]  Talal Rahwan,et al.  Algorithms for coalition formation in multi-agent systems , 2007 .

[24]  Michael Wooldridge,et al.  Computational Aspects of Cooperative Game Theory , 2011, KES-AMSTA.

[25]  Michael Wooldridge,et al.  Computational Aspects of Cooperative Game Theory (Synthesis Lectures on Artificial Inetlligence and Machine Learning) , 2011 .

[26]  Juan C. Burguillo,et al.  Using reputation and adaptive coalitions to support collaboration in competitive environments , 2015, Eng. Appl. Artif. Intell..

[27]  Nicholas R. Jennings,et al.  Coalition Structure Generation : Dynamic Programming Meets Anytime Optimization , 2008 .

[28]  Sarvapali D. Ramchurn,et al.  An Anytime Algorithm for Optimal Coalition Structure Generation , 2014, J. Artif. Intell. Res..

[29]  Mérouane Debbah,et al.  Coalition Formation Games for Collaborative Spectrum Sensing , 2010, IEEE Transactions on Vehicular Technology.

[30]  Ramachandra Kota,et al.  Cooperatives of distributed energy resources for efficient virtual power plants , 2011, AAMAS.

[31]  Nicholas R. Jennings,et al.  Coalition Structure Generation over Graphs , 2012, J. Artif. Intell. Res..

[32]  Wanyuan Wang,et al.  Community-Aware Task Allocation for Social Networked Multiagent Systems , 2014, IEEE Transactions on Cybernetics.

[33]  Sarit Kraus,et al.  Methods for Task Allocation via Agent Coalition Formation , 1998, Artif. Intell..

[34]  Sergios Theodoridis,et al.  Pattern Recognition, Fourth Edition , 2008 .

[35]  Sarvapali D. Ramchurn,et al.  Decentralised Control of Micro-Storage in the Smart Grid , 2011, AAAI.

[36]  Roger B. Myerson,et al.  Graphs and Cooperation in Games , 1977, Math. Oper. Res..

[37]  Nicholas R. Jennings,et al.  An improved dynamic programming algorithm for coalition structure generation , 2008, AAMAS.

[38]  Travis C. Service,et al.  Randomized coalition structure generation , 2011, Artif. Intell..

[39]  Sarvapali D. Ramchurn,et al.  Sharing Rides with Friends: A Coalition Formation Algorithm for Ridesharing , 2015, AAAI.

[40]  Nicholas R. Jennings,et al.  A distributed algorithm for anytime coalition structure generation , 2010, AAMAS.

[41]  Giorgio Gambosi,et al.  Complexity and approximation: combinatorial optimization problems and their approximability properties , 1999 .