Cooperative Set Function Optimization Without Communication or Coordination

We introduce a new model for cooperative agents that seek to optimize a common goal without communication or coordination. Given a universe of elements V, a set of agents, and a set function f, we ask each agent i to select a subset Si ⊂ V such that the size of Si is constrained (i.e., |Si| < k). The goal is for the agents to cooperatively choose the sets Si to maximize the function evaluated at the union of these sets, ∪iSi; we seek max f(∪iSi). We assume the agents can neither communicate nor coordinate how they choose their sets. This model arises naturally in many real-world settings such as swarms of surveillance robots and colonies of foraging insects. Even for simple classes of set functions, there are strong lower bounds on the achievable performance of coordinating deterministic agents. We show, surprisingly, that for the fundamental class of submodular set functions, there exists a near-optimal distributed algorithm for this problem that does not require communication. We demonstrate that our algorithm performs nearly as well as recently published algorithms that allow full coordination.

[1]  Sarit Kraus,et al.  Teamwork with Limited Knowledge of Teammates , 2013, AAAI.

[2]  D. Gordon The organization of work in social insect colonies , 1996, Nature.

[3]  Hiroya Takamura,et al.  Text Summarization Model based on Maximum Coverage Problem and its Variant , 2008 .

[4]  Sarit Kraus,et al.  Coordination without Communication: Experimental Validation of Focal Point Techniques , 1997, ICMAS.

[5]  T. Seeley The Wisdom of the Hive: The Social Physiology of Honey Bee Colonies , 1995 .

[6]  Mark W. Schmidt,et al.  Optimizing Costly Functions with Simple Constraints: A Limited-Memory Projected Quasi-Newton Algorithm , 2009, AISTATS.

[7]  Maxim A. Batalin,et al.  NIMS-AQ: A novel system for autonomous sensing of aquatic environments , 2008, 2008 IEEE International Conference on Robotics and Automation.

[8]  Andreas Krause,et al.  Submodular Function Maximization , 2014, Tractability.

[9]  Refik Molva,et al.  Analysis of coalition formation and cooperation strategies in mobile ad hoc networks , 2005, Ad Hoc Networks.

[10]  Francesco Di Corato,et al.  Thesaurus: AUV teams for archaeological search. Field results on acoustic communication and localization with the Typhoon , 2014, 22nd Mediterranean Conference on Control and Automation.

[11]  D. Gordon The Organization of Work in Social Insect , 2003 .

[12]  Amit Kumar,et al.  Maximum Coverage Problem with Group Budget Constraints and Applications , 2004, APPROX-RANDOM.

[13]  D. Sumpter Collective Animal Behavior , 2010 .

[14]  Katia P. Sycara,et al.  A stable and efficient buyer coalition formation scheme for e-marketplaces , 2001, AGENTS '01.

[15]  Onn Shehory,et al.  Coalition structure generation with worst case guarantees , 2022 .

[16]  Sarit Kraus,et al.  Methods for Task Allocation via Agent Coalition Formation , 1998, Artif. Intell..

[17]  Pushmeet Kohli,et al.  Tractability: Practical Approaches to Hard Problems , 2013 .

[18]  Petter Ögren,et al.  Cooperative control of mobile sensor networks:Adaptive gradient climbing in a distributed environment , 2004, IEEE Transactions on Automatic Control.

[19]  Ben Taskar,et al.  Determinantal Point Processes for Machine Learning , 2012, Found. Trends Mach. Learn..

[20]  Shahar Dobzinski,et al.  An improved approximation algorithm for combinatorial auctions with submodular bidders , 2006, SODA '06.

[21]  Huy L. Nguyen,et al.  The Power of Randomization: Distributed Submodular Maximization on Massive Datasets , 2015, ICML.

[22]  Sarit Kraus,et al.  Ad Hoc Autonomous Agent Teams: Collaboration without Pre-Coordination , 2010, AAAI.

[23]  Uriel Feige,et al.  The Submodular Welfare Problem with Demand Queries , 2010, Theory Comput..

[24]  M. L. Fisher,et al.  An analysis of approximations for maximizing submodular set functions—I , 1978, Math. Program..

[25]  Samir Khuller,et al.  The Budgeted Maximum Coverage Problem , 1999, Inf. Process. Lett..

[26]  Sarit Kraus,et al.  Coalition formation with uncertain heterogeneous information , 2003, AAMAS '03.

[27]  Daniel Lehmann,et al.  Combinatorial auctions with decreasing marginal utilities , 2001, EC '01.

[28]  Katia P. Sycara,et al.  Customer Coalitions in Electronic Markets , 2000, AMEC.

[29]  Peter Stone,et al.  An analysis framework for ad hoc teamwork tasks , 2012, AAMAS.

[30]  Feng Wu,et al.  Online Planning for Ad Hoc Autonomous Agent Teams , 2011, IJCAI.

[31]  Patricio Reyes-Bedoya,et al.  Maximum coverage and maximum connected covering in social networks with partial topology information , 2014, 2014 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[32]  U. Feige,et al.  Maximizing Non-monotone Submodular Functions , 2011 .

[33]  Kagan Tumer,et al.  Robot coordination with ad-hoc team formation , 2010, AAMAS.

[34]  Vahab S. Mirrokni,et al.  Maximizing Nonmonotone Submodular Functions under Matroid or Knapsack Constraints , 2009, SIAM J. Discret. Math..

[35]  Debraj Ray,et al.  Coalition formation as a dynamic process , 2003, J. Econ. Theory.

[36]  Andreas Krause,et al.  Near-Optimal Sensor Placements in Gaussian Processes: Theory, Efficient Algorithms and Empirical Studies , 2008, J. Mach. Learn. Res..

[37]  Sarit Kraus,et al.  Cooperative Exploration in the Electronic Marketplace , 2005, AAAI.

[38]  Joseph Naor,et al.  A Unified Continuous Greedy Algorithm for Submodular Maximization , 2011, 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science.

[39]  David Sarne,et al.  Joint search with self-interested agents and the failure of cooperation enhancers , 2014, Artif. Intell..

[40]  Andreas Krause,et al.  Distributed Submodular Maximization: Identifying Representative Elements in Massive Data , 2013, NIPS.