Asynchronous algorithms for approximate distributed constraint optimization with quality bounds

Distributed Constraint Optimization (DCOP) is a popular framework for cooperative multi-agent decision making. DCOP is NP-hard, so an important line of work focuses on developing fast incomplete solution algorithms for large-scale applications. One of the few incomplete algorithms to provide bounds on solution quality is k-size optimality, which defines a local optimality criterion based on the size of the group of deviating agents. Unfortunately, the lack of a general-purpose algorithm and the commitment to forming groups based solely on group size has limited the use of k-size optimality. This paper introduces t-distance optimality which departs from k-size optimality by using graph distance as an alternative criteria for selecting groups of deviating agents. This throws open a new research direction into the tradeoffs between different group selection and coordination mechanisms for incomplete DCOP algorithms. We derive theoretical quality bounds for t-distance optimality that improve known bounds for k-size optimality. In addition, we develop a new efficient asynchronous local search algorithm for finding both k-size and t-distance optimal solutions --- allowing these concepts to be deployed in real applications. Indeed, empirical results show that this algorithm significantly outperforms the only existing algorithm for finding general k-size optimal solutions, which is also synchronous. Finally, we compare the algorithmic performance of k-size and t-distance optimality using this algorithm. We find that t-distance consistently converges to higher-quality solutions in the long run, but results are mixed on convergence speed; we identify cases where k-size and t-distance converge faster.

[1]  Boi Faltings,et al.  Optimizing Streaming Applications with Self-Interested Users using MDPOP , 2006 .

[2]  Milind Tambe,et al.  Solving Multiagent Networks using Distributed Constraint Optimization , 2008, AI Mag..

[3]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[4]  Victor R. Lesser,et al.  Using cooperative mediation to solve distributed constraint satisfaction problems , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[5]  Stephen Fitzpatrick,et al.  Distributed Coordination through Anarchic Optimization , 2003 .

[6]  Makoto Yokoo,et al.  The operation point units of distributed constraint solvers , 2008 .

[7]  John Davin,et al.  Impact of problem centralization in distributed constraint optimization algorithms , 2005, AAMAS '05.

[8]  Amnon Meisels,et al.  Asynchronous Forward-Bounding for Distributed Constraints Optimization , 2006, ECAI.

[9]  Rachel Greenstadt An analysis of privacy loss in k-optimal algorithms , 2008 .

[10]  Nicholas R. Jennings,et al.  Bounded approximate decentralised coordination via the max-sum algorithm , 2009, Artif. Intell..

[11]  Boi Faltings,et al.  A Scalable Method for Multiagent Constraint Optimization , 2005, IJCAI.

[12]  Manish Jain,et al.  On k-optimal distributed constraint optimization algorithms: new bounds and algorithms , 2008, AAMAS.

[13]  Jonathan P. Pearce,et al.  KOPT : Distributed DCOP Algorithm for Arbitrary k-optima with Monotonically Increasing Utility , 2007 .

[14]  Makoto Yokoo,et al.  Adopt: asynchronous distributed constraint optimization with quality guarantees , 2005, Artif. Intell..

[15]  Roie Zivan Anytime Local Search for Distributed Constraint Optimization , 2008, AAAI.

[16]  Béla Bollobás,et al.  Random Graphs , 1985 .

[17]  Wolfgang Schreiner A java toolkit for teaching distributed algorithms , 2002, ITiCSE '02.

[18]  Weixiong Zhang,et al.  Distributed stochastic search and distributed breakout: properties, comparison and applications to constraint optimization problems in sensor networks , 2005, Artif. Intell..