LS-DPOP: A Propagation/Local Search Hybrid for Distributed Optimization

We present a new hybrid algorithm for local search in distributed combinatorial optimization. This method is a mix between classical local search methods in which nodes take decisions based only on local information, and full inference methods that guarantee completeness. In general, classical inference methods are time and space exponential in a parameter of the graph called the induced width, thus they may be infeasible for dense problems. On the other hand, local search methods suffer from the fact that the nodes take myopic decisions based only on local information available to them, and thus can easily get stuck in local optima. Their advantage is that they require linear memory, and in many cases provide good solutions with a small amount of effort. We propose a hybrid method that combines the advantages of both these approaches. This method is a utility propagation algorithm controlled by a parameter maxDim which specifies the maximal allowable amount of inference. The maximal space requirements are exponential in this parameter. In the dense parts of the problem, where the required amount of inference exceeds this limit, the algorithm executes a local search procedure guided by as much inference as allowed by maxDim. This hybrid can be seen as a large neighborhood search, where exponential neighborhoods are rigorously determined according to problem structure, and polynomial efforts are spent for their complete exploration at each local search step. The algorithm explores independent parts of the problem simultaneously and asynchronously, and then combines the results, all in a distributed fashion. We show the efficiency of this approach with experimental results from the distributed meeting scheduling domain.

[1]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[2]  Makoto Yokoo,et al.  Distributed constraint satisfaction for formalizing distributed problem solving , 1992, [1992] Proceedings of the 12th International Conference on Distributed Computing Systems.

[3]  Rina Dechter,et al.  Constraint Processing , 1995, Lecture Notes in Computer Science.

[4]  Thomas Schiex,et al.  Valued Constraint Satisfaction Problems: Hard and Easy Problems , 1995, IJCAI.

[5]  M. Yokoo,et al.  Distributed Breakout Algorithm for Solving Distributed Constraint Satisfaction Problems , 1996 .

[6]  Rina Dechter,et al.  A Graph-Based Method for Improving GSAT , 1996, AAAI/IAAI, Vol. 1.

[7]  Rina Dechter,et al.  Topological parameters for time-space tradeoff , 1996, Artif. Intell..

[8]  Abraham P. Punnen,et al.  A survey of very large-scale neighborhood search techniques , 2002, Discret. Appl. Math..

[9]  Makoto Yokoo,et al.  An asynchronous complete method for distributed constraint optimization , 2003, AAMAS '03.

[10]  Weixiong Zhang,et al.  Distributed breakout algorithm for distributed constraint optimization problems -- DBArelax , 2003, AAMAS '03.

[11]  J. Orlin,et al.  Two Dynamic Programming Methodologies in Very Large Scale Neighborhood Search Applied to the Traveling Salesman Problem , 2003 .

[12]  Rina Dechter,et al.  On Finding Minimal w-cutset , 2004, UAI.

[13]  Milind Tambe,et al.  Taking DCOP to the real world: efficient complete solutions for distributed multi-event scheduling , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[14]  B. Faltings,et al.  A Distributed, Complete Method for Multi-Agent Constraint Optimization , 2004 .

[15]  Rina Dechter Bucket Elimination: a Unifying Framework for Processing Hard and Soft Constraints , 2004, Constraints.

[16]  Boi Faltings,et al.  A Scalable Method for Multiagent Constraint Optimization , 2005, IJCAI.

[17]  James B. Orlin,et al.  A dynamic programming methodology in very large scale neighborhood search applied to the traveling salesman problem , 2006, Discret. Optim..