Sensitivity analysis for distributed optimization with resource constraints

Previous work in multiagent coordination has addressed the challenge of planning in domains where agents must optimize a global goal, while satisfying local resource constraints. However, the imposition of resource constraints naturally raises the question of whether the agents could significantly improve their team performance if a few more resources were made available. Sensitivity analysis aims to answer that question. This paper focuses on sensitivity analysis in the context of the distributed coordination framework, Multiply-Constrained DCOP (MC-DCOP). There are three main challenges in performing sensitivity analysis: (i) to perform it in a distributed fashion, (ii) to avoid re-solving an NP-hard MC-DCOP optimization from scratch, and (iii) to avoid considering unproductive uses for extra resources. To meet these challenges, this paper presents three types of locally optimal algorithms: link analysis, local reoptimization and local constraint propagation. These algorithms are distributed and avoid redundant computation by ascertaining just the effects of local perturbations on the original problem. Deploying our algorithms on a large number of MC-DCOP problems revealed several results. While our cheapest algorithm successfully identified quality improvements for a few problems, our more complex techniques were necessary to identify the best uses for additional resources. Furthermore, we identified two heuristics that can help identify a priori which agents might benefit most from additional resources: density rank, which works well when nodes received identical resources and remaining resource rank, which works well when nodes received resources based on the number of neighbors they had.

[1]  Boi Faltings,et al.  PC-DPOP: A New Partial Centralization Algorithm for Distributed Optimization , 2007, IJCAI.

[2]  Laurence A. Wolsey,et al.  Sensitivity Analysis for Branch and Bound Integer Programming , 1985, Oper. Res..

[3]  Milind Tambe,et al.  Multiply-Constrained DCOP for Distributed Planning and Scheduling , 2006 .

[4]  Toby Walsh,et al.  Encodings of Non-Binary Constraint Satisfaction Problems , 1999, AAAI/IAAI.

[5]  Manish Jain,et al.  On k-optimal distributed constraint optimization algorithms: new bounds and algorithms , 2008, AAMAS.

[6]  Milind Dawande,et al.  Inference-Based Sensitivity Analysis for Mixed Integer/Linear Programming , 2000, Oper. Res..

[7]  Carla P. Gomes,et al.  Artificial intelligence and operations research: challenges and opportunities in planning and scheduling , 2000, The Knowledge Engineering Review.

[8]  Makoto Yokoo,et al.  Resource Constrained Distributed Constraint Optimization with Virtual Variables , 2008, AAAI.

[9]  Olivier Bonnet-Torrés,et al.  Multiply-Constrained DCOP for Distributed Planning and Scheduling , 2006, AAAI Spring Symposium: Distributed Plan and Schedule Management.

[10]  John N. Tsitsiklis,et al.  Introduction to linear optimization , 1997, Athena scientific optimization and computation series.

[11]  Victor R. Lesser,et al.  Solving distributed constraint optimization problems using cooperative mediation , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[12]  Federico Pecora,et al.  Reasoning about and dynamically posting n-ary constraints in ADOPT , 2006 .

[13]  P. M. Wognum,et al.  Diagnosing and Solving Over-Determined Constraint Satisfaction Problems , 1993, IJCAI.

[14]  Edmund H. Durfee,et al.  Multiagent planning for agents with internal execution resource constraints , 2003, AAMAS '03.

[15]  Sarit Kraus,et al.  Towards a formalization of teamwork with resource constraints , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[16]  Laurence A. Wolsey,et al.  Integer programming duality: Price functions and sensitivity analysis , 1981, Math. Program..

[17]  Marc E. Posner,et al.  Sensitivity Analysis for Scheduling Problems , 2004, J. Sched..

[18]  Milind Tambe,et al.  Taking DCOP to the real world: efficient complete solutions for distributed multi-event scheduling , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[19]  N. Olhoff,et al.  Reliability-based topology optimization , 2004 .