Balancing local resources and global goals in multiply-constrained distributed constraint optimization

Distributed constraint optimization (DCOP) is a useful framework for cooperative multiagent coordination. DCOP focuses on optimizing a single team objective. However, in many domains, agents must satisfy constraints on resources consumed locally while optimizing the team goal. These resource constraints may need to be kept private or shared to improve efficiency. Extending DCOP to these domains raises two issues: algorithm design and sensitivity analysis. Algorithm design requires creating algorithms that trade off completeness, scalability, privacy and efficiency. Sensitivity analysis examines whether slightly increasing the available resources could yield a significantly better outcome. This thesis defines the multiply-constrained DCOP (MC-DCOP) framework and provides complete and incomplete algorithms for solving MC-DCOP problems. Complete algorithms find the best allocation of scarce resources, while incomplete algorithms are more scalable. The algorithms use mutually-intervening search; they use local resource constraints to intervene in the search for the globally optimal solution. The algorithms use four key techniques: (i) transforming constraints to maintain privacy; (ii) dynamically setting upper bounds on resource consumption; (iii) identifying the extent to which the local graph structure allows agents to compute exact bounds on resource consumption; and (iv) using a virtual assignment to flag problems rendered unsatisfiable by their resource constraints. Proofs of correctness are presented for all algorithms. Finally, the complete and incomplete algorithms are used in conjunction with one another to perform distributed local reoptimization to address sensitivity analysis. Experimental results demonstrated that MC-DCOP problems are most challenging when resources are scarce but sufficient. In problems where there are insufficient resources, the team goal is largely irrelevant. In problems with ample resources, the local resource constraints require little consideration. The incomplete algorithms were two orders of magnitude more efficient than the complete algorithm for the most challenging MC-DCOP problems and their runtime increased very little as the number of agents in the network increased. Finally, sensitivity analysis results indicated that local reoptimization is an effective way to identify resource constraints that are creating bottlenecks. Taken together these new algorithms and examination of the problem of sensitivity analysis help extend the applicability of DCOP to more complex domains.

[1]  Carla P. Gomes,et al.  Artificial intelligence and operations research: challenges and opportunities in planning and scheduling , 2000, The Knowledge Engineering Review.

[2]  Boi Faltings,et al.  Optimizing Streaming Applications with Self-Interested Users using MDPOP , 2006 .

[3]  Milind Tambe Electric Elves: What Went Wrong and Why , 2006, AI Mag..

[4]  Stephen Fitzpatrick,et al.  Distributed Coordination through Anarchic Optimization , 2003 .

[5]  Michael D. Smith,et al.  Improving privacy in distributed constraint optimization , 2007 .

[6]  Milind Tambe,et al.  Distributed Sensor Networks: A Multiagent Perspective , 2003 .

[7]  Pankaj Jalote,et al.  Assigning tasks in a 24-hour software development model , 2004, 11th Asia-Pacific Software Engineering Conference.

[8]  Milind Tambe,et al.  Local optimization in cooperative agent networks , 2007 .

[10]  Vipin Kumar,et al.  Algorithms for Constraint-Satisfaction Problems: A Survey , 1992, AI Mag..

[11]  Marco Gavanelli,et al.  An Algorithm for Multi-Criteria Optimization in CSPs , 2002, ECAI.

[12]  Milind Tambe,et al.  Towards efficient planning for real world partially observable domains , 2007 .

[13]  Marius-Calin Silaghi,et al.  Distributed constraint satisfaction and optimization with privacy enforcement , 2004, Proceedings. IEEE/WIC/ACM International Conference on Intelligent Agent Technology, 2004. (IAT 2004)..

[14]  Thomas Hanne,et al.  A Multi-Objective Evolutionary Algorithm for Scheduling and Inspection Planning in Software Development Projects , 2003 .

[15]  M. Schlossberg Passions Within Reason: The Strategic Role of the Emotions. , 1990 .

[16]  Makoto Yokoo,et al.  Adopt: asynchronous distributed constraint optimization with quality guarantees , 2005, Artif. Intell..

[17]  J. Alberto Espinosa,et al.  The impact of time separation on coordination in global software teams: a conceptual foundation , 2003, Softw. Process. Improv. Pract..

[18]  Manuela M. Veloso,et al.  Bumping strategies for the multiagent agreement problem , 2005, AAMAS '05.

[19]  Milind Tambe,et al.  Quality Guarantees on k-Optimal Solutions for Distributed Constraint Optimization Problems , 2007, IJCAI.

[20]  Milind Tambe,et al.  Distributed Algorithms for DCOP: A Graphical-Game-Based Approach , 2004, PDCS.

[21]  Alok Aggarwal,et al.  Cooperative Multiobjective Decision Support for the Paper Industry , 1999, Interfaces.

[22]  F. Y. Edgeworth Mathematical Psychics: An Essay on the Application of Mathematics to the Moral Sciences , 2007 .

[23]  Dennis Huisman,et al.  Integrated and Dynamic Vehicle and Crew Scheduling , 1999 .

[24]  Marc E. Posner,et al.  Sensitivity Analysis for Scheduling Problems , 2004, J. Sched..

[25]  Milind Tambe,et al.  Experimental analysis of privacy loss in DCOP algorithms , 2006, AAMAS '06.

[26]  Milind Tambe,et al.  Preprocessing techniques for accelerating the DCOP algorithm ADOPT , 2005, AAMAS '05.

[27]  Milind Tambe,et al.  Taking DCOP to the real world: efficient complete solutions for distributed multi-event scheduling , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[28]  Makoto Yokoo,et al.  The Distributed Constraint Satisfaction Problem: Formalization and Algorithms , 1998, IEEE Trans. Knowl. Data Eng..

[29]  Milind Tambe,et al.  Coordinating multiagent teams in uncertain domains using distributed pomdps , 2004 .

[30]  Sarit Kraus,et al.  Towards a formalization of teamwork with resource constraints , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[31]  相場亮 Distributed Constraint Satisfaction: Foundations of Cooperation in Multi - Agent Systems , 2001 .

[32]  Boi Faltings,et al.  A Scalable Method for Multiagent Constraint Optimization , 2005, IJCAI.

[33]  Makoto Yokoo,et al.  Distributed Multi-Criteria Coordination : Privacy vs . Efficiency , 2005 .

[34]  Sarit Kraus,et al.  Security in multiagent systems by policy randomization , 2006, AAMAS '06.

[35]  Nikos A. Vlassis,et al.  Anytime algorithms for multiagent decision making using coordination graphs , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[36]  X. Zhang,et al.  Solving Negotiation Chains in Semi-Cooperative Multi-Agent Systems , 2005 .

[37]  Milind Tambe,et al.  Multiply-Constrained DCOP for Distributed Planning and Scheduling , 2006 .

[38]  M. Ridley The origins of virtue : human instincts and the evolution of cooperation , 1998 .

[39]  Jürgen Münch,et al.  Distributed Process Planning Support with MILOS , 2000, Int. J. Softw. Eng. Knowl. Eng..

[40]  Jörg Denzinger,et al.  A General Framework for Multi-agent Search with Individual and Global Goals: Stakeholder Search , 2006, Int. Trans. Syst. Sci. Appl..

[41]  Amnon Meisels,et al.  Using additional information in DisCSPs search , 2004 .

[42]  Milind Dawande,et al.  Inference-Based Sensitivity Analysis for Mixed Integer/Linear Programming , 2000, Oper. Res..

[43]  Makoto Yokoo,et al.  Secure distributed constraint satisfaction: reaching agreement without revealing private information , 2002, Artif. Intell..

[44]  Victor R. Lesser,et al.  Solving distributed constraint optimization problems using cooperative mediation , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[45]  Federico Pecora,et al.  Reasoning about and dynamically posting n-ary constraints in ADOPT , 2006 .

[46]  Nikolaos F. Matsatsinis,et al.  A Multi-criteria Protocol for Multi-agent Negotiations , 2004, SETN.

[47]  P. M. Wognum,et al.  Diagnosing and Solving Over-Determined Constraint Satisfaction Problems , 1993, IJCAI.

[48]  Laurence A. Wolsey,et al.  Sensitivity Analysis for Branch and Bound Integer Programming , 1985, Oper. Res..

[49]  Weixiong Zhang,et al.  An analysis and application of distributed constraint satisfaction and optimization algorithms in sensor networks , 2003, AAMAS '03.

[50]  Milind Tambe,et al.  Valuations of Possible States (VPS): a quantitative framework for analysis of privacy loss among collaborative personal assistant agents , 2005, AAMAS '05.

[51]  John N. Tsitsiklis,et al.  Introduction to linear optimization , 1997, Athena scientific optimization and computation series.

[52]  Amal El Fallah Seghrouchni,et al.  An Aggregation-Disaggregation Approach for Automated Negotiation in Multi-Agent Systems , 2000 .

[53]  Makoto Yokoo,et al.  Optimize My Schedule but Keep It Flexible: Distributed Multi-Criteria Coordination for Personal Assistants , 2005, AAAI Spring Symposium: Persistent Assistants: Living and Working with AI.

[54]  John Davin,et al.  Impact of problem centralization in distributed constraint optimization algorithms , 2005, AAMAS '05.

[55]  Laurence A. Wolsey,et al.  Integer programming duality: Price functions and sensitivity analysis , 1981, Math. Program..

[56]  Milind Tambe,et al.  Privacy Loss in Distributed Constraint Reasoning: A Quantitative Framework for Analysis and its Applications , 2006, Autonomous Agents and Multi-Agent Systems.

[57]  Milind Tambe,et al.  Solution sets for DCOPs and graphical games , 2006, AAMAS '06.

[58]  A. Sen,et al.  Rational Fools: A Critique of the Behavioral Foundations of Economic Theory , 1977 .

[59]  H. Gintis,et al.  Social Capital and Community Governance , 2002 .

[60]  Makoto Yokoo,et al.  Multiply-constrained distributed constraint optimization , 2006, AAMAS '06.

[61]  Makoto Yokoo,et al.  Distributed Multi-Criteria Coordination in Multi-Agent Systems , 2005 .

[62]  M. Yokoo,et al.  Distributed Breakout Algorithm for Solving Distributed Constraint Satisfaction Problems , 1996 .

[63]  Khaled Ghédira,et al.  Multicriteria Optimization in CSPs : Foundations and Distributed Solving Approach , 2004, AIMSA.

[64]  Milind Tambe,et al.  Conflicts in teamwork: hybrids to the rescue , 2005, AAMAS '05.

[65]  John Davin,et al.  Hierarchical Variable Ordering for Multiagent Agreement Problems , 2006 .

[66]  Milind Tambe,et al.  Multiagent Teamwork: Hybrid Approaches , 2006 .

[67]  Boi Faltings,et al.  MB-DPOP: A New Memory-Bounded Algorithm for Distributed Optimization , 2007, IJCAI.