Distributed Constraint Optimization Problems and Applications: A Survey

The field of Multi-Agent System (MAS) is an active area of research within Artificial Intelligence, with an increasingly important impact in industrial and other real-world applications. Within a MAS, autonomous agents interact to pursue personal interests and/or to achieve common objectives. Distributed Constraint Optimization Problems (DCOPs) have emerged as one of the prominent agent architectures to govern the agents' autonomous behavior, where both algorithms and communication models are driven by the structure of the specific problem. During the last decade, several extensions to the DCOP model have enabled them to support MAS in complex, real-time, and uncertain environments. This survey aims at providing an overview of the DCOP model, giving a classification of its multiple extensions and addressing both resolution methods and applications that find a natural mapping within each class of DCOPs. The proposed classification suggests several future perspectives for DCOP extensions, and identifies challenges in the design of efficient resolution algorithms, possibly through the adaptation of strategies from different areas.

[1]  Subhrabrata Choudhury,et al.  A Multi-agent Based Optimised Server Selection Scheme for SOC in Pervasive Environment , 2014, PAAMS.

[2]  Krzysztof R. Apt,et al.  Principles of constraint programming , 2003 .

[3]  Steven Okamoto,et al.  Dynamic Multi-Agent Task Allocation with Spatial and Temporal Constraints , 2014, AAAI.

[4]  Feng Wu,et al.  Regret-Based Multi-Agent Coordination with Uncertain Task Rewards , 2014, AAAI.

[5]  Victor R. Lesser Evolution of the GPGP/TÆMS domain-independent coordination framework , 2002, AAMAS.

[6]  Enrico Pontelli,et al.  A Dynamic Programming-Based MCMC Framework for Solving DCOPs with GPUs , 2016, CP.

[7]  Nicholas R. Jennings,et al.  Decentralised coordination of low-power embedded devices using the max-sum algorithm , 2008, AAMAS.

[8]  Ivana Kockar,et al.  Distributed constraint optimisation for flexible network management , 2013, IEEE PES ISGT Europe 2013.

[9]  Neil Immerman,et al.  The Complexity of Decentralized Control of Markov Decision Processes , 2000, UAI.

[10]  Makoto Yokoo,et al.  Adopt: asynchronous distributed constraint optimization with quality guarantees , 2005, Artif. Intell..

[11]  Roie Zivan,et al.  Distributed Constraint Optimization for Large Teams of Mobile Sensing Agents , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[12]  Shlomo Zilberstein,et al.  Using Anytime Algorithms in Intelligent Systems , 1996, AI Mag..

[13]  Hiroshi Matsuo,et al.  A Formalization for Distributed Cooperative Sensor Resource Allocation , 2008, KES-AMSTA.

[14]  Leslie Lamport,et al.  Time, clocks, and the ordering of events in a distributed system , 1978, CACM.

[15]  Pradeep Varakantham,et al.  Near-Optimal Decentralized Power Supply Restoration in Smart Grids , 2015, AAMAS.

[16]  Hoong Chuin Lau,et al.  Decentralized Multi-Agent Reinforcement Learning in Average-Reward Dynamic DCOPs , 2014, AAAI.

[17]  Richard Demo Souza,et al.  Channel allocation algorithms for WLANs using distributed optimization , 2012 .

[18]  Michael Zink,et al.  An End-User-Responsive Sensor Network Architecture for Hazardous Weather Detection, Prediction and Response , 2006, AINTEC.

[19]  Chunming Qiao,et al.  Novel Branching-Router-Based Multicast Routing Protocol with Mobility Support , 2013, IEEE Transactions on Parallel and Distributed Systems.

[20]  Alessandro Farinelli,et al.  Optimising memory management for Belief Propagation in Junction Trees using GPGPUs , 2014, 2014 20th IEEE International Conference on Parallel and Distributed Systems (ICPADS).

[21]  Ana L. C. Bazzan,et al.  Evaluating the performance of DCOP algorithms in a real world, dynamic problem , 2008, AAMAS.

[22]  G. Thompson,et al.  Algorithms for Solving Production-Scheduling Problems , 1960 .

[23]  Thomas Stützle,et al.  Pareto Local Optimum Sets in the Biobjective Traveling Salesman Problem: An Experimental Study , 2004, Metaheuristics for Multiobjective Optimisation.

[24]  Milind Tambe,et al.  Asynchronous algorithms for approximate distributed constraint optimization with quality bounds , 2010, AAMAS.

[25]  Makoto Yokoo,et al.  Networked Distributed POMDPs: A Synergy of Distributed Constraint Optimization and POMDPs , 2005, IJCAI.

[26]  Boi Faltings,et al.  Superstabilizing, Fault-Containing Distributed Combinatorial Optimization , 2005, AAAI.

[27]  Makoto Yokoo,et al.  Distributed Problem Solving , 2012, AI Mag..

[28]  Sebastian Müller,et al.  Distributed constraint optimization for medical appointment scheduling , 2001, AGENTS '01.

[29]  Christian Bessiere,et al.  DisChoco 2: A Platform for Distributed Constraint Reasoning , 2011 .

[30]  Aditya K. Ghose,et al.  SBDO: A New Robust Approach to Dynamic Distributed Constraint Optimisation , 2009, PRIMA.

[31]  Enrico Pontelli,et al.  ASP-DPOP: solving distributed constraint optimization problems with logic programming , 2014, AAMAS.

[32]  Sarvapali D. Ramchurn,et al.  A Distributed Anytime Algorithm for Dynamic Task Allocation in Multi-Agent Systems , 2011, AAAI.

[33]  Toby Walsh,et al.  Handbook of Constraint Programming (Foundations of Artificial Intelligence) , 2006 .

[34]  Franco Zambonelli,et al.  Advances in Practical Applications of Heterogeneous Multi-Agent Systems. The PAAMS Collection , 2014, Lecture Notes in Computer Science.

[35]  C. Bessiere,et al.  DisChoco : A platform for distributed constraint programming , 2006 .

[36]  Milind Tambe,et al.  Quality Guarantees on k-Optimal Solutions for Distributed Constraint Optimization Problems , 2007, IJCAI.

[37]  Enrico Pontelli,et al.  A Multiagent System Approach to Scheduling Devices in Smart Homes , 2017, AAMAS.

[38]  Seif Haridi,et al.  Distributed Algorithms , 1992, Lecture Notes in Computer Science.

[39]  Ferdinando Fioretto,et al.  Preference Elicitation for DCOPs , 2017, CP.

[40]  Milind Tambe,et al.  Conflict negotiation among personal calendar agents , 2006, AAMAS '06.

[41]  S. Kozono Received signal-level characteristics in a wide-band mobile radio channel , 1994 .

[42]  Peter J. Stuckey,et al.  MiniZinc: Towards a Standard CP Modelling Language , 2007, CP.

[43]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[44]  Makoto Yokoo,et al.  Resource Constrained Distributed Constraint Optimization with Virtual Variables , 2008, AAAI.

[45]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[46]  Sarvapali D. Ramchurn,et al.  Optimal decentralised dispatch of embedded generation in the smart grid , 2012, AAMAS.

[47]  Makoto Yokoo,et al.  Distributed Partial Constraint Satisfaction Problem , 1997, CP.

[48]  Makoto Yokoo,et al.  Real-Time Solving of Quantified CSPs Based on Monte-Carlo Game Tree Search , 2011, IJCAI.

[49]  Steven Okamoto,et al.  Balancing exploration and exploitation in incomplete Min/Max-sum inference for distributed constraint optimization , 2017, Autonomous Agents and Multi-Agent Systems.

[50]  S. J. Ranade,et al.  Optimum operation of a customer-driven microgrid: A comprehensive approach , 2012, 2012 IEEE International Conference on Power Electronics, Drives and Energy Systems (PEDES).

[51]  Enrico Pontelli,et al.  Solving distributed constraint optimization problems using logic programming , 2017, Theory Pract. Log. Program..

[52]  Keith S. Decker,et al.  Coordination for uncertain outcomes using distributed neighbor exchange , 2010, AAMAS.

[53]  Katsumi Inoue,et al.  Lp-Norm based algorithm for multi-objective distributed constraint optimization , 2014, AAMAS.

[54]  Pedro Meseguer,et al.  Generalizing ADOPT and BnB-ADOPT , 2011, IJCAI.

[55]  Emal Pasarly Time , 2011, Encyclopedia of Evolutionary Psychological Science.

[56]  Sridhar Mahadevan,et al.  Average reward reinforcement learning: Foundations, algorithms, and empirical results , 2004, Machine Learning.

[57]  Robert J. McEliece,et al.  The generalized distributive law , 2000, IEEE Trans. Inf. Theory.

[58]  Wai Keung Terrence Quantified Weighted Constraint Satisfaction Problems , 2011 .

[59]  Usama Mir,et al.  A Cooperative Multiagent Based Spectrum Sharing , 2010, 2010 Sixth Advanced International Conference on Telecommunications.

[60]  Makoto Yokoo,et al.  A quantified distributed constraint optimization problem , 2010, AAMAS.

[61]  Meritxell Vinyals,et al.  A Scalable Message-Passing Algorithm for Supply Chain Formation , 2012, AAAI.

[62]  Christian Bessiere,et al.  Including Soft Global Constraints in DCOPs , 2012, CP.

[63]  Sven Koenig,et al.  Caching schemes for DCOP search algorithms , 2009, AAMAS.

[64]  Enrico Pontelli,et al.  Solving Customer-Driven Microgrid Optimization Problems as DCOPs , 2013 .

[65]  Lars Erik Holmquist,et al.  Fun and Games , 2005, Heading Home With Your Newborn.

[66]  Marco Benedetti,et al.  Quantified Constraint Optimization , 2008, CP.

[67]  Michael P. Wellman,et al.  Modeling Supply Chain Formation in Multiagent Systems , 1999, Agent Mediated Electronic Commerce.

[68]  Javier Larrosa,et al.  Node and arc consistency in weighted CSP , 2002, AAAI/IAAI.

[69]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[70]  Mehryar Mohri,et al.  Multi-armed Bandit Algorithms and Empirical Evaluation , 2005, ECML.

[71]  Steven Minton,et al.  Minimizing Conflicts: A Heuristic Repair Method for Constraint Satisfaction and Scheduling Problems , 1992, Artif. Intell..

[72]  Boi Faltings,et al.  H-DPOP: Using Hard Constraints for Search Space Pruning in DCOP , 2008, AAAI.

[73]  Robert N. Lass,et al.  Distributed Coordination of First Responders , 2008, IEEE Internet Computing.

[74]  Nicholas R. Jennings,et al.  Decentralised coordination of continuously valued control parameters using the max-sum algorithm , 2009, AAMAS.

[75]  Sarvapali D. Ramchurn,et al.  Efficient, Superstabilizing Decentralised Optimisation for Dynamic Task Allocation Environments , 2010 .

[76]  Anita Raja,et al.  Cognitive Radio Resource Management Using Multi-Agent Systems , 2007, 2007 4th IEEE Consumer Communications and Networking Conference.

[77]  Makoto Yokoo,et al.  Algorithms for Distributed Constraint Satisfaction: A Review , 2000, Autonomous Agents and Multi-Agent Systems.

[78]  Tong Pham,et al.  Conference on Agent-Based Modeling in Transportation Planning and Operations A Simple , Naive Agent-based Model for the Optimization of a System of Traffic Lights : Insights from an Exploratory Experiment , 2013 .

[79]  Roie Zivan,et al.  Applying DCOP_MST to a Team of Mobile Robots with Directional Sensing Abilities: (Extended Abstract) , 2016, AAMAS.

[80]  Boi Faltings,et al.  E[DPOP]: Distributed Constraint Optimization under Stochastic Uncertainty using Collaborative Sampling , 2009, IJCAI 2009.

[81]  A. Petcu,et al.  Optimal Solution Stability in Dynamic, Distributed Constraint Optimization , 2007, 2007 IEEE/WIC/ACM International Conference on Intelligent Agent Technology (IAT'07).

[82]  Robert M. Haralick,et al.  Structural Descriptions and Inexact Matching , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[83]  Edmund H. Durfee,et al.  The multi variable multi constrained distributed constraint optimization framework , 2010, AAMAS.

[84]  M. Chial,et al.  in simple , 2003 .

[85]  M. Calisti,et al.  FOUNDATION FOR INTELLIGENT PHYSICAL AGENTS , 2000 .

[86]  Nicholas R. Jennings,et al.  U-GDL: A decentralised algorithm for DCOPs with Uncertainty , 2011 .

[87]  Shijie Li,et al.  Distributed constraint optimization for addressing vessel rotation planning problems , 2016, Eng. Appl. Artif. Intell..

[88]  Victor Lesser,et al.  Application of Max-Sum Algorithm to Radar Coordination and Scheduling , 2010 .

[89]  Victor R. Lesser,et al.  Using cooperative mediation to coordinate traffic lights: a case study , 2005, AAMAS '05.

[90]  Aditya K. Ghose,et al.  Support-based distributed search: a new approach for multiagent constraint processing , 2006, AAMAS '06.

[91]  Richard Demo Souza,et al.  A multi-agent approach to optimal channel assignment in WLANs , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[92]  Jasbir S. Arora,et al.  Survey of multi-objective optimization methods for engineering , 2004 .

[93]  Enrico Pontelli,et al.  GD-GIBBS: a GPU-based sampling algorithm for solving distributed constraint optimization problems , 2014, AAMAS.

[94]  Meritxell Vinyals,et al.  Scalable decentralized supply chain formation through binarized belief propagation , 2012, AAMAS.

[95]  Michael Winsper,et al.  Using the Max-Sum Algorithm for Supply Chain Emergence in Dynamic Multiunit Environments , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[96]  Milind Tambe,et al.  Quality guarantees for region optimal DCOP algorithms , 2011, AAMAS.

[97]  Allen J. Wood,et al.  Power Generation, Operation, and Control , 1984 .

[98]  Otman A. Basir,et al.  Target to sensor allocation: A hierarchical dynamic Distributed Constraint Optimization approach , 2013, Comput. Commun..

[99]  Amnon Meisels,et al.  Dynamic Ordering for Asynchronous Backtracking on DisCSPs , 2005, Constraints.

[100]  Boi Faltings,et al.  PC-DPOP: A New Partial Centralization Algorithm for Distributed Optimization , 2007, IJCAI.

[101]  Makoto Yokoo,et al.  Distributed on-Line Multi-Agent Optimization under Uncertainty: Balancing Exploration and Exploitation , 2011, Adv. Complex Syst..

[102]  Aditya K. Ghose,et al.  Using Distributed Agents for Patient Scheduling , 2010, PRIMA.

[103]  Makoto Yokoo,et al.  The Distributed Constraint Satisfaction Problem: Formalization and Algorithms , 1998, IEEE Trans. Knowl. Data Eng..

[104]  Boi Faltings,et al.  ODPOP: An Algorithm for Open/Distributed Constraint Optimization , 2006, AAAI.

[105]  Amnon Meisels,et al.  Congestion Games for V2G-Enabled EV Charging , 2014, AAAI.

[106]  Ankur Gupta Network Management: Current Trends and Future Perspectives , 2006, Journal of Network and Systems Management.

[107]  Radoslaw Szymanek,et al.  FRODO 2.0: An Open-Source Framework for Distributed Constraint Optimization , 2009, IJCAI 2009.

[108]  Saurabh Gupta,et al.  Modeling microgrid islanding problems as DCOPs , 2013, 2013 North American Power Symposium (NAPS).

[109]  E. M. Davidson,et al.  The Use of Constraint Programming for the Autonomous Management of Power Flows , 2009, 2009 15th International Conference on Intelligent System Applications to Power Systems.

[110]  Makoto Yokoo,et al.  Distributed Search Method with Bounded Cost Vectors on Multiple Objective DCOPs , 2012, PRIMA.

[111]  Yen-Kuang Chen,et al.  Challenges and opportunities of internet of things , 2012, 17th Asia and South Pacific Design Automation Conference.

[112]  Nicholas R. Jennings,et al.  Agent-based meeting scheduling: a design and implementation , 1995 .

[113]  Evan Sultanik,et al.  On Modeling Multiagent Task Scheduling as a Distributed Constraint Optimization Problem , 2007, IJCAI.

[114]  Roie Zivan,et al.  Explorative max-sum for teams of mobile sensing agents , 2014, AAMAS.

[115]  Sarit Kraus,et al.  Negotiation and Cooperation in Multi-Agent Environments , 1997, Artif. Intell..

[116]  Milind Tambe,et al.  Distributed Algorithms for DCOP: A Graphical-Game-Based Approach , 2004, PDCS.

[117]  Sven Koenig,et al.  Incremental DCOP search algorithms for solving dynamic DCOPs , 2011, AAMAS.

[118]  Imrich Chlamtac,et al.  Internet of things: Vision, applications and research challenges , 2012, Ad Hoc Networks.

[119]  Gauthier Picard,et al.  Using Message-Passing DCOP Algorithms to Solve Energy-Efficient Smart Environment Configuration Problems , 2016, IJCAI.

[120]  Amnon Meisels,et al.  Comparing performance of distributed constraints process ing algorithms , 2002 .

[121]  Supriyo Ghosh,et al.  Probabilistic Inference Based Message-Passing for Resource Constrained DCOPs , 2015, IJCAI.

[122]  Anton Schwartz,et al.  A Reinforcement Learning Method for Maximizing Undiscounted Rewards , 1993, ICML.

[123]  Rémi Monasson,et al.  Determining computational complexity from characteristic ‘phase transitions’ , 1999, Nature.

[124]  Michael Wooldridge,et al.  Introduction to multiagent systems , 2001 .

[125]  Enrico Pontelli,et al.  A Realistic Dataset for the Smart Home Device Scheduling Problem for DCOPs , 2017, AAMAS Workshops.

[126]  Victor R. Lesser,et al.  Evolution of the GPGP/TÆMS Domain-Independent Coordination Framework , 2002, AAMAS '02.

[127]  Arnaud Lallouet,et al.  Ultra-weak solutions and consistency enforcement in minimax weighted constraint satisfaction , 2015, Constraints.

[128]  Sarvapali D. Ramchurn,et al.  Putting the 'smarts' into the smart grid , 2012, Commun. ACM.

[129]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[130]  Edith Elkind,et al.  Proceedings of the 14th International Conference on Autonomous Agents and Multiagent Systems (AAMAS) , 2015 .

[131]  Solomon W. Golomb,et al.  Backtrack Programming , 1965, JACM.

[132]  Robert N. Lass,et al.  Coordination of first responders under communication and resource constraints , 2008, AAMAS.

[133]  Alessandro Farinelli,et al.  Efficient Inter-Team Task Allocation in RoboCup Rescue , 2015, AAMAS.

[134]  Boi Faltings,et al.  MB-DPOP: A New Memory-Bounded Algorithm for Distributed Optimization , 2007, IJCAI.

[135]  Weixiong Zhang,et al.  Distributed stochastic search and distributed breakout: properties, comparison and applications to constraint optimization problems in sensor networks , 2005, Artif. Intell..

[136]  Boi Faltings,et al.  Approximations in Distributed Optimization , 2005, CP.

[137]  Abdul Sattar,et al.  An Intelligent Approach to Surgery Scheduling , 2010, PRIMA.

[138]  Archie C. Chapman,et al.  A Parameterisation of Algorithms for Distributed Constraint Optimisation via Potential Games , 2008 .

[139]  Makoto Yokoo,et al.  When should there be a "Me" in "Team"?: distributed multi-agent optimization under uncertainty , 2010, AAMAS.

[140]  Shlomo Zilberstein,et al.  Message-Passing Algorithms for Quadratic Programming Formulations of MAP Estimation , 2011, UAI.

[141]  Katsumi Inoue,et al.  A Two-Phase Complete Algorithm for Multi-Objective Distributed Constraint Optimization , 2014, J. Adv. Comput. Intell. Intell. Informatics.

[142]  Hiroshi Matsuo,et al.  Layered Distributed Constraint Optimization Problem for Resource Allocation Problem in Distributed Sensor Networks , 2009, PRIMA.

[143]  Amnon Meisels,et al.  Completeness and Performance Of The APO Algorithm , 2008, J. Artif. Intell. Res..

[144]  Roie Zivan,et al.  Max/min-sum distributed constraint optimization through value propagation on an alternating DAG , 2012, AAMAS.

[145]  Stochastic Relaxation , 2014, Computer Vision, A Reference Guide.

[146]  Victor R. Lesser,et al.  Solving distributed constraint optimization problems using cooperative mediation , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[147]  Boi Faltings,et al.  Distributed Constraint Optimization Under Stochastic Uncertainty , 2011, AAAI.

[148]  Federico Pecora,et al.  Reasoning about and dynamically posting n-ary constraints in ADOPT , 2006 .

[149]  Antonio Iera,et al.  The Internet of Things: A survey , 2010, Comput. Networks.

[150]  Christian Bessiere,et al.  Global Constraints in Distributed Constraint Satisfaction and Optimization , 2014, Comput. J..

[151]  Amnon Meisels,et al.  Distributed Search by Constrained Agents: Algorithms, Performance, Communication , 2007, Advanced Information and Knowledge Processing.

[152]  Robert N. Lass,et al.  Intelligent systems demonstration: disaster evacuation support , 2007, AAAI 2007.

[153]  Agostino Poggi,et al.  Developing Multi-agent Systems with JADE , 2007, ATAL.

[154]  Craig Boutilier,et al.  Robust Policy Computation in Reward-Uncertain MDPs Using Nondominated Policies , 2010, AAAI.

[155]  Enrico Pontelli,et al.  ER-DCOPs: A Framework for Distributed Constraint Optimization with Uncertainty in Constraint Utilities , 2016, AAMAS.

[156]  Gauthier Picard,et al.  Designing a Marketplace for the Trading and Distribution of Energy in the Smart Grid , 2015, AAMAS.

[157]  Kalliopi Kravari,et al.  A Survey of Agent Platforms , 2015, J. Artif. Soc. Soc. Simul..

[158]  Victor R. Lesser,et al.  Coordinating multi-agent reinforcement learning with limited communication , 2013, AAMAS.

[159]  Nicholas R. Jennings,et al.  Bounded decentralised coordination over multiple objectives , 2011, AAMAS.

[160]  Sven Koenig,et al.  Trading Off Solution Quality for Faster Computation in DCOP Search Algorithms , 2009, IJCAI.

[161]  Alexander Kleiner,et al.  Towards CSP-based mission dispatching in C2/C4I systems , 2012, 2012 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[162]  Jonathan P. How,et al.  Decentralized control of partially observable Markov decision processes , 2015, 52nd IEEE Conference on Decision and Control.

[163]  Makoto Yokoo,et al.  Leximin Multiple Objective Optimization for Preferences of Agents , 2014, PRIMA.

[164]  Howard Raiffa,et al.  Decision analysis: introductory lectures on choices under uncertainty. 1968. , 1969, M.D.Computing.

[165]  Katsumi Inoue,et al.  Cyber security problem based on Multi-Objective Distributed Constraint Optimization technique , 2013, 2013 43rd Annual IEEE/IFIP Conference on Dependable Systems and Networks Workshop (DSN-W).

[166]  Makoto Yokoo,et al.  Proactive Dynamic Distributed Constraint Optimization , 2016, AAMAS.

[167]  Chandler Jake,et al.  Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI) , 2016 .

[168]  Michael M. Marefat,et al.  Distributed algorithms for sleep scheduling in wireless sensor networks , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[169]  Steven Okamoto,et al.  Explorative anytime local search for distributed constraint optimization , 2014, Artif. Intell..

[170]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[171]  Tal Grinshpoun Clustering Variables by Their Agents , 2015, 2015 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT).

[172]  Pascal Van Hentenryck,et al.  Constraint-based local search , 2018, Handbook of Heuristics.

[173]  Javier Larrosa,et al.  Improved Bounded Max-Sum for Distributed Constraint Optimization , 2012, CP.

[174]  Michael L. Littman,et al.  Graphical Models for Game Theory , 2001, UAI.

[175]  Ken Binmore,et al.  Fun and games : a text on game theory , 1992 .

[176]  Peter Van Roy,et al.  From Mini-clouds to Cloud Computing , 2010, 2010 Fourth IEEE International Conference on Self-Adaptive and Self-Organizing Systems Workshop.

[177]  Rachel Greenstadt,et al.  Robust Distributed Constraint Reasoning , 2009 .

[178]  相場亮 Distributed Constraint Satisfaction: Foundations of Cooperation in Multi - Agent Systems , 2001 .

[179]  Randy Cogill,et al.  Belief Propagation for Large-Variable-Domain Optimization on Factor Graphs: An Application to Decentralized Weather-Radar Coordination , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[180]  Makoto Yokoo,et al.  Infinite-Horizon Proactive Dynamic DCOPs , 2017, AAMAS.

[181]  Pedro Meseguer,et al.  Improving BnB-ADOPT+-AC , 2012, AAMAS.

[182]  Michael D. Smith,et al.  SSDPOP: improving the privacy of DCOP with secret sharing , 2007, AAMAS '07.

[183]  Nicholas R. Jennings,et al.  Bounded approximate decentralised coordination via the max-sum algorithm , 2009, Artif. Intell..

[184]  Sarvapali D. Ramchurn,et al.  Decentralized Coordination in RoboCup Rescue , 2010, Comput. J..

[185]  Boi Faltings,et al.  A Scalable Method for Multiagent Constraint Optimization , 2005, IJCAI.

[186]  Sarvapali D. Ramchurn,et al.  Agent-based control for decentralised demand side management in the smart grid , 2011, AAMAS.

[187]  Nicholas R. Jennings,et al.  DCOPs and bandits: exploration and exploitation in decentralised coordination , 2012, AAMAS.

[188]  Sven Koenig,et al.  BnB-ADOPT: an asynchronous branch-and-bound DCOP algorithm , 2008, AAMAS.

[189]  Milind Tambe,et al.  Taking DCOP to the real world: efficient complete solutions for distributed multi-event scheduling , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[190]  Amnon Meisels,et al.  Concurrent forward bounding for distributed constraint optimization problems , 2012, Artif. Intell..

[191]  Hoong Chuin Lau,et al.  Stochastic dominance in stochastic DCOPs for risk-sensitive applications , 2012, AAMAS.

[192]  Katia Sycara,et al.  Multi-Agent Meeting Scheduling: Preliminary Experimental Results , 1996 .

[193]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[194]  Amnon Meisels,et al.  Distributed constraint satisfaction with partially known constraints , 2009, Constraints.

[195]  Amnon Meisels,et al.  Asymmetric Distributed Constraint Optimization Problems , 2013, J. Artif. Intell. Res..

[196]  Boi Faltings,et al.  DUCT: An Upper Confidence Bound Approach to Distributed Constraint Optimization Problems , 2012, AAAI.

[197]  Abbas Jamalipour,et al.  Wireless communications , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[198]  Makoto Yokoo,et al.  Cooperative problem solving against adversary: quantified distributed constraint satisfaction problem , 2010, AAMAS.

[199]  Katsumi Inoue,et al.  Local Search Based Approximate Algorithm for Multi-Objective DCOPs , 2014, PRIMA.

[200]  Makoto Yokoo,et al.  DCOPs meet the realworld: exploring unknown reward matrices with applications to mobile sensor networks , 2009, IJCAI 2009.

[201]  Enrico Pontelli,et al.  Multi-Variable Agent decomposition for DCOPs , 2016, AAAI 2016.

[202]  Jacques F. Benders,et al.  Partitioning procedures for solving mixed-variables programming problems , 2005, Comput. Manag. Sci..

[203]  Enrico Pontelli,et al.  Exploiting GPUs in Solving (Distributed) Constraint Optimization Problems with Dynamic Programming , 2015, CP.

[204]  Huaimin Wang,et al.  MABP: an optimal resource allocation approach in data center networks , 2014, Science China Information Sciences.

[205]  Michael Chertkov,et al.  Robust Broadcast-Communication Control of Electric Vehicle Charging , 2010, 2010 First IEEE International Conference on Smart Grid Communications.

[206]  Gilles Pesant,et al.  Distributed search for supply chain coordination , 2009, Comput. Ind..

[207]  Adam Wolisz,et al.  Regionalizing global optimization algorithms to improve the operation of large ad hoc networks , 2004, 2004 IEEE Wireless Communications and Networking Conference (IEEE Cat. No.04TH8733).

[208]  Minglu Li,et al.  A Distributed Application Component Placement Approach for Cloud Computing Environment , 2011, 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing.

[209]  Tamir Tassa,et al.  Preserving Privacy in Region Optimal DCOP Algorithms , 2016, IJCAI.

[210]  Sven Koenig,et al.  Speeding Up Distributed Constraint Optimization Search Algorithms , 2014 .

[211]  Amnon Meisels,et al.  Asynchronous Forward Bounding for Distributed COPs , 2014, J. Artif. Intell. Res..

[212]  Amnon Meisels,et al.  Taxation search in boolean games , 2013, AAMAS.

[213]  Hoong Chuin Lau,et al.  Distributed Gibbs: a memory-bounded sampling-based DCOP algorithm , 2013, AAMAS.

[214]  W.C. Regli,et al.  Facilitating Communication for First Responders Using Dynamic Distributed Constraint Optimization , 2008, 2008 IEEE Conference on Technologies for Homeland Security.

[215]  Pascal Van Hentenryck,et al.  Residential Demand Response under Uncertainty , 2013, CP.

[216]  Enrico Pontelli,et al.  Accelerating exact and approximate inference for (distributed) discrete optimization with GPUs , 2016, Constraints.

[217]  Andrea Castelletti,et al.  Modeling the Management of Water Resources Systems Using Multi-Objective DCOPs , 2015, AAMAS.

[218]  Michael Winsper,et al.  DECENTRALIZED SUPPLY CHAIN FORMATION USING MAX‐SUM LOOPY BELIEF PROPAGATION , 2013, Comput. Intell..

[219]  Katsumi Inoue,et al.  AOF-Based Algorithm for Dynamic Multi-Objective Distributed Constraint Optimization , 2013, MIWAI.

[220]  Pedro Meseguer,et al.  Removing Redundant Messages in N-ary BnB-ADOPT , 2012, J. Artif. Intell. Res..

[221]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[222]  Christian Glaßer,et al.  Approximability and Hardness in Multi-objective Optimization , 2010, CiE.

[223]  P. Noriega,et al.  Auctions and Multi-agent Systems , 1999 .

[224]  Shlomi Dolev,et al.  SuperStabilizing protocols for dynamic distributed systems , 1995, PODC '95.

[225]  Matthew E. Taylor,et al.  Distributed learning and multi-objectivity in traffic light control , 2014, Connect. Sci..

[226]  Keith Decker,et al.  Task Scheduling using Constraint Optimization with Uncertainty , 2007 .

[227]  Michael Wooldridge,et al.  Game Theory and Decision Theory in Multi-Agent Systems , 2002, Autonomous Agents and Multi-Agent Systems.

[228]  Milind Tambe,et al.  Conflicts in teamwork: hybrids to the rescue , 2005, AAMAS '05.

[229]  Hiroshi Matsuo,et al.  Source Sink ( a ) power supply network ( b ) feeder trees , 2011 .

[230]  Amnon Meisels,et al.  AgentZero: A Framework for Simulating and Evaluating Multi-agent Algorithms , 2014, Agent-Oriented Software Engineering.

[231]  Vivek S. Borkar,et al.  Learning Algorithms for Markov Decision Processes with Average Cost , 2001, SIAM J. Control. Optim..

[232]  Pedro Meseguer,et al.  Maintaining Soft Arc Consistencies in BnB-ADOPT + during Search , 2013, CP.

[233]  Boi Faltings,et al.  Distributed constraint optimization with structured resource constraints , 2009, AAMAS.

[234]  John Davin,et al.  Hierarchical Variable Ordering for Multiagent Agreement Problems , 2006 .

[235]  Rubén S. Montero,et al.  Key Challenges in Cloud Computing: Enabling the Future Internet of Services , 2013, IEEE Internet Computing.

[236]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[237]  Pragnesh Jay Modi,et al.  A Distributed Constraint Optimization Approach to Wireless Network Optimization , 2007 .

[238]  Eugene C. Freuder,et al.  The Complexity of Some Polynomial Network Consistency Algorithms for Constraint Satisfaction Problems , 1985, Artif. Intell..

[239]  Edsger W. Dijkstra,et al.  Self stabilization in spite of distributed control , 1974 .

[240]  Enrico Pontelli,et al.  Improving DPOP with Branch Consistency for Solving Distributed Constraint Optimization Problems , 2014, CP.

[241]  Kayo Iizuka,et al.  Effective Disaster Evacuation by Solving the Distributed Constraint Optimization Problem , 2013, 2013 Second IIAI International Conference on Advanced Applied Informatics.

[242]  Enrico Pontelli,et al.  Multi-Variable Agents Decomposition for DCOPs , 2016, AAAI Conference on Artificial Intelligence.

[243]  Amnon Meisels,et al.  Synchronizing for Performance - DCOP Algorithms , 2013, ICAART.

[244]  Ziyu Chen,et al.  An Iterative Refined Max-sum_AD Algorithm via Single-side Value Propagation and Local Search , 2017, AAMAS.

[245]  J. Hellendoorn,et al.  Multi-agent control of traffic networks: Algorithm and case study , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[246]  Marius M. Solomon,et al.  Algorithms for the Vehicle Routing and Scheduling Problems with Time Window Constraints , 1987, Oper. Res..

[247]  Katia P. Sycara,et al.  No-commitment branch and bound search for distributed constraint optimization , 2006, AAMAS '06.

[248]  Gérard Verfaillie,et al.  Constraint Solving in Uncertain and Dynamic Environments: A Survey , 2005, Constraints.

[249]  Andrea Castelletti,et al.  Multiagent Systems and Distributed Constraint Reasoning for Regulatory Mechanism Design in Water Management , 2015 .

[250]  Aditya K. Ghose,et al.  Support-Based Distributed Optimisation: An Approach to Radiotherapy Scheduling , 2010, eHealth.

[251]  Ana L. C. Bazzan,et al.  Optimizing Preferences within Groups: A Case Study on Travel Recommendation , 2008, SBIA.

[252]  H Raiffa,et al.  Decision Analysis: Introductory Lectures on Choices under Uncertainty. , 1969 .

[253]  Robert N. Lass,et al.  DCOPolis: a framework for simulating and deploying distributed constraint reasoning algorithms , 2008, AAMAS.

[254]  Abdul Sattar,et al.  An Efficient Algorithm for Solving Dynamic Complex DCOP Problems , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[255]  Paul Scerri,et al.  Towards an Understanding of the Value of Cooperation in Uncertain World , 2011, 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[256]  Makoto Yokoo,et al.  Multiply-constrained distributed constraint optimization , 2006, AAMAS '06.