Solving Multi-Objective Distributed Constraint Optimization Problems

For many decades, the field of optimization has progressed both in the way it represents real-life problem and how it solves these problems. However, most of the focus have been towards problems with a single objective to optimize whereas almost all real-life problems involve multiple objectives. In this thesis, we study the solving of multi-objective problems that we propose to view as two successive steps. The first step consists in finding the Pareto front of the given problem, i.e., the set of solutions offering optimal trade-offs of the objectives. As the size of this Pareto front can increase exponentially with the size of the problem, efficient algorithms are required to find the Pareto front or at least a good approximation. This first step is thus mostly about algorithms and searching for solutions. The second step then consists in using the previously found Pareto front to extract a single solution that can be implemented. It can be assumed that this second step is performed by a decision maker. However, selecting a solution from the Pareto front is rarely trivial for a human as the set of alternatives can be very large. Additionally, many problems require quick decisions, in which case interacting with a decision maker can be impossible. This second step is more about decision making and defining additional criteria to extract solutions from the Pareto front. In the first chapter of this thesis, we present the background of the main fields of research to which our thesis contributes. These fields are Optimization, Constraint Programming and Distributed Problem Solving. In the second chapter, we introduce the preliminary notions required for the understanding of our contribution. We present the framework used to represent multi-objective problems both for centralized and distributed systems, as well as for dynamic environments where the problem changes over time. In addition, we present some of the representative applications considered during this thesis. In the third chapter, we study the first step of multi-objective problem solving and propose two new algorithms for finding the Pareto front of multi-objective optimization problems in distributed systems. The first algorithm is the Multi-Objective Distributed Pseudo-tree Optimization, an exact algorithm based on dynamic programming techniques to find the complete Pareto front. The second algorithm is the Distributed Pareto Local Search, an algorithm based on local search techniques that provides an approximation of the Pareto front. In the fourth chapter, we study the second step of multi-objective problem solving and propose three multi-objective decision making methods to isolate subsets of Pareto fronts that can be deemed more interesting. The first selection method uses a preference-based criterion while the second and third selection methods use criteria specific to dynamic problems. In the fifth chapter, we discuss the related works and compare them with our proposed algorithms and decision methods. In the final chapter, we conclude this thesis by summing up our contribution and discussing the potential future works related to this thesis.

[1]  Boi Faltings,et al.  Optimal Solution Stability in Dynamic, Distributed Constraint Optimization , 2007, IAT.

[2]  Seyyed Ali MirHassani,et al.  Solution approaches to the course timetabling problem , 2011, Artificial Intelligence Review.

[3]  Ben Paechter,et al.  Setting the Research Agenda in Automated Timetabling: The Second International Timetabling Competition , 2010, INFORMS J. Comput..

[4]  Tuomas Sandholm,et al.  An Implementation of the Contract Net Protocol Based on Marginal Cost Calculations , 1993, AAAI.

[5]  Katsumi Inoue,et al.  Answer set programming as a modeling language for course timetabling , 2013, Theory Pract. Log. Program..

[6]  Katsumi Inoue,et al.  Lp-Norm based algorithm for multi-objective distributed constraint optimization , 2014, AAMAS.

[7]  Matthias Ehrgott,et al.  Integer programming methods for large-scale practical classroom assignment problems , 2015, Comput. Oper. Res..

[8]  Katsumi Inoue,et al.  Systems resilience: a challenge problem for dynamic constraint-based agent systems , 2013, AAMAS.

[9]  Alex M. Andrew,et al.  Knowledge Representation, Reasoning and Declarative Problem Solving , 2004 .

[10]  Thomas Schiex,et al.  Valued Constraint Satisfaction Problems: Hard and Easy Problems , 1995, IJCAI.

[11]  Roman Barták,et al.  A New Approach to Modeling and Solving Minimal Perturbation Problems , 2003, CSCLP.

[12]  Khaled Ghédira,et al.  Constraint Satisfaction Problems: Ghédira/Constraint Satisfaction Problems , 2013 .

[13]  Mihalis Yannakakis,et al.  On the approximability of trade-offs and optimal access of Web sources , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[14]  Aditya K. Ghose,et al.  SBDO: A New Robust Approach to Dynamic Distributed Constraint Optimisation , 2009, PRIMA.

[15]  M. J. Soomer,et al.  Scheduling aircraft landings using airlines' preferences , 2008, Eur. J. Oper. Res..

[16]  Boi Faltings,et al.  MB-DPOP: A New Memory-Bounded Algorithm for Distributed Optimization , 2007, IJCAI.

[17]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[18]  Katsumi Inoue,et al.  Utilitarian and Egalitarian Solutions for Multi-objective Constraint Optimization , 2014, 2014 IEEE 26th International Conference on Tools with Artificial Intelligence.

[19]  姜哲,et al.  韧性(Resilience)的概念分析 , 2008 .

[20]  Makoto Yokoo,et al.  Proactive Dynamic Distributed Constraint Optimization , 2016, AAMAS.

[21]  M. Janssen,et al.  Multi-Agent Systems for the Simulation of Land-Use and Land-Cover Change: A Review , 2003 .

[22]  H. Kellerer,et al.  Introduction to NP-Completeness of Knapsack Problems , 2004 .

[23]  Makoto Yokoo,et al.  Pseudo-tree-based algorithm for approximate distributed constraint optimization with quality bounds , 2011, AAMAS.

[24]  Patricia H. Longstaff,et al.  Building Resilient Communities: A Preliminary Framework for Assessment , 2010 .

[25]  Nicholas R. Jennings,et al.  Bounded decentralised coordination over multiple objectives , 2011, AAMAS.

[26]  Sven Koenig,et al.  Incremental DCOP search algorithms for solving dynamic DCOPs , 2011, AAMAS.

[27]  G. Monahan State of the Art—A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 1982 .

[28]  Martin Gebser,et al.  Answer Set Solving in Practice , 2012, Answer Set Solving in Practice.

[29]  Amnon Meisels,et al.  Hybrid search for minimal perturbation in Dynamic CSPs , 2011, Constraints.

[30]  Neil Immerman,et al.  The Complexity of Decentralized Control of Markov Decision Processes , 2000, UAI.

[31]  Carlos M. Fonseca,et al.  An Improved Dimension-Sweep Algorithm for the Hypervolume Indicator , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[32]  Rolf Wanka,et al.  Fairness in academic course timetabling , 2013, Annals of Operations Research.

[33]  Tommy R. Jensen,et al.  Graph Coloring Problems , 1994 .

[34]  Ulrich Junker Preference-Based Inconsistency Proving: When the Failure of the Best Is Sufficient , 2006, ECAI.

[35]  Richard R. Brooks,et al.  Distributed Sensor Networks: A Multiagent Perspective , 2008 .

[36]  Patrice Perny,et al.  Near Admissible Algorithms for Multiobjective Search , 2008, ECAI.

[37]  Peter Ross,et al.  Genetic algorithms and timetabling , 2003 .

[38]  Weixiong Zhang,et al.  Distributed stochastic search and distributed breakout: properties, comparison and applications to constraint optimization problems in sensor networks , 2005, Artif. Intell..

[39]  Pierre Hansen,et al.  Algorithms for the maximum satisfiability problem , 1987, Computing.

[40]  Kalyanmoy Deb,et al.  Reference point based multi-objective optimization using evolutionary algorithms , 2006, GECCO.

[41]  Steven Okamoto,et al.  Distributed constraint optimization for teams of mobile sensing agents , 2014, Autonomous Agents and Multi-Agent Systems.

[42]  R. Fletcher Practical Methods of Optimization , 1988 .

[43]  Tom Holvoet,et al.  The DynCOAA algorithm for dynamic constraint optimization problems , 2006, AAMAS '06.

[44]  Katsumi Inoue,et al.  Modeling and Algorithm for Dynamic Multi-objective Weighted Constraint Satisfaction Problem , 2014, ICAART.

[45]  Katsumi Inoue,et al.  Representative Solutions for Multi-Objective Constraint Optimization Problems , 2016, KR.

[46]  Danny Weyns,et al.  Multi-Agent Systems , 2009 .

[47]  Michel Bruneau,et al.  A Framework to Quantitatively Assess and Enhance the Seismic Resilience of Communities , 2003 .

[48]  Agostino Poggi,et al.  JADE - A Java Agent Development Framework , 2005, Multi-Agent Programming.

[49]  Alex S. Fukunaga An Improved Search Algorithm for Min-Perturbation , 2013, CP.

[50]  Milind Tambe,et al.  Quality Guarantees on k-Optimal Solutions for Distributed Constraint Optimization Problems , 2007, IJCAI.

[51]  Makoto Yokoo,et al.  The Distributed Constraint Satisfaction Problem: Formalization and Algorithms , 1998, IEEE Trans. Knowl. Data Eng..

[52]  Katsumi Inoue,et al.  Distributed Pareto Local Search for Multi-Objective DCOPs , 2017, IEICE Trans. Inf. Syst..

[53]  Evripidis Bampis,et al.  Approximating the Pareto Curve with Local Search for the Bicriteria TSP (1, 2) Problem , 2003, FCT.

[54]  Enrico Pontelli,et al.  Distributed Constraint Optimization Problems and Applications: A Survey , 2016, J. Artif. Intell. Res..

[55]  Katsumi Inoue,et al.  Model and Algorithm for Dynamic Multi-Objective Distributed Optimization , 2013, PRIMA.

[56]  Martin Josef Geiger,et al.  Multi-criteria Curriculum-Based Course Timetabling-A Comparison of a Weighted Sum and a Reference Point Based Approach , 2009, EMO.

[57]  Weixiong Zhang,et al.  An analysis and application of distributed constraint satisfaction and optimization algorithms in sensor networks , 2003, AAMAS '03.

[58]  Milind Tambe,et al.  Asynchronous algorithms for approximate distributed constraint optimization with quality bounds , 2010, AAMAS.

[59]  Calvin C. Gotlieb,et al.  The Construction of Class-Teacher Time-Tables , 1962, IFIP Congress.

[60]  Makoto Yokoo,et al.  Distributed Problem Solving , 2012, AI Mag..

[61]  Nicholas R. Jennings,et al.  Bounded approximate decentralised coordination via the max-sum algorithm , 2009, Artif. Intell..

[62]  Hana Rudová,et al.  Complex university course timetabling , 2011, J. Sched..

[63]  Katsutoshi Hirayama,et al.  Dynamic SAT with Decision Change Costs: Formalization and Solutions , 2011, IJCAI.

[64]  Boi Faltings,et al.  A Scalable Method for Multiagent Constraint Optimization , 2005, IJCAI.

[65]  Mark Wallace,et al.  Probe Backtrack Search for Minimal Perturbation in Dynamic Scheduling , 2000, Constraints.

[66]  Emmanuel Hebrard,et al.  Robust Solutions for Constraint Satisfaction and Optimization , 2004, AAAI.

[67]  Radu Marinescu,et al.  Exploiting Problem Decomposition in Multi-objective Constraint Optimization , 2009, CP.

[68]  Javier Larrosa,et al.  Bucket elimination for multiobjective optimization problems , 2006, J. Heuristics.

[69]  Rina Dechter,et al.  Mini-buckets: A general scheme for bounded inference , 2003, JACM.

[70]  Rina Dechter,et al.  AND/OR search spaces for graphical models , 2007, Artif. Intell..

[71]  Makoto Yokoo,et al.  Coalition Structure Generation based on Distributed Constraint Optimization , 2010, AAAI.

[72]  Nic Wilson,et al.  Computing Possibly Optimal Solutions for Multi-Objective Constraint Optimisation with Tradeoffs , 2015, IJCAI.

[73]  Shimon Whiteson,et al.  Queued Pareto Local Search for Multi-Objective Optimization , 2014, PPSN.

[74]  Paolo Toth,et al.  An overview of curriculum-based course timetabling , 2015 .

[75]  Sven Koenig,et al.  BnB-ADOPT: an asynchronous branch-and-bound DCOP algorithm , 2008, AAMAS.

[76]  Torsten Schaub,et al.  asprin: Customizing Answer Set Preferences without a Headache , 2015, AAAI.

[77]  A. Stechow,et al.  Decomposition , 1902, The Indian medical gazette.

[78]  Milind Tambe,et al.  Taking DCOP to the real world: efficient complete solutions for distributed multi-event scheduling , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[79]  Dirk Thierens,et al.  Stochastic Pareto local search: Pareto neighbourhood exploration and perturbation strategies , 2012, J. Heuristics.

[80]  Ronald C. Arkin,et al.  Cooperation without communication: Multiagent schema-based robot navigation , 1992, J. Field Robotics.

[81]  Kalyanmoy Deb,et al.  Multi-Objective Evolutionary Algorithm for University Class Timetabling Problem , 2007, Evolutionary Scheduling.

[82]  Rina Dechter,et al.  Constraint Processing , 1995, Lecture Notes in Computer Science.

[83]  Barry McCollum,et al.  The Second International Timetabling Competition (ITC-2007): Curriculum-based Course Timetabling (Track 3) — preliminary presentation — , 2007 .

[84]  Makoto Yokoo,et al.  Adopt: asynchronous distributed constraint optimization with quality guarantees , 2005, Artif. Intell..

[85]  Ana L. C. Bazzan,et al.  Evaluating the performance of DCOP algorithms in a real world, dynamic problem , 2008, AAMAS.

[86]  Makoto Yokoo,et al.  Distributed search method with bounded cost vectors on multiple objective DCOPs , 2012 .

[87]  Thomas Stützle,et al.  Pareto Local Optimum Sets in the Biobjective Traveling Salesman Problem: An Experimental Study , 2004, Metaheuristics for Multiobjective Optimisation.

[88]  R. Keith Sawyer,et al.  Artificial Societies , 2003 .

[89]  El-Ghazali Talbi,et al.  On dominance-based multiobjective local search: design, implementation and experimental analysis on scheduling and traveling salesman problems , 2012, J. Heuristics.

[90]  Luca Di Gaspero,et al.  Multi-neighbourhood Local Search with Application to Course Timetabling , 2002, PATAT.

[91]  Thomas Schiex,et al.  Solving weighted CSP by maintaining arc consistency , 2004, Artif. Intell..

[92]  Simon de Givry,et al.  Radio Link Frequency Assignment , 1999, Constraints.

[93]  Radu Marinescu Efficient Approximation Algorithms for Multi-objective Constraint Optimization , 2011, ADT.

[94]  Amnon Meisels Constraints Optimization Problems - COPs , 2008 .

[95]  Milind Tambe,et al.  Distributed Algorithms for DCOP: A Graphical-Game-Based Approach , 2004, PDCS.

[96]  Peter C. Fishburn,et al.  LEXICOGRAPHIC ORDERS, UTILITIES AND DECISION RULES: A SURVEY , 1974 .

[97]  Amnon Meisels,et al.  Scheduling Agents - distributed Timetabling Problems , 2003 .

[98]  Weijia Jia,et al.  Vertex Cover: Further Observations and Further Improvements , 2001, J. Algorithms.

[99]  Mario Vanhoucke,et al.  An evolutionary approach for the nurse rerostering problem , 2011, Comput. Oper. Res..

[100]  Luca Di Gaspero,et al.  Benchmarking curriculum-based course timetabling: formulations, data formats, instances, validation, visualization, and results , 2012, Ann. Oper. Res..

[101]  Rina Dechter,et al.  Bucket Elimination: A Unifying Framework for Reasoning , 1999, Artif. Intell..

[102]  Vahid Lotfi,et al.  A graph coloring algorithm for large scale scheduling problems , 1986, Comput. Oper. Res..

[103]  Jacques Ferber,et al.  Multi-agent systems - an introduction to distributed artificial intelligence , 1999 .

[104]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[105]  Radu Marinescu,et al.  Best-First vs. Depth-First AND/OR Search for Multi-objective Constraint Optimization , 2010, 2010 22nd IEEE International Conference on Tools with Artificial Intelligence.

[106]  Katsumi Inoue,et al.  Finding Resilient Solutions for Dynamic Multi-Objective Constraint Optimization Problems , 2015, ICAART.

[107]  Paolo Toth,et al.  Knapsack Problems: Algorithms and Computer Implementations , 1990 .

[108]  C. S. Holling Resilience and Stability of Ecological Systems , 1973 .

[109]  Hoong Chuin Lau,et al.  Distributed Gibbs: a memory-bounded sampling-based DCOP algorithm , 2013, AAMAS.

[110]  Andrea Castelletti,et al.  Modeling the Management of Water Resources Systems Using Multi-Objective DCOPs , 2015, AAMAS.

[111]  Ilkka Niemelä,et al.  Logic programs with stable model semantics as a constraint programming paradigm , 1999, Annals of Mathematics and Artificial Intelligence.

[112]  Agostinho C. Rosa,et al.  Solving the Timetabling Problem with Simulated Annealing , 1999, ICEIS.