DISTRIBUTED CONSTRAINT SATISFACTION FOR COORDINATING AND INTEGRATING A LARGE-SCALE, HETEROGENEOUS ENTERPRISE

Market forces are continuously driving public and private organisations towards higher productivity, shorter process and production times, and fewer labour hours. To cope with these changes, organisations are adopting new organisational models of coordination and cooperation that increase their flexibility, consistency, efficiency, productivity and profit margins. In this thesis an organisational model of coordination and cooperation is examined using a real life example; the technical integration of a distributed large-scale project of an international physics collaboration. The distributed resource constraint project scheduling problem is modelled and solved with the methods of distributed constraint satisfaction. A distributed local search method, the distributed breakout algorithm (DisBO), is used as the basis for the coordination scheme. The efficiency of the local search method is improved by extending it with an incremental problem solving scheme with variable ordering. The scheme is implemented as central algorithm, incremental breakout algorithm (IncBO), and as distributed algorithm, distributed incremental breakout algorithm (DisIncBO). In both cases, strong performance gains are observed for solving underconstrained problems. Distributed local search algorithms are incomplete and lack a termination guarantee. When problems contain hard or unsolvable subproblems and are tightly or overconstrained, local search falls into infinite cycles without explanation. A scheme is developed that identifies hard or unsolvable subproblems and orders these to size. This scheme is based on the constraint weight information generated by the breakout algorithm during search. This information, combined with the graph structure, is used to derive a fail first variable order. Empirical results show that the derived variable order is 'perfect'. When it guides simple backtracking, exceptionally hard problems do not occur, and, when problems are unsolvable, the fail depth is always the shortest. Two hybrid algorithms, BOBT and BOBT-SUSP are developed. When the problem is unsolvable, BOBT returns the minimal subproblem within the search scope and BOBT-SUSP returns the smallest unsolvable subproblem using a powerful weight sum constraint. A distributed hybrid algorithm (DisBOBT) is developed that combines DisBO with DisBT. The distributed hybrid algorithm first attempts to solve the problem with DisBO. If no solution is available after a bounded number of breakouts, DisBO is terminated, and DisBT solves the problem. DisBT is guided by a distributed variable order that is derived from the constraint weight information and the graph structure. The variable order is incrementally established, every time the partial solution needs to be extended, the next variable within the order is identified. Empirical results show strong performance gains, especially when problems are overconstrained and contain small unsolvable subproblems.

[1]  Solomon W. Golomb,et al.  Backtrack Programming , 1965, JACM.

[2]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[3]  Knut Bleicher Organisation als System , 1972 .

[4]  Ugo Montanari,et al.  Networks of constraints: Fundamental properties and applications to picture processing , 1974, Inf. Sci..

[5]  David L. Waltz,et al.  Understanding Line drawings of Scenes with Shadows , 1975 .

[6]  Edward M. Reingold,et al.  Backtrack programming techniques , 1975, CACM.

[7]  Alan K. Mackworth Consistency in Networks of Relations , 1977, Artif. Intell..

[8]  Organisation als System , 1978 .

[9]  Eugene C. Freuder Synthesizing constraint expressions , 1978, CACM.

[10]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[11]  J. J. McGregor Relational consistency algorithms and their application in finding subgraph and graph isomorphisms , 1979, Inf. Sci..

[12]  Daniel Brélaz,et al.  New methods to color the vertices of a graph , 1979, CACM.

[13]  Robert M. Haralick,et al.  Increasing Tree Search Efficiency for Constraint Satisfaction Problems , 1979, Artif. Intell..

[14]  Eugene C. Freuder A Sufficient Condition for Backtrack-Free Search , 1982, JACM.

[15]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[16]  Alan K. Mackworth Constraint Satisfaction , 1985 .

[17]  Thomas C. Henderson,et al.  Arc and Path Consistency Revisited , 1986, Artif. Intell..

[18]  Judea Pearl,et al.  Evidential Reasoning Using Stochastic Simulation of Causal Models , 1987, Artif. Intell..

[19]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[20]  Rolf H. Möhring,et al.  Scheduling project networks with resource constraints and time windows , 1988 .

[21]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[22]  Mark D. Johnston,et al.  A discrete stochastic neural network algorithm for constraint satisfaction problems , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[23]  Jun Gu,et al.  Parallel algorithms and architectures for very fast AI search , 1991 .

[24]  Victor R. Lesser,et al.  Multistage negotiation for distributed constraint satisfaction , 1991, IEEE Trans. Syst. Man Cybern..

[25]  Edward Tsang,et al.  Solving constraint satisfaction problems using neural networks , 1991 .

[26]  Peter C. Cheeseman,et al.  Where the Really Hard Problems Are , 1991, IJCAI.

[27]  Norman M. Sadeh,et al.  Distributed constrained heuristic search , 1991, IEEE Trans. Syst. Man Cybern..

[28]  Michael N. Huhns,et al.  Multiagent truth maintenance , 1991, IEEE Trans. Syst. Man Cybern..

[29]  Vipin Kumar,et al.  Algorithms for Constraint-Satisfaction Problems: A Survey , 1992, AI Mag..

[30]  Steven Minton,et al.  Minimizing Conflicts: A Heuristic Repair Method for Constraint Satisfaction and Scheduling Problems , 1992, Artif. Intell..

[31]  Makoto Yokoo,et al.  Distributed constraint satisfaction for formalizing distributed problem solving , 1992, [1992] Proceedings of the 12th International Conference on Distributed Computing Systems.

[32]  Tad Hogg,et al.  Solving the Really Hard Problems with Cooperative Search , 1993, AAAI.

[33]  Patrick Prosser,et al.  Domain Filtering can Degrade Intelligent Backtracking Search , 1993, IJCAI.

[34]  Edward P. K. Tsang,et al.  Foundations of constraint satisfaction , 1993, Computation in cognitive science.

[35]  Paul Morris,et al.  The Breakout Method for Escaping from Local Minima , 1993, AAAI.

[36]  Una-May O'Reilly,et al.  Program Search with a Hierarchical Variable Lenght Representation: Genetic Programming, Simulated Annealing and Hill Climbing , 1994, PPSN.

[37]  Makoto Yokoo,et al.  Weak-Commitment Search for Solving Constraint Satisfaction Problems , 1994, AAAI.

[38]  Toby Walsh,et al.  Easy Problems are Sometimes Hard , 1994, Artif. Intell..

[39]  Enn Tyugu,et al.  Constraint Programming , 1994, NATO ASI Series.

[40]  David W. Hildum Flexibility in a Knowledge-Based System for Solving Dynamic Resource-Constrained Scheduling Problems , 1994 .

[41]  Eugene C. Freuder,et al.  Contradicting Conventional Wisdom in Constraint Satisfaction , 1994, ECAI.

[42]  Tad Hogg,et al.  The Hardest Constraint Problems: A Double Phase Transition , 1994, Artif. Intell..

[43]  Barbara M. Smith,et al.  Sparse Constraint Graphs and Exceptionally Hard Problems , 1995, IJCAI.

[44]  Patrick Prosser,et al.  Forward Checking with Backmarking , 1995, Constraint Processing, Selected Papers.

[45]  Fahiem Bacchus,et al.  On the Forward Checking Algorithm , 1995, CP.

[46]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[47]  Fahiem Bacchus,et al.  Dynamic Variable Ordering in CSPs , 1995, CP.

[48]  Makoto Yokoo,et al.  Asynchronous Weak-commitment Search for Solving Distributed Constraint Satisfaction Problems , 1995, CP.

[49]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[50]  Matthew L. Ginsberg,et al.  Limited Discrepancy Search , 1995, IJCAI.

[51]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[52]  Barbara M. Smith In Search of Exceptionally Difficult Constraint Satisfaction Problems , 1995, Constraint Processing, Selected Papers.

[53]  Andrea C. Arpaci-Dusseau,et al.  Effective distributed scheduling of parallel workloads , 1996, SIGMETRICS '96.

[54]  Richard E. Korf,et al.  Improved Limited Discrepancy Search , 1996, AAAI/IAAI, Vol. 1.

[55]  Pang,et al.  A new synthesis algorithm for solving CSPsWanlin , 1996 .

[56]  Toby Walsh,et al.  The Constrainedness of Search , 1996, AAAI/IAAI, Vol. 1.

[57]  Norman M. Sadeh,et al.  Variable and Value Ordering Heuristics for the Job Shop Scheduling Constraint Satisfaction Problem , 1996, Artif. Intell..

[58]  Toby Walsh,et al.  An Empirical Study of Dynamic Variable Ordering Heuristics for the Constraint Satisfaction Problem , 1996, CP.

[59]  Michel Gendreau,et al.  A View of Local Search in Constraint Programming , 1996, CP.

[60]  Paul Walton Purdom,et al.  Backtracking and probing , 1996, Satisfiability Problem: Theory and Applications.

[61]  Hantao Zhang,et al.  Combining Local Search and Backtracking Techniques for Constraint Satisfaction , 1996, AAAI/IAAI, Vol. 1.

[62]  Valmir Carneiro Barbosa,et al.  An introduction to distributed algorithms , 1996 .

[63]  Thomas Schiex,et al.  Russian Doll Search for Solving Constraint Optimization Problems , 1996, AAAI/IAAI, Vol. 1.

[64]  M. Yokoo,et al.  Distributed Breakout Algorithm for Solving Distributed Constraint Satisfaction Problems , 1996 .

[65]  Ari-Pekka Hameri,et al.  What to be implemented at the early stage of a large-scale project , 1997 .

[66]  Makoto Yokoo,et al.  Distributed Partial Constraint Satisfaction Problem , 1997, CP.

[67]  Nils J. Nilsson,et al.  Artificial Intelligence: A New Synthesis , 1997 .

[68]  Pedro Meseguer Interleaved Depth-First Search , 1997, IJCAI.

[69]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[70]  Munindar P. Singh,et al.  Readings in agents , 1997 .

[71]  Yves Deville,et al.  A Distributed Arc-Consistency Algorithm , 1995, Sci. Comput. Program..

[72]  R. Dechter Backtracking Algorithms for Constraint Satisfaction Problems -- a Survey , 1998 .

[73]  Christian Bessiere,et al.  Backtracking in Distributed Constraint Networks , 1998 .

[74]  Makoto Yokoo,et al.  The Distributed Constraint Satisfaction Problem: Formalization and Algorithms , 1998, IEEE Trans. Knowl. Data Eng..

[75]  Paul Shaw,et al.  Using Constraint Programming and Local Search Methods to Solve Vehicle Routing Problems , 1998, CP.

[76]  Edward P. K. Tsang,et al.  Guided local search joins the elite in discrete optimisation , 1998, Constraint Programming and Large Scale Discrete Optimization.

[77]  Peter J. Stuckey,et al.  Programming with Constraints: An Introduction , 1998 .

[78]  Roman Barták,et al.  Constraint Programming: In Pursuit of the Holy Grail , 1999 .

[79]  Marko Fabiunke,et al.  Parallel Distributed Constraint Satisfaction , 1999, PDPTA.

[80]  Robert Klein,et al.  Scheduling of Resource-Constrained Projects , 1999 .

[81]  Mark Wallace,et al.  Search in AI: Escaping from the CSP Straightjacket , 2000, ECAI.

[82]  Markus Hannebauer A Formalization of Autonomous Dynamic Reconfiguration in Distributed Constraint Satisfaction , 2000, Fundam. Informaticae.

[83]  Marty V. Deise,et al.  Executive's Guide to E-Business: From Tactics to Strategy , 2000 .

[84]  Marius-Calin Silaghi,et al.  Asynchronous Search with Aggregations , 2000, AAAI/IAAI.

[85]  Andrew J. Davenport,et al.  An empirical investigation into the exceptionally hard problems , 2001 .

[86]  Youssef Hamadi Interleaved backtracking in distributed constraint networks , 2001, Proceedings 13th IEEE International Conference on Tools with Artificial Intelligence. ICTAI 2001.

[87]  Christian Bessiere,et al.  Distributed Dynamic Backtracking , 2001, CP.

[88]  Nicholas R. Jennings,et al.  The organisation of sociality: a manifesto for a new science of multi-agent systems , 2001 .

[89]  Pedro Meseguer,et al.  Specializing Russian Doll Search , 2001, CP.

[90]  Amnon Meisels,et al.  Distributed Forward Checking with Dynamic Ordering , 2001 .

[91]  Maintaining Consistency for ABT , 2001 .

[92]  相場亮 Distributed Constraint Satisfaction: Foundations of Cooperation in Multi - Agent Systems , 2001 .

[93]  Weixiong Zhang,et al.  Distributed Breakout vs . Distributed Stochastic : A Comparative Evaluation on Scan Scheduling , 2002 .

[94]  Weixiong Zhang,et al.  Distributed breakout revisited , 2002, AAAI/IAAI.

[95]  Rina Dechter,et al.  Backjump-based backtracking for constraint satisfaction problems , 2002, Artif. Intell..

[96]  Hoong Chuin Lau,et al.  Combining Two Heuristics to Solve a Supply Chain Optimization Problem , 2002, ECAI.

[97]  Youssef Hamadi,et al.  Distributed, Interleaved, Parallel and Cooperative Search in Constraint Satisfaction Networks , 2002 .

[98]  Zhidong Deng,et al.  Distributed problem solving in sensor networks , 2002, AAMAS '02.

[99]  Boi Faltings,et al.  A Distributed Breakout Algorithm for Solving a Large-Scale Project Scheduling Problem , 2002 .

[100]  Hani El Sakkout,et al.  Local Probing Applied to Scheduling , 2002, CP.

[101]  Makoto Yokoo,et al.  An Asynchronous Complete Method for General Distributed Constraint Optimization , 2002 .

[102]  Boi Faltings,et al.  Open Constraint Satisfaction , 2002, CP.

[103]  Monique Calisti,et al.  Constraint Satisfaction Techniques for Negotiating Agents , 2002 .

[104]  Boi Faltings,et al.  Hybrid Solving Scheme for Distributed Constraint Satisfaction Problems , 2003, IJCAI 2003.

[105]  Boi Faltings,et al.  A multiagent-system for integrating a large-scale project , 2003, AAMAS '03.

[106]  Boi Faltings,et al.  Using the Breakout Algorithm to Identify Hard and Unsolvable Subproblems , 2003, CP.

[107]  Pedro Meseguer,et al.  Distributed Forward Checking , 2003, CP.

[108]  Boi Faltings,et al.  Incremental Breakout Algorithm with Variable Ordering , 2003, FLAIRS.

[109]  Mahdieh Soleymani Baghshah,et al.  Semi-Supervised Metric Learning Using Pairwise Constraints , 2009, IJCAI.

[110]  Wanlin Pang,et al.  A Graph Based Synthesis Algorithm for Solving CSPs , 2003, FLAIRS.

[111]  Makoto Yokoo,et al.  Algorithms for Distributed Constraint Satisfaction: A Review , 2000, Autonomous Agents and Multi-Agent Systems.

[112]  Mark Wallace,et al.  Probe Backtrack Search for Minimal Perturbation in Dynamic Scheduling , 2000, Constraints.

[113]  Mark Wallace,et al.  Practical applications of constraint programming , 2004, Constraints.

[114]  Makoto Yokoo,et al.  Secure distributed constraint satisfaction: reaching agreement without revealing private information , 2002, Artif. Intell..

[115]  Marius-Călin Silaghi,et al.  Openness in Asynchronous Constraint Satisfaction Algorithms , .