The Tunneling Algorithm for Partial CSPs and Combinatorial Optimization Problems

Constraint satisfaction is the core of a large number of problems, notably scheduling. Because of their potential for containing the combinatorial explosion problem in constraint satisfaction, local search methods have received a lot of attention in the last few years. The problem with these methods is that they can be trapped in local minima. GENET is a connectionist approach to constraint satisfaction. It escapes local minima by means of a weight adjustment scheme, which has been demonstrated to be highly effective. The tunneling algorithm described in this paper is an extension of GENET for optimization. The main idea is to introduce modifications to the function which is to be optimized by the network (this function mirrors the objective function which is specified in the problem). We demonstrate the outstanding performance of this algorithm on constraint satisfaction problems, constraint satisfaction optimization problems, partial constraint satisfaction problems, radio frequency allocation problems and traveling salesman problems.

[1]  Peter Whittle Optimization Under Constraints: Theory and Applications of Nonlinear Programming. , 1972 .

[2]  G. Mitra Optimization Under Constraints (Theory and Applications of Nonlinear Programming) , 1972 .

[3]  G. Nemhauser,et al.  Integer Programming , 2020 .

[4]  Brian W. Kernighan,et al.  An Effective Heuristic Algorithm for the Traveling-Salesman Problem , 1973, Oper. Res..

[5]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[6]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[7]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[8]  A. V. Levy,et al.  The Tunneling Algorithm for the Global Minimization of Functions , 1985 .

[9]  Eugene L. Lawler,et al.  The Traveling Salesman Problem: A Guided Tour of Combinatorial Optimization , 1985 .

[10]  N. Biggs THE TRAVELING SALESMAN PROBLEM A Guided Tour of Combinatorial Optimization , 1986 .

[11]  Pascal Van Hentenryck,et al.  Applications of CHIP to industrial and engineering problems , 1988, IEA/AIE '88.

[12]  Richard J. Wallace,et al.  Partial Constraint Satisfaction , 1989, IJCAI.

[13]  Fred W. Glover,et al.  Tabu Search - Part I , 1989, INFORMS J. Comput..

[14]  Fred Glover,et al.  Tabu Search - Part II , 1989, INFORMS J. Comput..

[15]  Cecilia R. Aragon,et al.  Optimization by Simulated Annealing: An Experimental Evaluation; Part II, Graph Coloring and Number Partitioning , 1991, Oper. Res..

[16]  Edward Tsang,et al.  Solving constraint satisfaction problems using neural networks , 1991 .

[17]  Gerhard Reinelt,et al.  TSPLIB - A Traveling Salesman Problem Library , 1991, INFORMS J. Comput..

[18]  A. A. Zhigli︠a︡vskiĭ,et al.  Theory of Global Random Search , 1991 .

[19]  Hector J. Levesque,et al.  A New Method for Solving Hard Satisfiability Problems , 1992, AAAI.

[20]  Steven Minton,et al.  Minimizing Conflicts: A Heuristic Repair Method for Constraint Satisfaction and Scheduling Problems , 1992, Artif. Intell..

[21]  Bart Selman,et al.  Domain-Independent Extensions to GSAT : Solving Large StructuredSatis ability , 1993 .

[22]  Eugene C. Freuder,et al.  Conjunctive Width Heuristics for Maximal Constraint Satisfaction , 1993, AAAI.

[23]  Edward P. K. Tsang,et al.  Foundations of constraint satisfaction , 1993, Computation in cognitive science.

[24]  Paul Morris,et al.  The Breakout Method for Escaping from Local Minima , 1993, AAAI.

[25]  Barbara M. Smith,et al.  The Phase Transition and the Mushy Region in Constraint Satisfaction Problems , 1994, ECAI.

[26]  Andrew J. Davenport,et al.  GENET: A Connectionist Architecture for Solving Constraint Satisfaction Problems by Iterative Improvement , 1994, AAAI.

[27]  Bart Selman,et al.  Noise Strategies for Improving Local Search , 1994, AAAI.

[28]  Edward Tsang,et al.  A cascadable VLSI design for GENET , 1995 .

[29]  Gerhard Reinelt,et al.  The Traveling Salesman , 2001, Lecture Notes in Computer Science.

[30]  Ehl Emile Aarts,et al.  Simulated annealing and Boltzmann machines , 2003 .