Mathematical programming formulations for neural combinatorial optimization algorithms

This paper considers the anlog neural solution of the combinatorial optimization problem. the solution method is analyzed based on the Lagrange multiplier method for the continuous relaxation problem of 0-1 integer programming. It is shown that the solution process can be interpreted as the solution by the gradient method for the saddle point of the Lagrange function. an improved Hopfiled net is derived from the formulation as the pure integer programming. the elastic net and the generalized deformable model are derived from the mixed integer programming problem. Based on those results, an interpretation of the deterministic annealing is derived from the viewpoint of mathematical programming. It is shown that the Lagrange function can work as the Lyapunov function for the solution process and the convergence property of those neural methods of solution is analyzed.

[1]  Richard Durbin,et al.  An analogue approach to the travelling salesman problem using an elastic net method , 1987, Nature.

[2]  Alan L. Yuille,et al.  Determining The Optimal Weights In Multiple Objective Function Optimization , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[3]  Carsten Peterson,et al.  A New Method for Mapping Optimization Problems Onto Neural Networks , 1989, Int. J. Neural Syst..

[4]  Alan L. Yuille,et al.  Generalized Deformable Models, Statistical Physics, and Matching Problems , 1990, Neural Computation.

[5]  Petar D. Simic,et al.  Statistical mechanics as the underlying theory of ‘elastic’ and ‘neural’ optimisations , 1990 .

[6]  Von-Wun Soo,et al.  S-learning: a reinforcement learning method without parameter tuning , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[7]  K. Urahama,et al.  Neural algorithms for placement problems , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[8]  J. J. Kosowsky,et al.  Statistical Physics Algorithms That Converge , 1994, Neural Computation.