A Unified Constructive Network Model for Problem-Solving

Abstract We develop a neural network model that relieves time-consuming trial-and-error computer experiments usually performed in problem-solving with networks where problems, including the traveling salesman problem, pattern matching and pattern classification/learning, are formulated as optimization problems with constraint. First, we specify and uniquely distinguish the model as a set of constituent functions that should comply with restrictive conditions. Next, we demonstrate that it is unified, i.e., it yields most current networks. Finally, we verify that it is constructive, i.e. we show a standard method that systematically constructs from a given optimization problem a particular network in that model to solve it.

[1]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[2]  Alan L. Yuille,et al.  Generalized Deformable Models, Statistical Physics, and Matching Problems , 1990, Neural Computation.

[3]  Richard Durbin,et al.  An analogue approach to the travelling salesman problem using an elastic net method , 1987, Nature.

[4]  E. Coddington,et al.  Theory of Ordinary Differential Equations , 1955 .

[5]  Marc M. Van Hulle,et al.  Representation and processing in a stochastic neural network: An integrated approach , 1991, Neural Networks.

[6]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[7]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[8]  M. Hirsch,et al.  Differential Equations, Dynamical Systems, and Linear Algebra , 1974 .

[9]  Richard Szeliski,et al.  An Analysis of the Elastic Net Approach to the Traveling Salesman Problem , 1989, Neural Computation.

[11]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[13]  Petar D. Simic,et al.  Statistical mechanics as the underlying theory of ‘elastic’ and ‘neural’ optimisations , 1990 .