Noisy chaotic neural networks for solving combinatorial optimization problems

Chaotic simulated annealing (CSA) recently proposed by Chen and Aihara (1994) has been shown to have higher searching ability for solving combinatorial optimization problems compared to both the Hopfield-Tank approach and stochastic simulated annealing (SSA). However, CSA is not guaranteed to relax to a globally optimal solution no matter how slowly annealing takes place. In contrast, SSA is guaranteed to settle down to a global minimum with probability 1 if the temperature is reduced sufficiently slowly. In this paper, we attempt to combine the best of both worlds by proposing a new approach to simulated annealing using a noisy chaotic neural network, i.e., stochastic chaotic simulated annealing (SCSA). We demonstrate this approach with the 48-city traveling salesman problem.

[1]  Kazuyuki Aihara,et al.  Chaotic simulated annealing by a neural network model with transient chaos , 1995, Neural Networks.

[2]  Kate A. Smith,et al.  Incorporating Choas into the Hopfield Neural Network for Combinatorial Optimisation , 1998 .

[3]  Kate A. Smith,et al.  Solving Combinatorial Optimization Problems by Chaotic Neural Networks , 1998 .

[4]  Kazuyuki Aihara,et al.  Global searching ability of chaotic neural networks , 1999 .

[5]  W. Freeman,et al.  How brains make chaos in order to make sense of the world , 1987, Behavioral and Brain Sciences.

[6]  Kate Smith-Miles,et al.  On chaotic simulated annealing , 1998, IEEE Trans. Neural Networks.

[7]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[8]  H. Nozawa,et al.  Solution of the optimization problem using the neural network model as a globally coupled map , 1994 .

[9]  L. Wang,et al.  Oscillations and chaos in neural networks: an exactly solvable model. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[10]  K. Aihara,et al.  Chaotic neural networks , 1990 .

[11]  Kate A. Smith,et al.  Chaos in the discretized analog Hopfield neural network and potential applications to optimization , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[12]  Lipo Wang,et al.  Artificial neural networks - oscillations, chaos, and sequence processing , 1993 .

[13]  Hiroshi Nozawa,et al.  A neural network model as a globally coupled map and applications based on chaos. , 1992, Chaos.

[14]  Gerhard Reinelt,et al.  TSPLIB - A Traveling Salesman Problem Library , 1991, INFORMS J. Comput..

[15]  Lipo Wang,et al.  Oscillatory and chaotic dynamics in neural networks under varying operating conditions , 1996, IEEE Trans. Neural Networks.

[16]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[17]  Lipo Wang,et al.  Solving Optimization Problems Using Transiently Chaotic Neural Networks : Choices of Network Parameters , 2002 .

[18]  DeLiang Wang,et al.  Incremental learning of complex temporal patterns , 1996, IEEE Trans. Neural Networks.

[19]  Nikola Kasabov,et al.  Combining neuro-fuzzy and chaos methods for intelligent time series analysis-case study of heart rate variability , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.