Experimental analysis of chaotic neural network models for combinatorial optimization under a unifying framework

The aim of this paper is to study both the theoretical and experimental properties of chaotic neural network (CNN) models for solving combinatorial optimization problems. Previously we have proposed a unifying framework which encompasses the three main model types, namely, Chen and Aihara's chaotic simulated annealing (CSA) with decaying self-coupling, Wang and Smith's CSA with decaying timestep, and the Hopfield network with chaotic noise. Each of these models can be represented as a special case under the framework for certain conditions. This paper combines the framework with experimental results to provide new insights into the effect of the chaotic neurodynamics of each model. By solving the N-queen problem of various sizes with computer simulations, the CNN models are compared in different parameter spaces, with optimization performance measured in terms of feasibility, efficiency, robustness and scalability. Furthermore, characteristic chaotic neurodynamics crucial to effective optimization are identified, together with a guide to choosing the corresponding model parameters.

[1]  Diwei Zhou,et al.  A Method to Combine Chaos and Neural Network Based on the Fixed Point Theory , 1997 .

[2]  K. Aihara,et al.  Chaotic neural networks , 1990 .

[3]  Hayakawa,et al.  Effects of the chaotic noise on the performance of a neural network model for optimization problems. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[4]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Hiroshi Nozawa,et al.  A neural network model as a globally coupled map and applications based on chaos. , 1992, Chaos.

[6]  Kate Smith-Miles,et al.  A unified framework for chaotic neural-network approaches to combinatorial optimization , 1999, IEEE Trans. Neural Networks.

[7]  Kate A. Smith,et al.  Solving Combinatorial Optimization Problems by Chaotic Neural Networks , 1998 .

[8]  Kate Smith-Miles,et al.  On chaotic simulated annealing , 1998, IEEE Trans. Neural Networks.

[9]  Kazuyuki Aihara,et al.  Chaotic simulated annealing by a neural network model with transient chaos , 1995, Neural Networks.

[10]  Kazuyuki Aihara,et al.  Adaptive annealing for chaotic optimization , 1996 .

[11]  Y. Akiyama,et al.  Combinatorial optimization with Gaussian machines , 1989, International 1989 Joint Conference on Neural Networks.

[12]  Kazuyuki Aihara,et al.  Combination of Chaotic Neurodynamics with the 2-opt Algorithm to Solve Traveling Salesman Problems , 1997 .

[13]  Kazuyuki Aihara,et al.  Global bifurcation structure of chaotic neural networks and its application to traveling salesman problems , 1995, Neural Networks.

[14]  Kurt Wiesenfeld,et al.  Minireview of stochastic resonance. , 1998, Chaos.

[15]  Y. Takefuji,et al.  Design of parallel distributed Cauchy machines , 1989, International 1989 Joint Conference on Neural Networks.

[16]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[17]  Kazuyuki Aihara,et al.  An Analysis on Additive Effects of Nonlinear Dynamics for Combinatorial Optimization , 1997 .

[18]  K. Aihara,et al.  Chaos and asymptotical stability in discrete-time neural networks , 1997, chao-dyn/9701020.