A unified framework for chaotic neural-network approaches to combinatorial optimization

As an attempt to provide an organized way to study the chaotic structures and their effects in solving combinatorial optimization with chaotic neural networks (CNN's), a unifying framework is proposed to serve as a basis where the existing CNN models can be placed and compared. The key of this proposed framework is the introduction of an extra energy term into the computational energy of the Hopfield model, which takes on different forms for different CNN models, and modifies the original Hopfield energy landscape in various manners. Three CNN models, namely the Chen and Aihara model with self-feedback chaotic simulated annealing (CSA), the Wang and Smith model with timestep CSA, and the chaotic noise model, are chosen as examples to show how they can be classified and compared within the proposed framework.

[1]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Kazuyuki Aihara,et al.  Solving combinatorial optimization problems by nonlinear neural dynamics , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[3]  K. Aihara,et al.  Chaos and asymptotical stability in discrete-time neural networks , 1997, chao-dyn/9701020.

[4]  K. Aihara,et al.  Chaotic neural networks , 1990 .

[5]  Timothy X. Brown,et al.  Competitive neural architecture for hardware solution to the assignment problem , 1991, Neural Networks.

[6]  Hiroshi Nozawa,et al.  A neural network model as a globally coupled map and applications based on chaos. , 1992, Chaos.

[7]  Andrew Howard Gee,et al.  Problem solving with optimization networks , 1993 .

[8]  Hayakawa,et al.  Effects of the chaotic noise on the performance of a neural network model for optimization problems. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[9]  Kazuyuki Aihara,et al.  Global bifurcation structure of chaotic neural networks and its application to traveling salesman problems , 1995, Neural Networks.

[10]  Kazuyuki Aihara,et al.  Chaotic simulated annealing by a neural network model with transient chaos , 1995, Neural Networks.

[11]  Kazuyuki Aihara,et al.  Adaptive annealing for chaotic optimization , 1996 .

[12]  Diwei Zhou,et al.  A Method to Combine Chaos and Neural Network Based on the Fixed Point Theory , 1997 .

[13]  Hideki Asai,et al.  A study of Hopfield neural networks with external noises , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[14]  Kate A. Smith,et al.  Solving Combinatorial Optimization Problems by Chaotic Neural Networks , 1998 .

[15]  Kate Smith-Miles,et al.  On chaotic simulated annealing , 1998, IEEE Trans. Neural Networks.

[16]  T. Yamada,et al.  Chaotic neural networks and the traveling salesman problem , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[17]  Kazuyuki Aihara,et al.  An Analysis on Additive Effects of Nonlinear Dynamics for Combinatorial Optimization , 1997 .