An Annealed Chaotic Maximum Neural Network For Bipartite Subgraph Problem

In this paper, based on maximum neural network, we propose a new parallel algorithm that can help the maximum neural network escape from local minima by including a transient chaotic neurodynamics for bipartite subgraph problem. The goal of the bipartite subgraph problem, which is an NP- complete problem, is to remove the minimum number of edges in a given graph such that the remaining graph is a bipartite graph. Lee et al. presented a parallel algorithm using the maximum neural model (winner-take-all neuron model) for this NP- complete problem. The maximum neural model always guarantees a valid solution and greatly reduces the search space without a burden on the parameter-tuning. However, the model has a tendency to converge to a local minimum easily because it is based on the steepest descent method. By adding a negative self-feedback to the maximum neural network, we proposed a new parallel algorithm that introduces richer and more flexible chaotic dynamics and can prevent the network from getting stuck at local minima. After the chaotic dynamics vanishes, the proposed algorithm is then fundamentally reined by the gradient descent dynamics and usually converges to a stable equilibrium point. The proposed algorithm has the advantages of both the maximum neural network and the chaotic neurodynamics. A large number of instances have been simulated to verify the proposed algorithm. The simulation results show that our algorithm finds the optimum or near-optimum solution for the bipartite subgraph problem superior to that of the best existing parallel algorithms.

[1]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[2]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[3]  T. Yamada,et al.  Chaotic neural networks and the traveling salesman problem , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[4]  Kazuyuki Aihara,et al.  Associative Dynamics in a Chaotic Neural Network , 1997, Neural Networks.

[5]  Hiroshi Nozawa,et al.  A neural network model as a globally coupled map and applications based on chaos. , 1992, Chaos.

[6]  David S. Johnson,et al.  Some Simplified NP-Complete Graph Problems , 1976, Theor. Comput. Sci..

[7]  F. Barahona On some weakly bipartite graphs , 1983 .

[8]  Lipo Wang,et al.  Solving Optimization Problems Using Transiently Chaotic Neural Networks : Choices of Network Parameters , 2002 .

[9]  Teruo Higashino,et al.  A Proposal of Neuron Filter: A Constraint Resolution Scheme of Neural Networks for Combinatorial Optimization Problems , 2000 .

[10]  Martin Grötschel,et al.  Weakly bipartite graphs and the Max-cut problem , 1981, Oper. Res. Lett..

[11]  S. Nara Can potentially useful dynamics to solve complex problems emerge from constrained chaos and/or chaotic itinerancy? , 2003, Chaos.

[12]  Zheng Tang,et al.  A Near-Optimum Parallel Algorithm for Bipartite Subgraph Problem Using the Hopfield Neural Network Learning , 2002, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[13]  Cecilia R. Aragon,et al.  Optimization by Simulated Annealing: An Experimental Evaluation; Part I, Graph Partitioning , 1989, Oper. Res..

[14]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[15]  Kazuyuki Aihara,et al.  Chaotic simulated annealing by a neural network model with transient chaos , 1995, Neural Networks.

[16]  J. Hopfield,et al.  Computing with neural circuits: a model. , 1986, Science.

[17]  P. Davis,et al.  Chaotic wandering and search in a cycle-memory neural network , 1992 .

[18]  Richard M. Karp,et al.  Reducibility among combinatorial problems" in complexity of computer computations , 1972 .

[19]  K. Aihara,et al.  Chaotic neural networks , 1990 .

[20]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[21]  N. Sakimura Multi Delta-Sigma Architectures with Two-Level Feedback Loop Using a Dual-Quantization Architecture , 2001 .

[22]  Kazuyuki Aihara,et al.  A novel chaotic search for quadratic assignment problems , 2002, Eur. J. Oper. Res..

[23]  Kazuyuki Aihara,et al.  Global searching ability of chaotic neural networks , 1999 .

[24]  José Muñoz-Pérez,et al.  Design and analysis of maximum Hopfield networks , 2001, IEEE Trans. Neural Networks.

[25]  S. C. Locke,et al.  Largest bipartite subgraphs in triangle-free graphs with maximum degree three , 1986 .

[26]  Yoshiyasu Takefuji,et al.  A parallel improvement algorithm for the bipartite subgraph problem , 1992, IEEE Trans. Neural Networks.

[27]  Yoshiyasu Takefuji,et al.  An artificial maximum neural network: a winner-take-all neuron model forcing the state of the system in a solution domain , 2004, Biological Cybernetics.

[28]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[29]  Yoshiyasu Takefuji,et al.  A New Self-Organization Classification Algorithm for Remote-Sensing Images , 1998 .

[30]  Kate Smith-Miles,et al.  On chaotic simulated annealing , 1998, IEEE Trans. Neural Networks.

[31]  Kate Smith-Miles,et al.  Experimental analysis of chaotic neural network models for combinatorial optimization under a unifying framework , 2000, Neural Networks.

[32]  K. Aihara,et al.  Chaos and asymptotical stability in discrete-time neural networks , 1997, chao-dyn/9701020.

[33]  M. Inoue,et al.  A chaos neuro-computer , 1991 .

[34]  Kazuyuki Aihara,et al.  Combination of Chaotic Neurodynamics with the 2-opt Algorithm to Solve Traveling Salesman Problems , 1997 .