Chaotic dynamics of supervised neural network

It is important to study the neural network (NN) when it falls into chaos, because brain dynamics involve chaos. In this paper, the several chaotic behaviors of supervised neural networks using Hurst Exponent (H), fractal dimension (FD) and bifurcation diagram are studied. The update rule for NN trained with back-propagation (BP) algorithm absorbs the function of the form x(1-x) which is responsible for exhibiting chaos in the output of the NN at increased learning rate. The H is computed with the time series obtained from the output of NN. One can comment on the classification of the network from the values of Hs. The chaotic dynamics for two bit parity, cancer, and diabetes problems are examined. The result is validated with the help of bifurcation diagram. It is found that the values of H are repositioned marginally depending on the size of NN. The effect of the size of NN on chaos is also investigated.

[1]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[2]  F. Wolf,et al.  Extensive chaotic dynamics in neural networks in the balanced state , 2009, BMC Neuroscience.

[3]  Shigetoshi Nara,et al.  Numerically evaluated functional equivalence between chaotic dynamics in neural networks and cellular automata under totalistic rules , 2007, Cognitive Neurodynamics.

[4]  W. Freeman,et al.  How brains make chaos in order to make sense of the world , 1987, Behavioral and Brain Sciences.

[5]  Stamatis Vassiliadis,et al.  XOR and backpropagation learning: in and out of the chaos? , 1995, ESANN.

[6]  Hiroshi Nozawa,et al.  A neural network model as a globally coupled map and applications based on chaos. , 1992, Chaos.

[7]  Meir,et al.  Chaotic behavior of a layered neural network. , 1988, Physical review. A, General physics.

[8]  L. Olsen,et al.  Chaos in biological systems , 1985, Quarterly Reviews of Biophysics.

[9]  K. Aihara,et al.  Chaotic neural networks , 1990 .

[10]  A. Babloyantz,et al.  Evidence of Chaotic Dynamics of Brain Activity During the Sleep Cycle , 1985 .

[11]  Willi-Hans Steeb,et al.  The Nonlinear Workbook: Chaos, Fractals, Celluar Automata, Neural Networks, Genetic Algorithms, Gene Expression Programming, Support Vector Machine, Wavelets, Hiddn Markov Mo , 2005 .

[12]  Marius Usher,et al.  Chaotic Behavior of A Neural Network with Dynamical Thresholds , 1991, Int. J. Neural Syst..

[13]  L. Olsen,et al.  Chaos in biological systems. , 1985 .

[14]  Kazuyuki Aihara,et al.  Chaotic simulated annealing by a neural network model with transient chaos , 1995, Neural Networks.

[15]  J. Glanz,et al.  Mastering the Nonlinear Brain , 1997, Science.