Hopfield neural network: The hyperbolic tangent and the piecewise-linear activation functions

This paper reports two-dimensional parameter-space plots for both, the hyperbolic tangent and the piecewise-linear neuron activation functions of a three-dimensional Hopfield neural network. The plots obtained using both neuron activation functions are compared, and we show that similar features are present on them. The occurrence of self-organized periodic structures embedded in chaotic regions is verified for the two cases.

[1]  S. Wiggins.  Introduction to Applied Nonlinear Dynamical Systems and Chaos , 1989 .

[2]  Paulo C. Rech.  Self-Similarities and Period-Adding in the Parameter-Space of a Nonlinear Resonant Coupling Process , 2010 .

[3]  Paulo C. Rech,et al.  Spiral periodic structure inside chaotic region in parameter-space of a Chua circuit , 2012, Int. J. Circuit Theory Appl..

[4]  Ruedi Stoop,et al.  Real-world existence and origins of the spiral organization of shrimp-shaped domains. , 2010, Physical review letters.

[5]  Paulo C. Rech,et al.  Self-similar structures in a 2D parameter-space of an inductorless Chua's circuit , 2008 .

[6]  唐万生,et al.  A new chaotic Hopfield network with piecewise linear activation function , 2010 .

[7]  Paulo C. Rech,et al.  Some two-dimensional parameter spaces of a Chua system with cubic nonlinearity. , 2010, Chaos.

[8]  J. G. Freire,et al.  Non-Shilnikov cascades of spikes and hubs in a semiconductor laser with optoelectronic feedback. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Jason A. C. Gallas,et al.  The Structure of Infinite Periodic and Chaotic Hub Cascades in Phase Diagrams of Simple Autonomous Flows , 2010, Int. J. Bifurc. Chaos.

[11]  Yan Huang,et al.  Chaos, bifurcation and Robustness of a Class of Hopfield Neural Networks , 2011, Int. J. Bifurc. Chaos.

[12]  J. Gallas,et al.  Periodicity hub and nested spirals in the phase diagram of a simple resistive circuit. , 2008, Physical review letters.

[13]  Tommy W. S. Chow,et al.  Neurocomputing Research Developments , 2007 .