2005 Special Issue: Non-homogenous neural networks with chaotic recursive nodes: Connectivity and multi-assemblies structures in recursive processing elements architectures

This paper addresses recurrent neural architectures based on bifurcating nodes that exhibit chaotic dynamics, with local dynamics defined by first order parametric recursions. In the studied architectures, logistic recursive nodes interact through parametric coupling, they self organize, and the network evolves to global spatio-temporal period-2 attractors that encode stored patterns. The performance of associative memories arrangements is measured through the average error in pattern recovery, under several levels of prompting noise. The impact of the synaptic connections magnitude on architecture performance is analyzed in detail, through pattern recovery performance measures and basin of attraction characterization. The importance of a planned choice of the synaptic connections scale in RPEs architectures is shown. A strategy for minimizing pattern recovery degradation when the number of stored patterns increases is developed. Experimental results show the success of such strategy. Mechanisms for allowing the studied associative networks to deal with asynchronous changes in input patterns, and tools for the interconnection between different associative assemblies are developed. Finally, coupling in heterogeneous assemblies with diverse recursive maps is analyzed, and the associated synaptic connections are equated.

[1]  Emilio Del Moral Hernandez,et al.  Studying Neural Networks of Bifurcating Recursive Processing Elements - Quantitative Methods for Architecture Design and Performance Analysis , 2001 .

[2]  E. Del Moral Hernandez.  Non-homogenous structures in neural networks with chaotic recursive nodes: dealing with diverse multi-assemblies architectures, connectivity and arbitrary bifurcating nodes , 2005 .

[3]  Robert Kozma,et al.  Encoding and recall of noisy data as chaotic spatio-temporal memory patterns in the style of the brains , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[4]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[5]  Kunihiko Kaneko,et al.  Complex Systems: Chaos and Beyond: A Constructive Approach with Applications in Life Sciences , 2000 .

[6]  E. Del Moral Hernandez,et al.  A new hybrid neural architecture (MLP+RPE) for hetero association: multi layer perceptron and coupled recursive processing elements neural networks , 2004 .

[7]  Robert C. Hilborn,et al.  Chaos And Nonlinear Dynamics: An Introduction for Scientists and Engineers , 1994 .

[8]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Santosh S. Venkatesh,et al.  The capacity of the Hopfield associative memory , 1987, IEEE Trans. Inf. Theory.

[10]  N. Farhat,et al.  Analog realization of arbitrary one-dimensional maps , 2003 .

[11]  Emilio Del-Moral-Hernandez,et al.  Neural networks with chaotic recursive nodes: techniques for the design of associative memories, contrast with Hopfield architectures, and extensions for time-dependent inputs , 2003, Neural Networks.

[12]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[13]  Lipo Wang.  Heteroassociations of spatio-temporal sequences with the bidirectional associative memory , 2000, IEEE Trans. Neural Networks Learn. Syst..

[14]  Emilio Del Moral Hernandez.  Artificial neural networks based on bifurcating recursive processing elements , 1998 .

[15]  DeLiang Wang.  A comparison of CNN and LEGION networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[16]  Walter J. Freeman,et al.  TUTORIAL ON NEUROBIOLOGY: FROM SINGLE NEURONS TO BRAIN CHAOS , 1992 .

[17]  John G. Harris,et al.  Design and implementation of a biologically realistic olfactory cortex in analog VLSI , 2001, Proc. IEEE.