Associative memories based on continuous-time cellular neural networks designed using space-invariant cloning templates

Associative memories are brain-style devices designed to store a set of patterns as stable equilibria such that the stored patterns can be reliably retrieved with the initial probes containing sufficient information about the patterns. This paper presents a new design procedure for synthesizing associative memories based on continuous-time cellular neural networks with time delays characterized by input and output matrices obtained using two-dimensional space-invariant cloning templates. The design procedure enables hetero-associative or auto-associative memories to be synthesized by solving a set of linear inequalities with few design parameters and retrieval probes feeding from external inputs instead of initial states. The designed associative memories are robust in terms of design parameter selection. In addition, the hosting cellular neural networks are guaranteed to be globally exponentially stable. Simulation and experimental results of illustrative examples and Monte Carlo tests demonstrate the applicability and superiority of the methodology.

[1]  Derong Liu,et al.  A new synthesis procedure for a class of cellular neural networks with space-invariant cloning template , 1998 .

[2]  G. Grassi,et al.  A new approach to design cellular neural networks for associative memories , 1997 .

[3]  Zhigang Zeng,et al.  Stability analysis of delayed cellular neural networks described using cloning templates , 2004, IEEE Trans. Circuits Syst. I Regul. Pap..

[4]  Zhigang Zeng,et al.  Design and Analysis of High-Capacity Associative Memories Based on a Class of Discrete-Time Recurrent Neural Networks , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Derong Liu,et al.  Cloning template design of cellular neural networks for associative memories , 1997 .

[6]  Zhigang Zeng,et al.  Analysis and synthesis of associative memories based on Brain-State-in-a-Box neural networks , 2009, 2009 International Joint Conference on Neural Networks.

[7]  M. Brucoli,et al.  Discrete-time cellular neural networks for associative memories with learning and forgetting capabilities , 1995 .

[8]  Derong Liu,et al.  Sparsely interconnected neural networks for associative memories with applications to cellular neural networks , 1994 .

[9]  Gary G. Yen,et al.  A learning and forgetting algorithm in associative memories: the eigenstructure method , 1992 .

[10]  Anthony N. Michel,et al.  A learning and forgetting algorithm in associative memories: results involving pseudo-inverses , 1991 .

[11]  Derong Liu,et al.  A new synthesis approach for feedback neural networks based on the perceptron training algorithm , 1997, IEEE Trans. Neural Networks.

[12]  Zhigang Zeng,et al.  Analysis and Design of Associative Memories Based on Recurrent Neural Networks with Linear Saturation Activation Functions and Time-Varying Delays , 2007, Neural Computation.

[13]  Shu-Cherng Fang,et al.  Linear Optimization and Extensions: Theory and Algorithms , 1993 .

[14]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[15]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[16]  G. Grassi,et al.  On discrete-time cellular neural networks for associative memories , 2001 .