A New Method to Analyze Complete stability of PWL Cellular Neural Networks

In recent years, the standard Cellular Neural Networks (CNN's) introduced by Chua and Yang [1988] have been one of the most investigated paradigms for neural information processing. In a wide range of applications, the CNN's are required to be completely stable, i.e. each trajectory should converge toward some stationary state. However, a rigorous proof of complete stability, even in the simplest original setting of piecewise-linear (PWL) neuron activations and symmetric interconnections [Chua & Yang, 1988], is still lacking. This paper aims primarily at filling this gap, in order to give a sound analytical foundation to the CNN paradigm. To this end, a novel approach for studying complete stability is proposed. This is based on a fundamental limit theorem for the length of the CNN trajectories. The method differs substantially from the classic approach using LaSalle invariance principle, and permits to overcome difficulties encountered when using LaSalle approach to analyze complete stability of PWL CNN's. The main result obtained, is that a symmetric PWL CNN is completely stable for any choice of the network parameters, i.e. it possesses the Absolute Stability property of global pattern formation. This result is really general and shows that complete stability holds under hypotheses weaker than those considered in [Chua & Yang, 1988]. The result does not require, for example, that the CNN has binary stable equilibrium points only. It is valid even in degenerate situations where the CNN has infinite nonisolated equilibrium points. These features significantly extend the potential application fields of the standard CNN's.

[1]  Leon O. Chua,et al.  On the universe of stable cellular neural networks , 1992, Int. J. Circuit Theory Appl..

[2]  A. Michel Recent trends in the stability analysis of hybrid dynamical systems , 1999 .

[3]  R. A. Silverman,et al.  Introductory Real Analysis , 1972 .

[4]  J. Hale,et al.  Ordinary Differential Equations , 2019, Fundamentals of Numerical Mathematics for Physicists and Engineers.

[5]  G.S. Moschytz,et al.  An analysis of CNN settling time , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[6]  M. DI MARCO,et al.  Bifurcations and oscillatory Behavior in a Class of Competitive Cellular Neural Networks , 2000, Int. J. Bifurc. Chaos.

[7]  M. Hirsch The dynamical systems approach to differential equations , 1984 .

[8]  P. Thiran,et al.  An approach to information propagation in 1-D cellular neural networks. II. Global propagation , 1998 .

[9]  F. Zou,et al.  Bifurcation and chaos in cellular neural networks , 1993 .

[10]  A. Tesi,et al.  New conditions for global stability of neural networks with application to linear and quadratic programming problems , 1995 .

[11]  N. G. Parke,et al.  Ordinary Differential Equations. , 1958 .

[12]  Morris W. Hirsch,et al.  Convergent activation dynamics in continuous time networks , 1989, Neural Networks.

[13]  Leon O. Chua,et al.  Pyramidal cells: a novel class of adaptive coupling cells and their applications for cellular neural networks , 1998 .

[14]  M. Forti On Global Asymptotic Stability of a Class of Nonlinear Systems Arising in Neural Network Theory , 1994 .

[15]  Romano Fantacci,et al.  Cellular neural network approach to a class of communication problems , 1999 .

[16]  L. Chua,et al.  A more rigorous proof of complete stability of cellular neural networks , 1997 .

[17]  George S. Moschytz,et al.  An analysis of CNN settling time , 2000 .

[18]  A. Michel,et al.  Analysis and synthesis of a class of neural networks: linear systems operating on a closed hypercube , 1989 .

[19]  Chih-Wen Shih,et al.  Complete Stability for Standard Cellular Neural Networks , 1999 .

[20]  Leon O. Chua,et al.  UNIVERSAL CNN CELLS , 1999 .

[21]  Charles R. Johnson The Theory of Matrices. Second Edition (with Applications) (Peter Lancaster and Miron Tismenetsky) , 1987 .

[22]  L. Pandolfi,et al.  On stability of cellular neural networks with delay , 1993 .

[23]  Leon O. Chua,et al.  CNN: A Vision of Complexity , 1997 .

[24]  M. Branicky Multiple Lyapunov functions and other analysis tools for switched and hybrid systems , 1998, IEEE Trans. Autom. Control..

[25]  J. Palis,et al.  Geometric theory of dynamical systems , 1982 .

[26]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[27]  Wolfgang Porod,et al.  Qualitative analysis and synthesis of a class of neural networks , 1988 .

[29]  Stephen Grossberg,et al.  Nonlinear neural networks: Principles, mechanisms, and architectures , 1988, Neural Networks.

[30]  Patrick Thiran,et al.  An approach to information propagation in cellular neural networks - Part I : Local diffusion , 1998 .