Dynamics in Artificial Higher Order Neural Networks with Delays

AbstrAct This chapter concentrates on studying the dynamics of artificial higher order neural networks (HONNs) with delays. Both stability analysis and periodic oscillation are discussed here for a class of delayed HONNs with (or without) impulses. Most of the sufficient conditions obtained in this chapter are presented in linear matrix inequalities (LMIs), and so can be easily computed and checked in practice using the Matlab LMI Toolbox. In reality, stability is a necessary feature when applying artificial neural networks. Also periodic solution plays an important role in the dynamical behavior of all solutions though other dynamics such as bifurcation and chaos do coexist. So here we mainly focus on questions of the stability and periodic solutions of artificial HONNs with (or without) impulses. Firstly, stability analysis and periodic oscillation are analyzed for higher order bidirectional associative memory (BAM) neural networks without impulses. Secondly, global exponential stability and exponential convergence are studied for a class of impulsive higher order bidirectional associative memory neural networks with time-varying delays. The main methods and tools used in this chapter are linear matrix inequalities (LMIs), Lyapunov stability theory and coincidence degree theory.

[1]  Bingji Xu,et al.  Global asymptotic stability of high-order Hopfield type neural networks with time delays , 2003 .

[2]  Paul McCullagh,et al.  The Use of Artificial Neural Networks for Objective Determination of Hearing Threshold Using the Auditory Brainstem Response , 2006 .

[3]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[4]  Jinde Cao,et al.  Absolute exponential stability of recurrent neural networks with Lipschitz-continuous activation functions and time delays , 2004, Neural Networks.

[5]  Jinde Cao,et al.  LMI-based criteria for stability of high-order neural networks with time-varying delay☆ , 2006 .

[6]  P. Peretto,et al.  Long term memory storage capacity of multiconnected neural networks , 2004, Biological Cybernetics.

[7]  Pierre Baldi,et al.  Neural networks, orientations of the hypercube, and algebraic threshold functions , 1988, IEEE Trans. Inf. Theory.

[8]  Juebang Yu,et al.  Qualitative analysis of Bi‐directional Associative Memory with time delay , 1998 .

[9]  Jinde Cao,et al.  Exponential stability of delayed bi-directional associative memory networks , 2003, Appl. Math. Comput..

[10]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[11]  P.K. Simpson,et al.  Higher-ordered and intraconnected bidirectional associative memories , 1990, IEEE Trans. Syst. Man Cybern..

[12]  Pauline van den Driessche,et al.  Global Attractivity in Delayed Hopfield Neural Network Models , 1998, SIAM J. Appl. Math..

[13]  James Lam,et al.  Neural computation for robust approximate pole assignment , 1999, Neurocomputing.

[14]  Yaser S. Abu-Mostafa,et al.  Information capacity of the Hopfield model , 1985, IEEE Trans. Inf. Theory.

[15]  Shankar M. Krishnan,et al.  Neural Networks in Healthcare: Potential and Challenges , 2006 .

[16]  Jinde Cao,et al.  Exponential stability of high-order bidirectional associative memory neural networks with time delays , 2004 .

[17]  Roberto Pinto,et al.  Neural Network Models for the Estimation of Product Costs: An Application in the Automotive Industry , 2006 .

[18]  Marios M. Polycarpou,et al.  High-order neural network structures for identification of dynamical systems , 1995, IEEE Trans. Neural Networks.

[19]  Jinde Cao,et al.  Periodic solutions for a class of higher-order Cohen-Grossberg type neural networks with delays , 2007, Comput. Math. Appl..

[20]  D. Yue,et al.  Differential inequality with delay and impulse and its applications to design of robust control , 1999 .

[21]  Isabelle Guyon,et al.  High-order neural networks: information storage without errors , 1987 .

[22]  Santosh S. Venkatesh,et al.  The capacity of the Hopfield associative memory , 1987, IEEE Trans. Inf. Theory.

[23]  Lihong Huang,et al.  Existence and global exponential stability of periodic solution to self-connection BAM neural networks with delays , 2004 .

[24]  S. Mohamad.  Global exponential stability in continuous-time and discrete-time delayed bidirectional neural networks , 2001 .

[25]  Belén Gonzalez,et al.  Prediction of the Consistency of Concrete by Means of the Use of Artificial Neural Networks , 2006 .

[26]  Jinde Cao,et al.  On stability of delayed cellular neural networks , 1999 .

[27]  R. Sarker,et al.  Artificial Neural Networks in Finance and Manufacturing , 2006 .

[28]  Jinde Cao,et al.  Globally exponential stability conditions for cellular neural networks with time-varying delays , 2002, Appl. Math. Comput..

[30]  Jinde Cao,et al.  Novel Stability Criteria for Delayed Cellular Neural Networks , 2003, Int. J. Neural Syst..

[31]  Jinde Cao,et al.  Periodic oscillation of higher-order bidirectional associative memory neural networks with periodic coefficients and delays , 2007 .

[32]  R. Westervelt,et al.  Stability of analog neural networks with delay. , 1989, Physical review. A, General physics.

[33]  A. Dembo,et al.  High-order absolutely stable neural networks , 1991 .

[34]  Jinde Cao,et al.  Estimation on Domain of Attraction and Convergence Rate of Hopfield Continuous Feedback Neural Networks , 2001, J. Comput. Syst. Sci..

[35]  Jinde Cao,et al.  Exponential stability and periodic oscillatory solution in BAM networks with delays , 2002, IEEE Trans. Neural Networks.

[36]  Jinde Cao,et al.  Periodic bidirectional associative memory neural networks with distributed delays , 2006 .

[37]  Jinde Cao,et al.  Exponential stability of BAM neural networks with transmission delays , 2004, Neurocomputing.

[38]  Jinde Cao,et al.  Global exponential stability of Hopfield neural networks , 2001, Int. J. Syst. Sci..

[39]  Demetri Psaltis,et al.  Higher order associative memories and their optical implementations , 1988, Neural Networks.

[40]  Manolis A. Christodoulou,et al.  Structural properties of gradient recurrent high-order neural networks , 1995 .

[41]  Jinde Cao,et al.  Global asymptotic stability of delayed bi-directional associative memory neural networks , 2003, Appl. Math. Comput..