Different Zhang functions leading to various ZNN models illustrated via solving the time-varying overdetermined system of linear equations

Since 2001, a special class of recurrent neural network (RNN), termed Zhang neural network (ZNN), has been proposed, generalized and investigated for solving time-varying problems by following Zhang et al.'s design method. In the procedure of constructing ZNN models, designing a suitable error function [i.e., the so-called Zhang function (ZF) used in the methodology] plays an important role, as different ZFs lead to various ZNN models. Besides, differing from other error functions, e.g., the nonnegative energy function associated with the conventional gradient-based neural network (GNN), ZF is indefinite which means that such a ZF can be positive, zero, negative, bounded, or unbounded, even lower-unbounded. In this paper, two different main ZNN models are designed, constructed and investigated to solve the problem of time-varying overdetermined system of linear equations (TVOSLE) by exploiting different ZFs. Computer-simulation results substantiate the effectiveness of the two main ZNN models for solving such a time-varying problem.

[1]  Pagavathigounder Balasubramaniam,et al.  LMI Conditions for Robust Stability Analysis of Stochastic Hopfield Neural Networks with Interval Time-Varying Delays and Linear Fractional Uncertainties , 2011, Circuits Syst. Signal Process..

[2]  Abhishek K Gupta,et al.  Numerical Methods using MATLAB , 2014, Apress.

[3]  Jun Wang,et al.  Recurrent Neural Networks for Computing Pseudoinverses of Rank-Deficient Matrices , 1997, SIAM J. Sci. Comput..

[4]  Wonpil Im,et al.  Explicit treatment of force contribution from alignment tensor using overdetermined linear equations and its application in NMR structure determination , 2007, J. Comput. Chem..

[5]  Yunong Zhang,et al.  Robustness analysis of the Zhang neural network for online time-varying quadratic optimization , 2010 .

[6]  Ning Tan,et al.  Zhang neural network solving for time-varying full-rank matrix Moore–Penrose inverse , 2010, Computing.

[7]  M. Brannigan The strict Chebyshev solution of overdetermined systems of linear equations with rank deficient matrix , 1982 .

[8]  Yunong Zhang,et al.  Improved Zhang neural network model and its solution of time-varying generalized linear matrix equations , 2010, Expert Syst. Appl..

[9]  Peng Xu,et al.  Time-varying square roots finding via Zhang dynamics versus gradient dynamics and the former's link and new explanation to Newton-Raphson iteration , 2010, Inf. Process. Lett..

[10]  Shuzhi Sam Ge,et al.  Design and analysis of a general recurrent neural network model for time-varying matrix inversion , 2005, IEEE Transactions on Neural Networks.

[11]  James A. Cadzow Minimum l1, l2, and l∞ Norm Approximate Solutions to an Overdetermined System of Linear Equations , 2002, Digit. Signal Process..

[12]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[13]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[14]  Lei Zhang,et al.  Accurate Solution to Overdetermined Linear Equations with Errors Using L1 Norm Minimization , 2000, Comput. Optim. Appl..