Global exponential convergence and stability of gradient-based neural network for online matrix inversion

Wang proposed a gradient-based neural network (GNN) to solve online matrix-inverses. Global asymptotical convergence was shown for such a neural network when applied to inverting nonsingular matrices. As compared to the previously-presented asymptotical convergence, this paper investigates more desirable properties of the gradient-based neural network; e.g., global exponential convergence for nonsingular matrix inversion, and global stability even for the singular-matrix case. Illustrative simulation results further demonstrate the theoretical analysis of gradient-based neural network for online matrix inversion.

[1]  Robert H. Sturges,et al.  Analog matrix inversion [robot kinematics] , 1988, IEEE J. Robotics Autom..

[2]  Michael A. Fiddy,et al.  Regularized image reconstruction using SVD and a neural network method for matrix inversion , 1993, IEEE Trans. Signal Process..

[3]  Çetin Kaya Koç,et al.  Inversion of all principal submatrices of a matrix , 1994 .

[4]  Yunong Zhang,et al.  Exploiting Hessian matrix and trust-region algorithm in hyperparameters estimation of Gaussian process , 2005, Appl. Math. Comput..

[5]  Shuzhi Sam Ge,et al.  Design and analysis of a general recurrent neural network model for time-varying matrix inversion , 2005, IEEE Transactions on Neural Networks.

[6]  Jun Wang,et al.  A recurrent neural network for solving Sylvester equation with time-varying coefficients , 2002, IEEE Trans. Neural Networks.

[7]  Soo-Young Lee,et al.  An Optimization Network for Matrix Inversion , 1987, NIPS.

[8]  T. Sarkar,et al.  Survey of numerical methods for solution of large systems of linear equations for electromagnetic field problems , 1981 .

[9]  Hoay Beng Gooi,et al.  New ordering methods for sparse matrix inversion via diagonalization , 1997 .

[10]  L.P. Caloba,et al.  A new algorithm for analog matrix inversion , 1995, 38th Midwest Symposium on Circuits and Systems. Proceedings.

[11]  Jun Wang,et al.  A recurrent neural network for real-time matrix inversion , 1993 .

[12]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[13]  Shuzhi Ge,et al.  A general recurrent neural network model for time-varying matrix inversion , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[14]  Yunong Zhang.  Towards Piecewise-Linear Primal Neural Networks for Optimization and Redundant Robotics , 2006, 2006 IEEE International Conference on Networking, Sensing and Control.

[15]  Yunong Zhang,et al.  A set of nonlinear equations and inequalities arising in robotics and its online solution via a primal neural network , 2006, Neurocomputing.

[16]  Behrouz Fathi Vajargah.  Different stochastic algorithms to obtain matrix inversion , 2007, Appl. Math. Comput..

[17]  Ahmed El-Amawy.  A Systolic Architecture for Fast Dense Matrix Inversion , 1989, IEEE Trans. Computers.

[18]  Jun Wang,et al.  Global exponential stability of recurrent neural networks for synthesizing linear feedback control systems via pole assignment , 2002, IEEE Trans. Neural Networks.

[19]  Ke Chen,et al.  Applied Mathematics and Computation , 2022 .

[20]  Victor-Emil Neagoe,et al.  Inversion of the Van der Monde matrix , 1996, IEEE Signal Processing Letters.

[21]  K. S. Yeung,et al.  Symbolic matrix inversion with application to electronic circuits , 1988 .

[22]  Yunong Zhang,et al.  O(N 2)-Operation Approximation of Covariance Matrix Inverse in Gaussian Process Regression Based on Quasi-Newton BFGS Method , 2007, Commun. Stat. Simul. Comput..

[23]  Yunong Zhang,et al.  Revisit the Analog Computer and Gradient-Based Neural System for Matrix Inversion , 2005, Proceedings of the 2005 IEEE International Symposium on, Mediterrean Conference on Control and Automation Intelligent Control, 2005..

[24]  S. Hakimi,et al.  Analog methods for computation of the generalized inverse , 1968 .

[25]  Yunong Zhang,et al.  Time-series Gaussian Process Regression Based on Toeplitz Computation of O(N2) Operations and O(N)-level Storage , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.