Design and Analysis of a Novel Finite-Time Convergent and Noise-Tolerant Recurrent Neural Network for Time-Variant Matrix Inversion

Matrix inversion ubiquitously arises in engineering. The so-called zeroing neural network (ZNN) is an effective recurrent neural network for solving time-variant matrix inversion. Without considering noises, the ZNN approach requires finite time or infinitely long time to converge to the exact solution. When perturbed by additive noises, the existing ZNN models exhibit limited ability to reject disturbances and are susceptible to be divergent. For instance, under time-variant bounded noises, steady-state residual errors of the existing ZNNs would be bounded. To make the steady-state residual errors arbitrarily small, infinitely long time is required and related design parameters must be set large enough or infinitely large, which is not realistic in practice. To overcome this situation, this paper for the first time systematically designs and analyses a finite-time convergent and noise-tolerant ZNN (FTNTZNN) that is capable of completely converging to the theoretical solution in finite time even under various types of noises. Theoretically, the finite-time convergence and disturbance-rejection properties of the FTNTZNN are rigorously proved. Comparative numerical results substantiate that the FTNTZNN model delivers superior convergence and robustness performance in solving time-variant matrix inversion and kinematic control of a robotic arm as compared with the existing ZNN models. The FTNTZNN model expands the current knowledge for designing neural-dynamic systems to solve matrix inversion, which can provide inspiration for other problems solving under noises.

[1]  Yunong Zhang,et al.  Finite-time convergence analysis and verification of improved ZNN for real-time matrix inversion , 2014, 2014 4th IEEE International Conference on Information Science and Technology.

[2]  Zhang Yi,et al.  Convergence Analysis of Recurrent Neural Networks , 2003, Network Theory and Applications.

[3]  Naohiro Ishii,et al.  Analog Neural Circuit and Hardware Design of Deep Learning Model , 2015, KES.

[4]  Mohd. Samar Ansari,et al.  Voltage-Mode Neural Network for the Solution of Linear Equations , 2014 .

[5]  Dongsheng Guo,et al.  Novel Discrete-Time Zhang Neural Network for Time-Varying Matrix Inversion , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[6]  MengChu Zhou,et al.  Modified Primal-Dual Neural Networks for Motion Control of Redundant Manipulators With Dynamic Rejection of Harmonic Noises , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Y. N. Bapat,et al.  Electronic circuits and systems: analog and digital , 1992 .

[8]  Shuai Li,et al.  Design and Analysis of FTZNN Applied to the Real-Time Solution of a Nonstationary Lyapunov Equation and Tracking Control of a Wheeled Mobile Manipulator , 2018, IEEE Transactions on Industrial Informatics.

[9]  Shuai Li,et al.  Accelerating a Recurrent Neural Network to Finite-Time Convergence for Solving Time-Varying Sylvester Equation by Using a Sign-Bi-power Activation Function , 2012, Neural Processing Letters.

[10]  Jun Wang,et al.  A recurrent neural network for real-time matrix inversion , 1993 .

[11]  Yunong Zhang,et al.  Zhang Neural Networks and Neural-Dynamic Method , 2011 .

[12]  Yosuke Yamashita,et al.  A Neuron Circuit Model with Smooth Nonlinear Output Function , 2007 .

[13]  Prem Kumar Kalra,et al.  Modified Hopfield Neural Network Approach for Solving Nonlinear Algebraic Equations , 2007, Eng. Lett..

[14]  Weibing Li,et al.  A Recurrent Neural Network With Explicitly Definable Convergence Time for Solving Time-Variant Linear Matrix Equations , 2018, IEEE Transactions on Industrial Informatics.

[15]  G. Dullerud,et al.  A Course in Robust Control Theory: A Convex Approach , 2005 .

[16]  Sophie Tarbouriech,et al.  Stability and Stabilization of Linear Systems with Saturating Actuators , 2011 .

[17]  Alexander Reiter Time-Optimal Trajectory Planning for Redundant Robots , 2016 .

[18]  Yunong Zhang,et al.  Zeroing Dynamics, Gradient Dynamics, and Newton Iterations , 2015 .

[19]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[20]  Masafumi Hashimoto,et al.  Remarks on Solving Algebraic Riccati Matrix Equations using a Hopfield Neural Network and Application to Optimal Control Problems , 2015 .

[21]  Shuai Li,et al.  Integration-Enhanced Zhang Neural Network for Real-Time-Varying Matrix Inversion in the Presence of Various Kinds of Noises , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Jan Modersitzki,et al.  Fast inversion of matrices arising in image processing , 1999, Numerical Algorithms.

[23]  Shuzhi Sam Ge,et al.  Design and analysis of a general recurrent neural network model for time-varying matrix inversion , 2005, IEEE Transactions on Neural Networks.

[24]  Jaime A. Moreno,et al.  A linear framework for the robust stability analysis of a Generalized Super-Twisting Algorithm , 2009, 2009 6th International Conference on Electrical Engineering, Computing Science and Automatic Control (CCE).

[25]  Jaan Kiusalaas,et al.  Numerical methods in engineering with Python , 2005 .

[26]  P. Olver Nonlinear Systems , 2013 .

[27]  Marvin J. Tobias,et al.  Matrices in Engineering Problems , 2011, Matrices in Engineering Problems.

[28]  Yunong Zhang,et al.  From Davidenko Method to Zhang Dynamics for Nonlinear Equation Systems Solving , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[29]  Sidney Soclof Design And Applications Of Analog Integrated Circuits , 2004 .

[30]  Nobuto Matsuhira,et al.  Virtual Robot Experimentation Platform V-REP: A Versatile 3D Robot Simulator , 2010, SIMPAR.

[31]  Enrique S. Quintana-Ortí,et al.  Matrix inversion on CPU–GPU platforms with applications in control theory , 2013, Concurr. Comput. Pract. Exp..

[32]  Ue-Pyng Wen,et al.  A review of Hopfield neural networks for solving mathematical programming problems , 2009, Eur. J. Oper. Res..

[33]  Gamini Dissanayake,et al.  Convergence and Consistency Analysis for Extended Kalman Filter Based SLAM , 2007, IEEE Transactions on Robotics.

[34]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[35]  Shuai Li,et al.  Cooperative Motion Generation in a Distributed Network of Redundant Robot Manipulators With Noises , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[36]  Ke Chen,et al.  Performance Analysis of Gradient Neural Network Exploited for Online Time-Varying Matrix Inversion , 2009, IEEE Transactions on Automatic Control.

[37]  Yuehua Huang,et al.  Finite-Time Stability and Its Application for Solving Time-Varying Sylvester Equation by Recurrent Neural Network , 2014, Neural Processing Letters.