Integration enhanced and noise tolerant ZNN for computing various expressions involving outer inverses

Abstract An integration-enhanced noise-tolerant zeroing neural network (IENTZNN) model for computing various expressions involving outer inverses is defined and considered. The model assumes an input matrix A, two appropriately selected matrices F, G, a regularization parameter, and will be shortly denoted by IENTZNN(A, F, G). Particularly, IENTZNN(A, F, G) is applicable in computing real-time-varying matrix outer inverse with prescribed range and null space under the presence of various kinds of noises. The model is an extension of the IEZNN model for solving the problem of real-time matrix inversion as well as an integration-enhanced and noise-tolerant extension of the ZNNATS2 model for approximating time-varying outer inverse with prescribed range and null space. Theoretical analyses show that the proposed integration-enhanced model globally and exponentially converges to the theoretical solution. Moreover, the proposed IENTZNN(A, F, G) model is proven to have a very good performance in the presence of various kinds of noise. Finally, illustrative simulation examples are presented to testify the efficacy of the proposed model.

[1]  Shuai Li,et al.  Nonlinear recurrent neural networks for finite-time solution of general time-varying linear matrix equations , 2018, Neural Networks.

[2]  Shuai Li,et al.  Noise-Tolerant ZNN Models for Solving Time-Varying Zero-Finding Problems: A Control-Theoretic Approach , 2017, IEEE Transactions on Automatic Control.

[3]  Yimin Wei,et al.  Neural network approach to computing outer inverses based on the full rank representation , 2016 .

[4]  Shuai Li,et al.  Zeroing neural networks: A survey , 2017, Neurocomputing.

[5]  Zhijun Zhang,et al.  A Varying-Parameter Convergent Neural Dynamic Controller of Multirotor UAVs for Tracking Time-Varying Tasks , 2018, IEEE Transactions on Vehicular Technology.

[6]  Shuzhi Sam Ge,et al.  Design and analysis of a general recurrent neural network model for time-varying matrix inversion , 2005, IEEE Transactions on Neural Networks.

[7]  Shuai Li,et al.  Integration-Enhanced Zhang Neural Network for Real-Time-Varying Matrix Inversion in the Presence of Various Kinds of Noises , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Long Jin,et al.  Infinitely many Zhang functions resulting in various ZNN models for time-varying matrix inversion with link to Drazin inverse , 2015, Inf. Process. Lett..

[9]  Predrag S. Stanimirovic,et al.  Complex ZFs for computing time-varying complex outer inverses , 2018, Neurocomputing.

[10]  Yimin Wei.  Recurrent neural networks for computing weighted Moore-Penrose inverse , 2000, Appl. Math. Comput..

[11]  Yunong Zhang,et al.  Simulation and verification of Zhang neural network for online time-varying matrix inversion , 2009, Simul. Model. Pract. Theory.

[12]  Yimin Wei,et al.  Integral and limit representations of the outer inverse in Banach space , 2012 .

[13]  Yunong Zhang,et al.  Complex-valued Zhang neural network for online complex-valued time-varying matrix inversion , 2011, Appl. Math. Comput..

[14]  Predrag S. Stanimirovic,et al.  Gradient Neural Network with Nonlinear Activation for Computing Inner Inverses and the Drazin Inverse , 2017, Neural Processing Letters.

[15]  Predrag S. Stanimirovic,et al.  Recurrent Neural Network for Computing the Drazin Inverse , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Lin Xiao,et al.  A nonlinearly-activated neurodynamic model and its finite-time solution to equality-constrained quadratic optimization with nonstationary coefficients , 2016, Appl. Soft Comput..

[17]  Predrag S. Stanimirovic,et al.  Successive matrix squaring algorithm for computing outer inverses , 2008, Appl. Math. Comput..

[18]  Yong-Lin Chen,et al.  Representation and approximation of the outer inverse AT,S(2) of a matrix A , 2000 .

[19]  Jun Wang,et al.  Recurrent Neural Networks for Computing Pseudoinverses of Rank-Deficient Matrices , 1997, SIAM J. Sci. Comput..

[20]  Yimin Wei,et al.  A characterization and representation of the generalized inverse A(2)T,S and its applications , 1998 .

[21]  Predrag S. Stanimirovic,et al.  Recurrent Neural Network Approach Based on the Integral Representation of the Drazin Inverse , 2015, Neural Computation.

[22]  Yunong Zhang,et al.  Different Complex ZFs Leading to Different Complex ZNN Models for Time-Varying Complex Generalized Inverse Matrices , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Zhijun Zhang,et al.  A Varying-Parameter Convergent-Differential Neural Network for Solving Joint-Angular-Drift Problems of Redundant Robot Manipulators , 2018, IEEE/ASME Transactions on Mechatronics.

[24]  Predrag S. Stanimirovic,et al.  Limit representations of generalized inverses and related methods , 1999, Appl. Math. Comput..

[25]  Lin Xiao,et al.  Finite-time solution to nonlinear equation using recurrent neural dynamics with a specially-constructed activation function , 2015, Neurocomputing.

[26]  Weiguo Li,et al.  A family of iterative methods for computing the approximate inverse of a square matrix and inner inverse of a non-square matrix , 2010, Appl. Math. Comput..

[27]  Predrag S. Stanimirovic,et al.  Recurrent neural network for computing the W-weighted Drazin inverse , 2017, Appl. Math. Comput..

[28]  Predrag S. Stanimirovic,et al.  Iterative Method for Computing Moore-penrose Inverse Based on Penrose Equations , 2022 .

[29]  Y. Wei,et al.  The representation and approximations of outer generalized inverses , 2004 .

[30]  Yunong Zhang,et al.  Link Between and Comparison and Combination of Zhang Neural Network and Quasi-Newton BFGS Method for Time-Varying Quadratic Minimization , 2013, IEEE Transactions on Cybernetics.

[31]  Zhijun Zhang,et al.  A Complex Varying-Parameter Convergent-Differential Neural-Network for Solving Online Time-Varying Complex Sylvester Equation , 2019, IEEE Transactions on Cybernetics.

[32]  Yunong Zhang,et al.  From different ZFs to different ZNN models accelerated via Li activation functions to finite-time convergence for time-varying matrix pseudoinversion , 2014, Neurocomputing.

[33]  Shuai Li,et al.  A New Varying-Parameter Convergent-Differential Neural-Network for Solving Time-Varying Convex QP Problem Constrained by Linear-Equality , 2018, IEEE Transactions on Automatic Control.

[34]  MengChu Zhou,et al.  Modified Primal-Dual Neural Networks for Motion Control of Redundant Manipulators With Dynamic Rejection of Harmonic Noises , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[35]  Ning Tan,et al.  Zhang neural network solving for time-varying full-rank matrix Moore–Penrose inverse , 2010, Computing.

[36]  Jun Wang,et al.  A recurrent neural network for real-time matrix inversion , 1993 .

[37]  Jian Li,et al.  Enhanced discrete-time Zhang neural network for time-variant matrix inversion in the presence of bias noises , 2016, Neurocomputing.

[38]  Luo Fa-long,et al.  Neural network approach to computing matrix inversion , 1992 .

[39]  Francis Hsuan,et al.  The {2}-inverse with applications in statistics , 1985 .

[40]  Yong-Lin Chen.  A cramer rule for solution of the general restricted linear equation , 1993 .

[41]  Predrag S. Stanimirovic,et al.  Nonlinearly Activated Recurrent Neural Network for Computing the Drazin Inverse , 2017, Neural Processing Letters.

[42]  Predrag S. Stanimirovic,et al.  A class of numerical algorithms for computing outer inverses , 2014, J. Comput. Appl. Math..

[43]  Siyuan Chen,et al.  Compatible Convex–Nonconvex Constrained QP-Based Dual Neural Networks for Motion Planning of Redundant Robot Manipulators , 2019, IEEE Transactions on Control Systems Technology.

[44]  Dongsheng Guo,et al.  Comparison on Zhang neural dynamics and gradient-based neural dynamics for online solution of nonlinear time-varying equation , 2011, Neural Computing and Applications.

[45]  Shuai Li,et al.  Design and Analysis of FTZNN Applied to the Real-Time Solution of a Nonstationary Lyapunov Equation and Tracking Control of a Wheeled Mobile Manipulator , 2018, IEEE Transactions on Industrial Informatics.

[46]  Robert E. Hartwig,et al.  Applications of the Drazin Inverse to the Hill Cryptographic System. Part II , 1980, Cryptologia.

[47]  Yimin Wei,et al.  Two finite-time convergent Zhang neural network models for time-varying complex matrix Drazin inverse , 2017 .

[48]  T. Kaczorek,et al.  Computation of the Drazin inverse of a singular matrix making use of neural networks , 1992 .

[49]  Adi Ben-Israel.  On Matrices of Index Zero or One , 1969 .

[50]  Predrag S. Stanimirovic,et al.  Recurrent Neural Network for Computing Outer Inverse , 2016, Neural Computation.

[51]  Binghuang Cai,et al.  From Zhang Neural Network to Newton Iteration for Matrix Inversion , 2009, IEEE Transactions on Circuits and Systems I: Regular Papers.

[52]  Predrag S. Stanimirovic,et al.  Neural network for computing pseudoinverses and outer inverses of complex-valued matrices , 2016, Appl. Math. Comput..

[53]  Bing Zheng,et al.  Generalized inverse A(2)T, S and a rank equation , 2004, Appl. Math. Comput..

[54]  Jun Wang.  Recurrent neural networks for solving linear matrix equations , 1993 .

[55]  Gerhard Zielke,et al.  Report on test matrices for generalized inverses , 1986, Computing.

[56]  Shuai Li,et al.  Kinematic Control of Redundant Manipulators Using Neural Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[57]  Predrag S. Stanimirović,et al.  Complex Neural Network Models for Time-Varying Drazin Inverse , 2016, Neural Computation.

[58]  Predrag S. Stanimirovic,et al.  Two improvements of the iterative method for computing Moore-Penrose inverse based on Penrose equations , 2014, J. Comput. Appl. Math..

[59]  Predrag S. Stanimirovic,et al.  Gauss-Jordan elimination method for computing outer inverses , 2013, Appl. Math. Comput..

[60]  Zhijun Zhang,et al.  A New Varying-Parameter Recurrent Neural-Network for Online Solution of Time-Varying Sylvester Equation , 2018, IEEE Transactions on Cybernetics.

[61]  Shuai Li,et al.  A Novel Recurrent Neural Network for Manipulator Control With Improved Noise Tolerance , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[62]  Randall E. Cline,et al.  Inverses of Rank Invariant Powers of a Matrix , 1968 .