Modified gradient neural networks for solving the time-varying Sylvester equation with adaptive coefficients and elimination of matrix inversion

Abstract In scientific and engineering fields, the solutions to many problems can be transformed into finding the solutions to Sylvester equation, for which various computational methods (e.g., recurrent neural network, RNN) have been presented and investigated. RNN models are frequently used to solve computational problems due to the prevalent exploitation of the gradient-based RNN. However, the overlong convergent time and the too large residual error restrict the widespread applications of the RNN model in solving time-varying problems. Further, a special type of RNN named zeroing neural network (ZNN) is able to solve the time-varying Sylvester equation, which breaks the limitations mentioned above, but fails to handle complex time-varying problems owing to the sharp increment of the calculated amount in matrix inversion involved. To remedy the limitation, a modified gradient-based RNN (MGRNN) model is proposed to generate more accurate computational solutions with less convergent time and adaptive coefficients for solving the time-varying Sylvester equation, which replaces the matrix inversion problem with the matrix transposition problem. Besides, theoretical analyses and mathematical verifications are presented to validate the efficiency and superiority of the proposed MGRNN model compared with the traditional gradient-based recurrent neural network (GRNN) and ZNN models. Furthermore, simulation experiments are conducted to substantiate the properties of the newly proposed MGRNN model for solving the time-varying Sylvester equation.

[1]  Jing Na,et al.  Online optimal solutions for multi-player nonzero-sum game with completely unknown dynamics , 2017, Neurocomputing.

[2]  Jing Na,et al.  Adaptive Parameter Estimation and Control Design for Robot Manipulators With Finite-Time Convergence , 2018, IEEE Transactions on Industrial Electronics.

[3]  Long Jin,et al.  Continuous and discrete Zhang dynamics for real-time varying nonlinear optimization , 2015, Numerical Algorithms.

[4]  Predrag S. Stanimirovic,et al.  Recurrent Neural Network for Computing the Drazin Inverse , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Jing Na,et al.  RISE-Based Asymptotic Prescribed Performance Tracking Control of Nonlinear Servo Mechanisms , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[6]  Shuai Li,et al.  A Noise-Suppressing Neural Algorithm for Solving the Time-Varying System of Linear Equations: A Control-Based Approach , 2019, IEEE Transactions on Industrial Informatics.

[7]  Shuai Li,et al.  RNN Models for Dynamic Matrix Inversion: A Control-Theoretical Perspective , 2018, IEEE Transactions on Industrial Informatics.

[8]  Jun Wang,et al.  A recurrent neural network for solving Sylvester equation with time-varying coefficients , 2002, IEEE Trans. Neural Networks.

[9]  Chee Peng Lim,et al.  Classification of transcranial Doppler signals using individual and ensemble recurrent neural networks , 2017, Neurocomputing.

[10]  Ming Jiang,et al.  Convergence Studies on Iterative Algorithms for Image Reconstruction , 2003, IEEE Trans. Medical Imaging.

[11]  Shuai Li,et al.  Zeroing neural networks: A survey , 2017, Neurocomputing.

[12]  Richard H. Bartels,et al.  Algorithm 432 [C2]: Solution of the matrix equation AX + XB = C [F4] , 1972, Commun. ACM.

[13]  Frank L. Lewis,et al.  Resilient adaptive and H∞ controls of multi-agent systems under sensor and actuator faults , 2019, Autom..

[14]  Shuai Li,et al.  Nonlinearly Activated Neural Network for Solving Time-Varying Complex Sylvester Equation , 2014, IEEE Transactions on Cybernetics.

[15]  Vassilis L. Syrmos,et al.  Disturbance decoupling using constrained Sylvester equations , 1994, IEEE Trans. Autom. Control..

[16]  Shuai Li,et al.  Dynamic neural networks aided distributed cooperative control of manipulators capable of different performance indices , 2018, Neurocomputing.

[17]  Shuai Li,et al.  Robot manipulator control using neural networks: A survey , 2018, Neurocomputing.

[18]  Shuzhi Sam Ge,et al.  Design and analysis of a general recurrent neural network model for time-varying matrix inversion , 2005, IEEE Transactions on Neural Networks.

[19]  Jing Na,et al.  Approximation-Free Control for Vehicle Active Suspensions With Hydraulic Actuator , 2018, IEEE Transactions on Industrial Electronics.

[20]  Long Jin,et al.  Neural network-based discrete-time Z-type model of high accuracy in noisy environments for solving dynamic system of linear equations , 2016, Neural Computing and Applications.

[21]  Jing Na,et al.  Unknown input observer‐based robust adaptive funnel motion control for nonlinear servomechanisms , 2018, International Journal of Robust and Nonlinear Control.

[22]  Eugenius Kaszkurewicz,et al.  Solving systems of linear equations via gradient systems with discontinuous righthand sides: application to LS-SVM , 2005, IEEE Transactions on Neural Networks.

[23]  Dongsheng Guo,et al.  Comparison on Zhang neural dynamics and gradient-based neural dynamics for online solution of nonlinear time-varying equation , 2011, Neural Computing and Applications.

[24]  Y. Saad,et al.  Iterative solution of linear systems in the 20th century , 2000 .

[25]  Shuai Li,et al.  Accelerating a Recurrent Neural Network to Finite-Time Convergence for Solving Time-Varying Sylvester Equation by Using a Sign-Bi-power Activation Function , 2012, Neural Processing Letters.

[26]  Saeid Abbasbandy,et al.  Conjugate gradient method for fuzzy symmetric positive definite system of linear equations , 2005, Appl. Math. Comput..

[27]  Shuai Li,et al.  Nonconvex function activated zeroing neural network models for dynamic quadratic programming subject to equality and inequality constraints , 2017, Neurocomputing.

[28]  Feng Ding,et al.  Gradient Based Iterative Algorithms for Solving a Class of Matrix Equations , 2005, IEEE Trans. Autom. Control..

[29]  Guido Herrmann,et al.  Active Adaptive Estimation and Control for Vehicle Suspensions With Prescribed Performance , 2018, IEEE Transactions on Control Systems Technology.

[30]  Chenguang Yang,et al.  New Noise-Tolerant Neural Algorithms for Future Dynamic Nonlinear Optimization With Estimation on Hessian Matrix Inversion , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[31]  Changyin Sun,et al.  Neural Network Control of a Robotic Manipulator With Input Deadzone and Output Constraint , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[32]  John G. Harris,et al.  Noise-Robust Automatic Speech Recognition Using a Predictive Echo State Network , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[33]  Yu Guo,et al.  Robust adaptive control for vehicle active suspension systems with uncertain dynamics , 2018 .

[34]  Qiang Chen,et al.  Adaptive echo state network control for a class of pure-feedback systems with input and output constraints , 2018, Neurocomputing.