Neural network-based discrete-time Z-type model of high accuracy in noisy environments for solving dynamic system of linear equations

AbstractTo solve dynamic system of linear equations with square or rectangular system matrices in real time, a discrete-time Z-type model based on neural network is proposed and investigated. It is developed from and studied with the aid of a unified continuous-time Z-type model. Note that the framework of such a unified continuous-time Z-type model is generic and has a wide range of applications, such as robotic redundancy resolution with quadratic programming formulations. To do so, a one-step-ahead numerical differentiation formula and its optimal sampling-gap rule in noisy environments are presented. We compare the Z-type model extensively with E-type and N-type models. Theoretical results on stability and convergence are provided which show that the maximal steady-state residual errors of the Z-type, E-type and N-type models have orders $$O(\tau ^3)$$O(τ3), $$O(\tau ^2)$$O(τ2) and $$O(\tau )$$O(τ), respectively, where $$\tau $$τ is the sampling gap. We also prove that the residual error of any static method that does not exploit the time-derivative information of a time-dependent system of linear equations has order $$O(\tau )$$O(τ) when applied to solve discrete real-time dynamic system of linear equations. Finally, several illustrative numerical experiments in noisy environments as well as two application examples to the inverse-kinematics control of redundant manipulators are provided and illustrated. Our analysis substantiates the efficacy of the Z-type model for solving the dynamic system of linear equations in real time.

[1]  Xingyuan Wang,et al.  An asynchronous communication system based on the hyperchaotic system of 6th-order cellular neural network , 2012 .

[2]  Long Jin,et al.  Infinitely many Zhang functions resulting in various ZNN models for time-varying matrix inversion with link to Drazin inverse , 2015, Inf. Process. Lett..

[3]  Guang Li,et al.  Adaptive Neural Network Feedforward Control for Dynamically Substructured Systems , 2014, IEEE Transactions on Control Systems Technology.

[4]  Yu Guo,et al.  Adaptive neural network predictive control for nonlinear pure feedback systems with input delay , 2012 .

[5]  Jinde Cao,et al.  Global exponential stability of discrete-time recurrent neural network for solving quadratic programming problems subject to linear constraints , 2011, Neurocomputing.

[6]  Shuai Li,et al.  Decentralized control of collaborative redundant manipulators with partial command coverage via locally connected recurrent neural networks , 2012, Neural Computing and Applications.

[7]  Shuai Li,et al.  Neural network based mobile phone localization using Bluetooth connectivity , 2013, Neural Computing and Applications.

[8]  Jean-Luc Starck,et al.  Sparse Solution of Underdetermined Systems of Linear Equations by Stagewise Orthogonal Matching Pursuit , 2012, IEEE Transactions on Information Theory.

[9]  Bing Chen,et al.  Robust Adaptive Fuzzy Tracking Control for Pure-Feedback Stochastic Nonlinear Systems With Input Constraints , 2013, IEEE Transactions on Cybernetics.

[10]  Yunong Zhang,et al.  Presentation, error analysis and numerical experiments on a group of 1-step-ahead numerical differentiation formulas , 2013, J. Comput. Appl. Math..

[11]  Desmond J. Higham,et al.  Numerical Methods for Ordinary Differential Equations - Initial Value Problems , 2010, Springer undergraduate mathematics series.

[12]  Long Cheng,et al.  Multicriteria Optimization for Coordination of Redundant Robots Using a Dual Neural Network , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Shuai Li,et al.  Selective Positive–Negative Feedback Produces the Winner-Take-All Competition in Recurrent Neural Networks , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Ke Chen.  Robustness analysis of Wang neural network for online linear equation solving , 2012 .

[15]  Lin Xiao,et al.  Finite-time solution to nonlinear equation using recurrent neural dynamics with a specially-constructed activation function , 2015, Neurocomputing.

[16]  Ting Wang,et al.  Combined Convex Technique on Delay-Dependent Stability for Delayed Neural Networks , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Long Jin,et al.  Taylor-type 1-step-ahead numerical differentiation rule for first-order derivative approximation and ZNN discretization , 2015, J. Comput. Appl. Math..

[18]  Ke Chen.  Implicit dynamic system for online simultaneous linear equations solving , 2013 .

[19]  Abhishek K Gupta,et al.  Numerical Methods using MATLAB , 2014, Apress.

[20]  Bing Chen,et al.  Adaptive neural control for strict-feedback stochastic nonlinear systems with time-delay , 2012, Neurocomputing.

[21]  Manchun Tan,et al.  Exponential convergence and stability of delayed fuzzy cellular neural networks with time-varying coefficients , 2011 .

[22]  Shuai Li,et al.  Nonlinearly Activated Neural Network for Solving Time-Varying Complex Sylvester Equation , 2014, IEEE Transactions on Cybernetics.

[23]  Shuai Li,et al.  Accelerating a Recurrent Neural Network to Finite-Time Convergence for Solving Time-Varying Sylvester Equation by Using a Sign-Bi-power Activation Function , 2012, Neural Processing Letters.

[24]  Saeid Abbasbandy,et al.  Conjugate gradient method for fuzzy symmetric positive definite system of linear equations , 2005, Appl. Math. Comput..

[25]  Yunong Zhang,et al.  Superior robustness of power-sum activation functions in Zhang neural networks for time-varying quadratic programs perturbed with large implementation errors , 2011, Neural Computing and Applications.

[26]  Dongsheng Guo,et al.  Zhang neural network and its application to Newton iteration for matrix square root estimation , 2010, Neural Computing and Applications.

[27]  Frank Uhlig,et al.  Numerical Algorithms with C , 1996 .

[28]  Xingyuan Wang,et al.  Backstepping generalized synchronization for neural network with delays based on tracing control method , 2014, Neural Computing and Applications.

[29]  Nadia Magnenat-Thalmann,et al.  Human-Like Behavior Generation Based on Head-Arms Model for Robot Tracking External Targets and Body Parts , 2015, IEEE Transactions on Cybernetics.

[30]  A. Cichocki,et al.  Neural networks for solving systems of linear equations and related problems , 1992 .

[31]  Jun Wang,et al.  A primal-dual neural network for online resolving constrained kinematic redundancy in robot motion control , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[32]  Ying Wang,et al.  Different ZFs Leading to Various ZNN Models Illustrated via Online Solution of Time-Varying Underdetermined Systems of Linear Equations with Robotic Application , 2013, ISNN.

[33]  Predrag S. Stanimirovic,et al.  Recurrent Neural Network for Computing the Drazin Inverse , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[34]  George Lindfield,et al.  Numerical Methods Using MATLAB , 1998 .

[35]  Shuzhi Sam Ge,et al.  Impedance Learning for Robots Interacting With Unknown Environments , 2014, IEEE Transactions on Control Systems Technology.

[36]  Yunong Zhang,et al.  Discrete-time Zhang neural network and numerical algorithm for time-varying linear equations solving , 2011, 2011 IEEE International Conference on Mechatronics and Automation.

[37]  Youngchul Sung,et al.  Least Squares Approach to Joint Beam Design for Interference Alignment in Multiuser Multi-Input Multi-Output Interference Channels , 2010, IEEE Transactions on Signal Processing.

[38]  Zhi Yang,et al.  Revisit and compare Ma equivalence and Zhang equivalence of minimum velocity norm (MVN) type , 2016, Adv. Robotics.

[39]  Long Cheng,et al.  Recurrent Neural Network for Non-Smooth Convex Optimization Problems With Application to the Identification of Genetic Regulatory Networks , 2011, IEEE Transactions on Neural Networks.

[40]  B. Keramati,et al.  An approach to the solution of linear system of equations by He’s homotopy perturbation method , 2009 .

[41]  Yunong Zhang,et al.  Different Zhang functions leading to various ZNN models illustrated via solving the time-varying overdetermined system of linear equations , 2013, 2013 IEEE Third International Conference on Information Science and Technology (ICIST).

[42]  Kai Xu,et al.  Intrinsic Wrench Estimation and Its Performance Index for Multisegment Continuum Robots , 2010, IEEE Transactions on Robotics.

[43]  Binghuang Cai,et al.  A novel artificial neural network method for biomedical prediction based on matrix pseudo-inversion , 2014, J. Biomed. Informatics.

[44]  Tingting Xu,et al.  Autonomous Behavior-Based Switched Top-Down and Bottom-Up Visual Attention for Mobile Robots , 2010, IEEE Transactions on Robotics.

[45]  Chenguang Yang,et al.  Neural Network-Based Motion Control of an Underactuated Wheeled Inverted Pendulum Model , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[46]  Predrag S. Stanimirovic,et al.  Recurrent Neural Network Approach Based on the Integral Representation of the Drazin Inverse , 2015, Neural Computation.

[47]  Eugenius Kaszkurewicz,et al.  Solving systems of linear equations via gradient systems with discontinuous righthand sides: application to LS-SVM , 2005, IEEE Transactions on Neural Networks.

[48]  Y. Saad,et al.  Iterative solution of linear systems in the 20th century , 2000 .

[49]  Long Jin,et al.  Discrete-time Zhang neural network of O(τ3) pattern for time-varying matrix pseudoinversion with application to manipulator motion generation , 2014, Neurocomputing.