General Square-Pattern Discretization Formulas via Second-Order Derivative Elimination for Zeroing Neural Network Illustrated by Future Optimization

Previous works provide a few effective discretization formulas for zeroing neural network (ZNN), of which the precision is a square pattern. However, those formulas are separately developed via many relatively blind attempts. In this paper, general square-pattern discretization (SPD) formulas are proposed for ZNN via the idea of the second-order derivative elimination. All existing SPD formulas in previous works are included in the framework of the general SPD formulas. The connections and differences of various general formulas are also discussed. Furthermore, the general SPD formulas are used to solve future optimization under linear equality constraints, and the corresponding general discrete ZNN models are proposed. General discrete ZNN models have at least one parameter to adjust, thereby determining their zero stability. Thus, the parameter domains are obtained by restricting zero stability. Finally, numerous comparative numerical experiments, including the motion control of a PUMA560 robot manipulator, are provided to substantiate theoretical results and their superiority to conventional Euler formula.

[1]  Bin Zhou,et al.  On Asymptotic Stability of Discrete-Time Linear Time-Varying Systems , 2017, IEEE Transactions on Automatic Control.

[2]  Bing Chen,et al.  Robust Adaptive Fuzzy Tracking Control for Pure-Feedback Stochastic Nonlinear Systems With Input Constraints , 2013, IEEE Transactions on Cybernetics.

[3]  Yunong Zhang,et al.  Presentation, error analysis and numerical experiments on a group of 1-step-ahead numerical differentiation formulas , 2013, J. Comput. Appl. Math..

[4]  Long Jin,et al.  Taylor $O(h^{3})$ Discretization of ZNN Models for Dynamic Equality-Constrained Quadratic Programming With Application to Manipulators , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Binghuang Cai,et al.  Different-Level Redundancy-Resolution and Its Equivalent Relationship Analysis for Robot Manipulators Using Gradient-Descent and Zhang 's Neural-Dynamic Methods , 2012, IEEE Transactions on Industrial Electronics.

[6]  E. Süli,et al.  An introduction to numerical analysis , 2003 .

[7]  Emiliano Dall'Anese,et al.  Prediction-Correction Algorithms for Time-Varying Constrained Optimization , 2017, IEEE Transactions on Signal Processing.

[8]  Desmond J. Higham,et al.  Numerical Methods for Ordinary Differential Equations - Initial Value Problems , 2010, Springer undergraduate mathematics series.

[9]  Long Jin,et al.  Discrete-time Zhang neural network of O(τ3) pattern for time-varying matrix pseudoinversion with application to manipulator motion generation , 2014, Neurocomputing.

[10]  Jinde Cao,et al.  Synchronization of Neural Networks With Control Packet Loss and Time-Varying Delay via Stochastic Sampled-Data Controller , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Yunong Zhang,et al.  ZD, ZG and IOL Controllers and Comparisons for Nonlinear System Output Tracking with DBZ Problem Conquered in Different Relative-Degree Cases , 2017 .

[12]  Jinde Cao,et al.  Improved synchronization analysis of competitive neural networks with time-varying delays , 2018 .

[13]  Aryan Mokhtari,et al.  Decentralized Prediction-Correction Methods for Networked Time-Varying Convex Optimization , 2016, IEEE Transactions on Automatic Control.

[14]  Nadia Magnenat-Thalmann,et al.  Human-Like Behavior Generation Based on Head-Arms Model for Robot Tracking External Targets and Body Parts , 2015, IEEE Transactions on Cybernetics.

[15]  Shuai Li,et al.  Modified ZNN for Time-Varying Quadratic Programming With Inherent Tolerance to Noises and Its Application to Kinematic Redundancy Resolution of Robot Manipulators , 2016, IEEE Transactions on Industrial Electronics.

[16]  Jinde Cao,et al.  Synchronization of Hierarchical Time-Varying Neural Networks Based on Asynchronous and Intermittent Sampled-Data Control , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Long Jin,et al.  Continuous and discrete Zhang dynamics for real-time varying nonlinear optimization , 2015, Numerical Algorithms.

[18]  Chih-Wei Liu,et al.  A View of Gaussian Elimination Applied to Early-Stopped Berlekamp–Massey Algorithm , 2007, IEEE Transactions on Communications.

[19]  Shuai Li,et al.  Distributed Task Allocation of Multiple Robots: A Control Perspective , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[20]  Shuai Li,et al.  New Discretization-Formula-Based Zeroing Dynamics for Real-Time Tracking Control of Serial and Parallel Manipulators , 2018, IEEE Transactions on Industrial Informatics.

[21]  Yunong Zhang,et al.  New ZFD (Zhang finite difference) formula 4IgSFD_L for time-varying reciprocal and inverse computation , 2017, 2017 29th Chinese Control And Decision Conference (CCDC).

[22]  Alan J. Fenn,et al.  An experimental adaptive nulling receiver utilizing the sample matrix inversion algorithm with channel equalization , 1991 .

[23]  Adel M. Alimi,et al.  Stability analysis for delayed high-order type of Hopfield neural networks with impulses , 2015, Neurocomputing.

[24]  Jian Li,et al.  Enhanced discrete-time Zhang neural network for time-variant matrix inversion in the presence of bias noises , 2016, Neurocomputing.

[25]  Yunong Zhang,et al.  Zhang Neural Networks and Neural-Dynamic Method , 2011 .

[26]  Jinde Cao,et al.  Existence and Uniform Stability Analysis of Fractional-Order Complex-Valued Neural Networks With Time Delays , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Begnaud Francis Hildebrand,et al.  Introduction to numerical analysis: 2nd edition , 1987 .

[28]  Long Jin,et al.  Taylor-type 1-step-ahead numerical differentiation rule for first-order derivative approximation and ZNN discretization , 2015, J. Comput. Appl. Math..

[29]  Bolin Liao,et al.  Control of pendulum tracking (including swinging up) of IPC system using zeroing-gradient method , 2017 .

[30]  Jia Wang,et al.  Event-Triggered Generalized Dissipativity Filtering for Neural Networks With Time-Varying Delays , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Xiaoping Liu,et al.  Robust Adaptive Neural Tracking Control for a Class of Stochastic Nonlinear Interconnected Systems , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Jian Li,et al.  Z-type neural-dynamics for time-varying nonlinear optimization under a linear equality constraint with robot application , 2018, J. Comput. Appl. Math..

[33]  Shuai Li,et al.  Cooperative Motion Generation in a Distributed Network of Redundant Robot Manipulators With Noises , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[34]  William F. Tinney,et al.  Compensation Methods for Network Solutions by Optimally Ordered Triangular Factorization , 1972 .

[35]  Yunong Zhang,et al.  ZFD formula 4IgSFD_Y applied to future minimization , 2017 .

[36]  Xinghuo Yu,et al.  Quantized Iterative Learning Consensus Tracking of Digital Networks With Limited Information Communication , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[37]  Predrag S. Stanimirovic,et al.  Recurrent Neural Network for Computing the Drazin Inverse , 2015, IEEE Transactions on Neural Networks and Learning Systems.