Discrete-Time Zhang Neural Network for Online Time-Varying Nonlinear Optimization With Application to Manipulator Motion Generation

In this brief, a discrete-time Zhang neural network (DTZNN) model is first proposed, developed, and investigated for online time-varying nonlinear optimization (OTVNO). Then, Newton iteration is shown to be derived from the proposed DTZNN model. In addition, to eliminate the explicit matrix-inversion operation, the quasi-Newton Broyden-Fletcher-Goldfarb-Shanno (BFGS) method is introduced, which can effectively approximate the inverse of Hessian matrix. A DTZNN-BFGS model is thus proposed and investigated for OTVNO, which is the combination of the DTZNN model and the quasiNewton BFGS method. In addition, theoretical analyses show that, with step-size h = 1 and/or with zero initial error, the maximal residual error of the DTZNN model has an O(τ2) pattern, whereas the maximal residual error of the Newton iteration has an O(τ) pattern, with τ denoting the sampling gap. Besides, when h ≠ 1 and h ∈ (0, 2), the maximal steady-state residual error of the DTZNN model has an O(τ2) pattern. Finally, an illustrative numerical experiment and an application example to manipulator motion generation are provided and analyzed to substantiate the efficacy of the proposed DTZNN and DTZNN-BFGS models for OTVNO.

[1]  Yunong Zhang,et al.  Zhang Neural Networks and Neural-Dynamic Method , 2011 .

[2]  Yunong Zhang,et al.  O(N 2)-Operation Approximation of Covariance Matrix Inverse in Gaussian Process Regression Based on Quasi-Newton BFGS Method , 2007, Commun. Stat. Simul. Comput..

[3]  Alireza Nazemi.  A dynamic system model for solving convex nonlinear optimization problems , 2012 .

[4]  Abhishek K Gupta,et al.  Numerical Methods using MATLAB , 2014, Apress.

[5]  Qingshan Liu,et al.  A One-Layer Projection Neural Network for Nonsmooth Optimization Subject to Linear Equalities and Bound Constraints , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Bruno Alfano,et al.  Descent Algorithms on Oblique Manifold for Source-Adaptive ICA Contrast , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Euntai Kim,et al.  Novel Range-Free Localization Based on Multidimensional Support Vector Regression Trained in the Primal Space , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Abdesselam Bouzerdoum,et al.  Efficient training algorithms for a class of shunting inhibitory convolutional neural networks , 2005, IEEE Transactions on Neural Networks.

[9]  María José Pérez-Ilzarbe.  New Discrete-Time Recurrent Neural Network Proposal for Quadratic Optimization With General Linear Constraints , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[10]  C.B. Feng,et al.  Time-Varying Nonlinear Programming and its Realization via Neural Networks , 1992, 1992 American Control Conference.

[11]  Yunong Zhang,et al.  Time-series Gaussian Process Regression Based on Toeplitz Computation of O(N2) Operations and O(N)-level Storage , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[12]  Qingshan Liu,et al.  A One-Layer Recurrent Neural Network for Pseudoconvex Optimization Subject to Linear Equality Constraints , 2011, IEEE Transactions on Neural Networks.

[13]  Yunong Zhang,et al.  Zhang Neural Network Versus Gradient Neural Network for Solving Time-Varying Linear Inequalities , 2011, IEEE Transactions on Neural Networks.

[14]  Harvey Lipkin,et al.  A dynamic quasi-Newton method for uncalibrated visual servoing , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[15]  George Lindfield,et al.  Numerical Methods Using MATLAB , 1998 .

[16]  M. Fukushima,et al.  A modified BFGS method and its global convergence in nonconvex minimization , 2001 .

[17]  Ke Chen,et al.  Cyclic motion generation of multi-link planar robot performing square end-effector trajectory analyzed via gradient-descent and Zhang et al’s neural-dynamic methods , 2008, 2008 2nd International Symposium on Systems and Control in Aerospace and Astronautics.

[18]  Zhipeng Wu,et al.  BFGS quasi-Newton method for solving electromagnetic inverse problems , 2006 .

[19]  Binghuang Cai,et al.  From Zhang Neural Network to Newton Iteration for Matrix Inversion , 2009, IEEE Transactions on Circuits and Systems I: Regular Papers.

[20]  Dongsheng Guo,et al.  Zhang neural network, Getz-Marsden dynamic system, and discrete-time algorithms for time-varying matrix inversion with application to robots' kinematic control , 2012, Neurocomputing.

[21]  Raymond L. Watrous.  Learning Algorithms for Connectionist Networks: Applied Gradient Methods of Nonlinear Optimization , 1988 .

[22]  Hyun Myung,et al.  Time-varying two-phase optimization and its application to neural-network learning , 1997, IEEE Trans. Neural Networks.

[23]  Chun-Yi Su,et al.  Neural-Adaptive Control of Single-Master–Multiple-Slaves Teleoperation for Coordinated Multiple Mobile Manipulators With Time-Varying Communication Delays and Input Uncertainties , 2013, IEEE Transactions on Neural Networks and Learning Systems.