Complex Zhang neural networks for complex-variable dynamic quadratic programming

Abstract In this paper, a neurodynamic approach concerning complex Zhang neural networks (ZNNs) is presented to solve a complex-variable dynamic quadratic programming (QP). The proposed complex ZNNs are activated by various complex activation functions respectively, such as linear function, sign function and Li function. It is proved that ZNNs with different activation functions have different convergence rates involving super exponential convergency and finite time convergency. Furthermore, by introducing an integral term, a noise-tolerated ZNN is proposed to ensure the convergency under constant noise. Compared with existing works, the presented complex ZNNs in this paper have less amount of neurons and superior convergence rate. Some numerical examples are provided to illustrate the effectiveness and validity of the results. In addition, the complex ZNNs also apply well to LCMP beamforming problem.

[1]  Pierre-Brice Wieber,et al.  Hierarchical quadratic programming: Fast online humanoid-robot motion generation , 2014, Int. J. Robotics Res..

[2]  Gang Feng,et al.  A neural network for robust LCMP beamforming , 2006, Signal Process..

[3]  Chen Xu,et al.  A One-Layer Recurrent Neural Network for Constrained Complex-Variable Convex Optimization , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Ke Wang,et al.  Tracking control of air-breathing hypersonic vehicles with non-affine dynamics via improved neural back-stepping design. , 2018, ISA transactions.

[5]  Paul T. Boggs,et al.  Sequential Quadratic Programming , 1995, Acta Numerica.

[6]  N. Grudinin.  Reactive power optimization using successive quadratic programming method , 1998 .

[7]  Xiaodong Li,et al.  Signum-function array activated ZNN with easier circuit implementation and finite-time convergence for linear systems solving , 2017, Inf. Process. Lett..

[8]  B.D. Van Veen,et al.  Beamforming: a versatile approach to spatial filtering , 1988, IEEE ASSP Magazine.

[9]  Dongsheng Guo,et al.  Li-function activated ZNN with finite-time convergence applied to redundant-manipulator kinematic control via time-varying Jacobian matrix pseudoinversion , 2014, Appl. Soft Comput..

[10]  Lin Xiao,et al.  A convergence-accelerated Zhang neural network and its solution application to Lyapunov equation , 2016, Neurocomputing.

[11]  Jiaqi Huang,et al.  Neural-approximation-based robust adaptive control of flexible air-breathing hypersonic vehicles with parametric uncertainties and control input constraints , 2016, Inf. Sci..

[12]  Lin Xiao,et al.  Accelerating a recurrent neural network to finite-time convergence using a new design formula and its application to time-varying matrix square root , 2017, J. Frankl. Inst..

[13]  Dongsheng Guo,et al.  Zhang neural network versus gradient-based neural network for time-varying linear matrix equation solving , 2011, Neurocomputing.

[14]  Lawrence Hasdorff,et al.  Economic Dispatch Using Quadratic Programming , 1973 .

[15]  P. Wolfe.  THE SIMPLEX METHOD FOR QUADRATIC PROGRAMMING , 1959 .

[16]  Yunong Zhang,et al.  Complex-valued Zhang neural network for online complex-valued time-varying matrix inversion , 2011, Appl. Math. Comput..

[17]  Jian Li,et al.  Z-type neural-dynamics for time-varying nonlinear optimization under a linear equality constraint with robot application , 2018, J. Comput. Appl. Math..

[18]  Zhijun Zhang,et al.  A New Varying-Parameter Recurrent Neural-Network for Online Solution of Time-Varying Sylvester Equation , 2018, IEEE Transactions on Cybernetics.

[19]  Jun Wang,et al.  A Complex-Valued Projection Neural Network for Constrained Optimization of Real Functions in Complex Variables , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Yunong Zhang,et al.  Improved Zhang neural network model and its solution of time-varying generalized linear matrix equations , 2010, Expert Syst. Appl..

[21]  Lin Xiao,et al.  A new design formula exploited for accelerating Zhang neural network and its application to time-varying matrix inversion , 2016, Theor. Comput. Sci..

[22]  Ke Wang,et al.  A prescribed performance control approach guaranteeing small overshoot for air-breathing hypersonic vehicles via neural approximation , 2017 .

[23]  Yunong Zhang,et al.  Zhang Neural Networks and Neural-Dynamic Method , 2011 .

[24]  Yunong Zhang,et al.  Zhang neural network for online solution of time-varying convex quadratic program subject to time-varying linear-equality constraints , 2009 .

[25]  Wei Xing Zheng,et al.  A complex-valued neural dynamical optimization approach and its stability analysis , 2015, Neural Networks.

[26]  Yunong Zhang,et al.  Zhang Neural Network Versus Gradient Neural Network for Solving Time-Varying Linear Inequalities , 2011, IEEE Transactions on Neural Networks.

[27]  Chenfu Yi,et al.  Improved gradient-based neural networks for online solution of Lyapunov matrix equation , 2011, Inf. Process. Lett..

[28]  Shuai Li,et al.  Nonlinearly Activated Neural Network for Solving Time-Varying Complex Sylvester Equation , 2014, IEEE Transactions on Cybernetics.

[29]  Philip Wolfe,et al.  An algorithm for quadratic programming , 1956 .

[30]  C. Cryer.  The Solution of a Quadratic Programming Problem Using Systematic Overrelaxation , 1971 .

[31]  Jun Wang,et al.  A recurrent neural network for solving Sylvester equation with time-varying coefficients , 2002, IEEE Trans. Neural Networks.

[32]  A. Tesi,et al.  New conditions for global stability of neural networks with application to linear and quadratic programming problems , 1995 .

[33]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[34]  Predrag S. Stanimirovic,et al.  From Zhang Neural Network to scaled hyperpower iterations , 2018, J. Comput. Appl. Math..

[35]  Shuai Li,et al.  Nonconvex function activated zeroing neural network models for dynamic quadratic programming subject to equality and inequality constraints , 2017, Neurocomputing.

[36]  Jiaqi Huang,et al.  A guaranteed transient performance-based adaptive neural control scheme with low-complexity computation for flexible air-breathing hypersonic vehicles , 2016 .

[37]  Shuai Li,et al.  Modified ZNN for Time-Varying Quadratic Programming With Inherent Tolerance to Noises and Its Application to Kinematic Redundancy Resolution of Robot Manipulators , 2016, IEEE Transactions on Industrial Electronics.

[38]  Ke Chen,et al.  Performance Analysis of Gradient Neural Network Exploited for Online Time-Varying Matrix Inversion , 2009, IEEE Transactions on Automatic Control.

[39]  Yunong Zhang,et al.  Different Complex ZFs Leading to Different Complex ZNN Models for Time-Varying Complex Generalized Inverse Matrices , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[40]  Ken Kreutz-Delgado,et al.  The Complex Gradient Operator and the CR-Calculus ECE275A - Lecture Supplement - Fall 2005 , 2009, 0906.4835.

[41]  Songchuan Zhang,et al.  Solving Nonlinear Optimization Problems of Real Functions in Complex Variables by Complex-Valued Iterative Methods , 2018, IEEE Transactions on Cybernetics.

[42]  Yimin Wei,et al.  Two finite-time convergent Zhang neural network models for time-varying complex matrix Drazin inverse , 2017 .