Noise-suppressing zeroing neural network for online solving time-varying nonlinear optimization problem: a control-based approach

Time-varying nonlinear optimization problems with different noises often arise in the fields of scientific and engineering research. Noises are unavoidable in the practical workspace, but the most existing models for time-varying nonlinear optimization problems carry out with one assume that the computing process is free of noises. In this paper, from a control-theoretical framework, noise-suppressing zeroing neural dynamic (NSZND) model is developed, analyzed and investigated by feat of continuous-time zeroing neural network model, which behaves efficiently for hurdling online time-varying nonlinear optimization problems with the presence of different noises. Further, for speeding the rate of convergence, general noise-suppressing zeroing neural network (GNSZNN) model with different activation functions is discussed. Then, theoretical analyses show that the proposed noise-suppressing zeroing neural network model derived from NSZND model has the global convergence property in the presence of different kinds of noises. Besides, how GNSZNN model performs with different activation functions is also proved in detail. In addition, numerical results are provided to substantiate the feasibility and superiority of GNSZNN model for online time-varying nonlinear optimization problems with inherent tolerance to noises.

[1]  Long Jin,et al.  Neural network-based discrete-time Z-type model of high accuracy in noisy environments for solving dynamic system of linear equations , 2016, Neural Computing and Applications.

[2]  Neculai Andrei A Dai-Liao conjugate gradient algorithm with clustering of eigenvalues , 2017, Numerical Algorithms.

[3]  Yantao Tian,et al.  A novel projected Fletcher‐Reeves conjugate gradient approach for finite‐time optimal robust controller of linear constraints optimization problem: Application to bipedal walking robots , 2018 .

[4]  S. J. Li,et al.  New three-term conjugate gradient method with guaranteed global convergence , 2014, Int. J. Comput. Math..

[5]  Long Jin,et al.  Continuous and discrete Zhang dynamics for real-time varying nonlinear optimization , 2015, Numerical Algorithms.

[6]  Jing Wang,et al.  Two modified spectral conjugate gradient methods and their global convergence for unconstrained optimization , 2018, Int. J. Comput. Math..

[7]  Shuai Li,et al.  Modified ZNN for Time-Varying Quadratic Programming With Inherent Tolerance to Noises and Its Application to Kinematic Redundancy Resolution of Robot Manipulators , 2016, IEEE Transactions on Industrial Electronics.

[8]  Xiang Chen,et al.  A Visual Distance Approach for Multicamera Deployment With Coverage Optimization , 2018, IEEE/ASME Transactions on Mechatronics.

[9]  Dongsheng Guo,et al.  Zhang neural network and its application to Newton iteration for matrix square root estimation , 2010, Neural Computing and Applications.

[10]  Peiyao Shen,et al.  Complete and Time-Optimal Path-Constrained Trajectory Planning With Torque and Velocity Constraints: Theory and Applications , 2018, IEEE/ASME Transactions on Mechatronics.

[11]  Panayiotis E. Pintelas,et al.  A descent hybrid conjugate gradient method based on the memoryless BFGS update , 2018, Numerical Algorithms.

[12]  Karim Djouani,et al.  Toward Lower Limbs Functional Rehabilitation Through a Knee-Joint Exoskeleton , 2017, IEEE Transactions on Control Systems Technology.

[13]  Zhanshan Wang,et al.  A projection neural network with mixed delays for solving linear variational inequality , 2014, Neurocomputing.

[14]  Wei Xing Zheng,et al.  A complex-valued neural dynamical optimization approach and its stability analysis , 2015, Neural Networks.

[15]  Xin Zhang,et al.  Dynamic task allocation in multi-robot coordination for moving target tracking: A distributed approach , 2019, Autom..

[16]  Y. -H. Dai,et al.  New Conjugacy Conditions and Related Nonlinear Conjugate Gradient Methods , 2001 .

[17]  Feng Li,et al.  Different modified zeroing neural dynamics with inherent tolerance to noises for time-varying reciprocal problems: A control-theoretic approach , 2019, Neurocomputing.

[18]  Shuai Li,et al.  Nonconvex function activated zeroing neural network models for dynamic quadratic programming subject to equality and inequality constraints , 2017, Neurocomputing.

[19]  Shuai Li,et al.  On Generalized RMP Scheme for Redundant Robot Manipulators Aided With Dynamic Neural Networks and Nonconvex Bound Constraints , 2019, IEEE Transactions on Industrial Informatics.

[20]  Baotong Cui,et al.  A neural dynamic system for solving convex nonlinear optimization problems with hybrid constraints , 2019, Neural Computing and Applications.

[21]  Shuai Li,et al.  Neural Dynamics for Cooperative Control of Redundant Robot Manipulators , 2018, IEEE Transactions on Industrial Informatics.

[22]  Shuai Li,et al.  Cooperative Motion Generation in a Distributed Network of Redundant Robot Manipulators With Noises , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[23]  Neculai Andrei,et al.  An adaptive scaled BFGS method for unconstrained optimization , 2018, Numerical Algorithms.

[24]  Shuai Li,et al.  Decentralized control of collaborative redundant manipulators with partial command coverage via locally connected recurrent neural networks , 2012, Neural Computing and Applications.

[25]  Poom Kumam,et al.  A descent Dai-Liao conjugate gradient method for nonlinear equations , 2018, Numerical Algorithms.

[26]  Yunong Zhang,et al.  Zhang Neural Networks and Neural-Dynamic Method , 2011 .

[27]  Yunong Zhang,et al.  Zhang neural network for online solution of time-varying convex quadratic program subject to time-varying linear-equality constraints , 2009 .

[28]  Rachel W Jackson,et al.  Human-in-the-loop optimization of exoskeleton assistance during walking , 2017, Science.

[29]  Lin Xiao,et al.  Complex-Valued Discrete-Time Neural Dynamics for Perturbed Time-Dependent Complex Quadratic Programming With Applications , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Lingao Li,et al.  A new finite-time varying-parameter convergent-differential neural-network for solving nonlinear and nonconvex optimization problems , 2018, Neurocomputing.

[31]  Yunong Zhang,et al.  Superior robustness of power-sum activation functions in Zhang neural networks for time-varying quadratic programs perturbed with large implementation errors , 2011, Neural Computing and Applications.

[32]  Liqun Qi,et al.  Neurodynamical Optimization , 2004, J. Glob. Optim..

[33]  Chenguang Yang,et al.  New Noise-Tolerant Neural Algorithms for Future Dynamic Nonlinear Optimization With Estimation on Hessian Matrix Inversion , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[34]  Yunong Zhang,et al.  Zhang Functions and Various Models , 2015 .

[35]  Long Jin,et al.  Discrete-Time Zhang Neural Network for Online Time-Varying Nonlinear Optimization With Application to Manipulator Motion Generation , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[36]  Zhongbo Sun,et al.  A new trust region–sequential quadratic programming approach for nonlinear systems based on nonlinear model predictive control , 2019 .

[37]  Yunong Zhang,et al.  Design and experimentation of acceleration-level drift-free scheme aided by two recurrent neural networks , 2013 .

[38]  George Lindfield,et al.  Numerical Methods Using MATLAB , 1998 .

[39]  Long Cheng,et al.  Toward Patients’ Motion Intention Recognition: Dynamics Modeling and Identification of iLeg—An LLRR Under Motion Constraints , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[40]  José Mario Martínez,et al.  Handling infeasibility in a large-scale nonlinear optimization algorithm , 2012, Numerical Algorithms.

[41]  Neculai Andrei,et al.  On three-term conjugate gradient algorithms for unconstrained optimization , 2013, Appl. Math. Comput..