Linear Simultaneous Equations' Neural Solution and Its Application to Convex Quadratic Programming with Equality-Constraint

A gradient-based neural network (GNN) is improved and presented for the linear algebraic equation solving. Then, such a GNN model is used for the online solution of the convex quadratic programming (QP) with equality-constraints under the usage of Lagrangian function and Karush-Kuhn-Tucker (KKT) condition. According to the electronic architecture of such a GNN, it is known that the performance of the presented GNN could be enhanced by adopting different activation function arrays and/or design parameters. Computer simulation results substantiate that such a GNN could obtain the accurate solution of the QP problem with an effective manner.

[1]  Ke Chen.  Robustness analysis of Wang neural network for online linear equation solving , 2012 .

[2]  Chenfu Yi,et al.  Comparison on neural solvers for the Lyapunov matrix equation with stationary & nonstationary coefficients , 2013 .

[3]  Jun Wang,et al.  A recurrent neural network for solving Sylvester equation with time-varying coefficients , 2002, IEEE Trans. Neural Networks.

[4]  Samuel Burer,et al.  A finite branch-and-bound algorithm for nonconvex quadratic programming via semidefinite relaxations , 2008, Math. Program..

[5]  Jun Wang,et al.  Electronic realisation of recurrent neural network for solving simultaneous linear equations , 1992 .

[6]  Yunong Zhang,et al.  Simulation and verification of Zhang neural network for online time-varying matrix inversion , 2009, Simul. Model. Pract. Theory.

[7]  Mohammad Ali Ghorbani,et al.  A probe into the chaotic nature of daily streamflow time series by correlation dimension and largest Lyapunov methods , 2010 .

[8]  Panpan Liu,et al.  On the Positive Definite Solutions of a Nonlinear Matrix Equation , 2013, J. Appl. Math..

[9]  Yunong Zhang,et al.  Analogue recurrent neural network for linear algebraic equation solving , 2008 .

[10]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[11]  Feng Ding,et al.  Gradient Based Iterative Algorithms for Solving a Class of Matrix Equations , 2005, IEEE Trans. Autom. Control..

[12]  Narin Petrot.  Some Existence Theorems for Nonconvex Variational Inequalities Problems , 2010 .

[13]  Chaitali Chakrabarti,et al.  Energy-Efficient Video Transmission Over a Wireless Link , 2009, IEEE Transactions on Vehicular Technology.

[14]  Zdenek Dostál,et al.  An Optimal Algorithm for Minimization of Quadratic Functions with Bounded Spectrum Subject to Separable Convex Inequality and Linear Equality Constraints , 2010, SIAM J. Optim..

[15]  Jun Wang,et al.  Global exponential stability of recurrent neural networks for synthesizing linear feedback control systems via pole assignment , 2002, IEEE Trans. Neural Networks.

[16]  Shouming Zhong,et al.  Neural-Network-Based Approach for Extracting Eigenvectors and Eigenvalues of Real Normal Matrices and Some Extension to Real Matrices , 2013, J. Appl. Math..

[17]  Yunong Zhang,et al.  Exploiting Hessian matrix and trust-region algorithm in hyperparameters estimation of Gaussian process , 2005, Appl. Math. Comput..