A neural network model for solving convex quadratic programming problems with some applications

Abstract This paper presents a capable neural network for solving strictly convex quadratic programming (SCQP) problems with general linear constraints. The proposed neural network model is stable in the sense of Lyapunov and can converge to an exact optimal solution of the original problem. A block diagram of the proposed model is also given. Several applicable examples further show the correctness of the results and the good performance of the model.

[1]  Jun Wang,et al.  A general projection neural network for solving monotone variational inequalities and related optimization problems , 2004, IEEE Transactions on Neural Networks.

[2]  S. Effati,et al.  A novel recurrent nonlinear neural network for solving quadratic programming problems , 2011 .

[3]  You-Ping Chen,et al.  An Improved Neural Network for Solving Optimization of Quadratic Programming Problems , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[4]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[5]  Jinde Cao,et al.  A simple and high performance neural network for quadratic programming problems , 2001, Appl. Math. Comput..

[6]  Leon O. Chua,et al.  Neural networks for nonlinear programming , 1988 .

[7]  Kwong-Sak Leung,et al.  A new gradient-based neural network for solving linear and quadratic programming problems , 2001, IEEE Trans. Neural Networks.

[8]  Jun Wang,et al.  A one-layer recurrent neural network for support vector machine learning , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Alireza Nazemi.  A dynamical model for solving degenerate quadratic minimax problems with constraints , 2011, J. Comput. Appl. Math..

[10]  Stefen Hui,et al.  On solving constrained optimization problems with neural networks: a penalty method approach , 1993, IEEE Trans. Neural Networks.

[11]  Wei Bian,et al.  A project neural network for solving degenerate convex quadratic program , 2007, Neurocomputing.

[12]  Xiaolin Hu,et al.  Design of General Projection Neural Networks for Solving Monotone Linear Variational Inequalities and Linear and Quadratic Optimization Problems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[14]  Jun Wang,et al.  A recurrent neural network with exponential convergence for solving convex quadratic program and related linear piecewise equations , 2004, Neural Networks.

[15]  Jun Wang,et al.  A recurrent neural network for solving linear projection equations , 2000, Neural Networks.

[16]  Xiaolin Hu,et al.  Applications of the general projection neural network in solving extended linear-quadratic programming problems with linear constraints , 2009, Neurocomputing.

[17]  Huang Yuancan,et al.  A Novel Method to Handle Inequality Constraints for Convex Programming Neural Network , 2002, Neural Processing Letters.

[18]  Li-Zhi Liao,et al.  A Novel Neural Network for a Class of Convex Quadratic Minimax Problems , 2006, Neural Computation.

[19]  Jinde Cao,et al.  Global exponential stability of discrete-time recurrent neural network for solving quadratic programming problems subject to linear constraints , 2011, Neurocomputing.

[20]  Davide Anguita,et al.  Improved neural network for SVM learning , 2002, IEEE Trans. Neural Networks.

[21]  J. Hale,et al.  Ordinary Differential Equations , 2019, Fundamentals of Numerical Mathematics for Physicists and Engineers.

[22]  Walter Engevald Lillo.  Solving constrained optimization problems with neural networks , 1992 .

[23]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[24]  W K Chen,et al.  A high-performance neural network for solving linear and quadratic programming problems , 1996, IEEE Trans. Neural Networks.

[25]  Sunil K. Agrawal,et al.  Optimization of Dynamic Systems , 1999 .

[26]  Sohrab Effati,et al.  Neural network models and its application for solving linear and quadratic programming problems , 2006, Appl. Math. Comput..

[27]  Qingshan Liu,et al.  A One-Layer Recurrent Neural Network With a Discontinuous Hard-Limiting Activation Function for Quadratic Programming , 2008, IEEE Transactions on Neural Networks.

[28]  Wei Bian,et al.  A project neural network for solving degenerate quadratic minimax problem with linear constraints , 2009, Neurocomputing.

[29]  Michael A. Shanblatt,et al.  Linear and quadratic programming neural network analysis , 1992, IEEE Trans. Neural Networks.

[30]  Shengwei Zhang,et al.  Lagrange programming neural networks , 1992 .

[31]  Zhong Chen,et al.  A neural network for solving a convex quadratic bilevel programming problem , 2010, J. Comput. Appl. Math..

[32]  Robert L. Fry,et al.  Observer-participant models of neural processing , 1995, IEEE Trans. Neural Networks.

[33]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[34]  Gerardo Toraldo,et al.  On the Solution of Large Quadratic Programming Problems with Bound Constraints , 1991, SIAM J. Optim..

[35]  Youshen Xia,et al.  A new neural network for solving linear and quadratic programming problems , 1996, IEEE Trans. Neural Networks.

[36]  Youshen Xia,et al.  A recurrent neural network for nonlinear convex optimization subject to nonlinear inequality constraints , 2004, IEEE Trans. Circuits Syst. I Regul. Pap..

[37]  Youshen Xia,et al.  An improved neural network for convex quadratic optimization with application to real-time beamforming , 2005, Neurocomputing.

[38]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[39]  Jun Wang,et al.  Primal neural networks for solving convex quadratic programs , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[40]  Mordecai Avriel,et al.  Nonlinear programming , 1976 .

[41]  Li-Zhi Liao,et al.  A New One-Layer Neural Network for Linear and Quadratic Programming , 2010, IEEE Transactions on Neural Networks.

[42]  Gang Feng,et al.  Solving convex quadratic programming problems by an modified neural network with exponential convergence , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.

[43]  Yunong Zhang,et al.  Performance analysis of gradient neural network exploited for online time-varying quadratic minimization and equality-constrained quadratic programming , 2011, Neurocomputing.

[44]  N. Huang,et al.  A new class of interval projection neural networks for solving interval quadratic program , 2008 .