A recurrent neural network for solving a class of generalized convex optimization problems

In this paper, we propose a penalty-based recurrent neural network for solving a class of constrained optimization problems with generalized convex objective functions. The model has a simple structure described by using a differential inclusion. It is also applicable for any nonsmooth optimization problem with affine equality and convex inequality constraints, provided that the objective function is regular and pseudoconvex on feasible region of the problem. It is proven herein that the state vector of the proposed neural network globally converges to and stays thereafter in the feasible region in finite time, and converges to the optimal solution set of the problem.

[1]  Qingshan Liu,et al.  A One-Layer Recurrent Neural Network for Pseudoconvex Optimization Subject to Linear Equality Constraints , 2011, IEEE Transactions on Neural Networks.

[2]  Jun Wang,et al.  A deterministic annealing neural network for convex programming , 1994, Neural Networks.

[3]  Youshen Xia.  A new neural network for solving linear programming problems and its application , 1996, IEEE Trans. Neural Networks.

[4]  K. Arrow,et al.  Handbook of Mathematical Economics , 1983 .

[5]  Jun Wang,et al.  A Novel Recurrent Neural Network for Solving Nonlinear Optimization Problems With Inequality Constraints , 2008, IEEE Transactions on Neural Networks.

[6]  Sardar M. N. Islam,et al.  Some Extensions of Nonconvex Economic Modeling: Invexity, Quasimax, and New Stability Conditions , 2005 .

[7]  Qingshan Liu,et al.  A one-layer recurrent neural network for constrained pseudoconvex optimization and its application for dynamic portfolio optimization , 2012, Neural Networks.

[8]  Seyed Mohammad Hosseini,et al.  A New Steepest Descent Differential Inclusion-Based Method for Solving General Nonsmooth Convex Optimization Problems , 2013, J. Optim. Theory Appl..

[9]  Shubao Liu,et al.  A Simplified Dual Neural Network for Quadratic Programming With Its KWTA Application , 2006, IEEE Transactions on Neural Networks.

[10]  Schrutka.  Geometrie der Zahlen , 1911 .

[11]  Wei Bian,et al.  Subgradient-Based Neural Networks for Nonsmooth Nonconvex Optimization Problems , 2009, IEEE Transactions on Neural Networks.

[12]  Youshen Xia,et al.  Neural network for solving linear programming problems with bounded variables , 1995, IEEE Trans. Neural Networks.

[13]  F. Clarke.  Optimization And Nonsmooth Analysis , 1983 .

[14]  Danchi Jiang,et al.  A Lagrangian network for kinematic control of redundant robot manipulators , 1999, IEEE Trans. Neural Networks.

[15]  Xiaojun Chen,et al.  Minimizing the Condition Number of a Gram Matrix , 2011, SIAM J. Optim..

[16]  Jun Wang,et al.  A General Projection Neural Network for Solving Monotone Variational Inequalities and Related Optimization Problems , 2004 .

[17]  Majid Soleimani-damaneh,et al.  A differential inclusion-based approach for solving nonsmooth convex optimization problems , 2013 .

[18]  Leon O. Chua,et al.  Neural networks for nonlinear programming , 1988 .

[19]  J. Jensen.  Sur les fonctions convexes et les inégalités entre les valeurs moyennes , 1906 .

[20]  Mauro Forti,et al.  Generalized neural network for nonsmooth nonlinear programming problems , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[21]  Qingshan Liu,et al.  A One-Layer Projection Neural Network for Nonsmooth Optimization Subject to Linear Equalities and Bound Constraints , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[22]  J. Aubin,et al.  Differential inclusions set-valued maps and viability theory , 1984 .

[23]  Jun Wang,et al.  A general projection neural network for solving monotone variational inequalities and related optimization problems , 2004, IEEE Transactions on Neural Networks.

[24]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[25]  Jun Wang,et al.  A recurrent neural network for solving nonlinear convex programs subject to linear constraints , 2005, IEEE Transactions on Neural Networks.

[26]  Jun Wang,et al.  A One-Layer Recurrent Neural Network for Constrained Nonsmooth Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[27]  Jun Wang,et al.  A recurrent neural network with exponential convergence for solving convex quadratic program and related linear piecewise equations , 2004, Neural Networks.

[28]  Jane J. Ye,et al.  Optimizing Condition Numbers , 2009, SIAM J. Optim..

[29]  Jun Wang,et al.  A projection neural network and its application to constrained optimization problems , 2002 .

[30]  Elena Molho,et al.  The origins of quasi-concavity: a development between mathematics and economics , 2004 .

[31]  Cheng Wu,et al.  Generalized gradient projection neural networks for nonsmooth optimization problems , 2010, Science China Information Sciences.