A One-Layer Recurrent Neural Network for Pseudoconvex Optimization Subject to Linear Equality Constraints

In this paper, a one-layer recurrent neural network is presented for solving pseudoconvex optimization problems subject to linear equality constraints. The global convergence of the neural network can be guaranteed even though the objective function is pseudoconvex. The finite-time state convergence to the feasible region defined by the equality constraints is also proved. In addition, global exponential convergence is proved when the objective function is strongly pseudoconvex on the feasible region. Simulation results on illustrative examples and application on chemical process data reconciliation are provided to demonstrate the effectiveness and characteristics of the neural network.

[1]  Jun Wang,et al.  A Novel Recurrent Neural Network for Solving Nonlinear Optimization Problems With Inequality Constraints , 2008, IEEE Transactions on Neural Networks.

[2]  Qingshan Liu,et al.  A One-Layer Recurrent Neural Network for Non-smooth Convex Optimization Subject to Linear Equality Constraints , 2009, ICONIP.

[3]  Jose A. Romagnoli,et al.  Data Processing and Reconciliation for Chemical Process Operations , 1999 .

[4]  Carl Olsson,et al.  Generalized Convexity in Multiple View Geometry , 2010, Journal of Mathematical Imaging and Vision.

[5]  Shubao Liu,et al.  A Simplified Dual Neural Network for Quadratic Programming With Its KWTA Application , 2006, IEEE Transactions on Neural Networks.

[6]  J. Ponstein,et al.  Seven kinds of convexity , 1967 .

[7]  Jun Wang,et al.  A recurrent neural network for solving nonlinear convex programs subject to linear constraints , 2005, IEEE Transactions on Neural Networks.

[8]  J. Cortés.  Discontinuous dynamical systems , 2008, IEEE Control Systems.

[9]  Qingshan Liu,et al.  Finite-Time Convergent Recurrent Neural Network With a Hard-Limiting Activation Function for Constrained Optimization With Piecewise-Linear Objective Functions , 2011, IEEE Transactions on Neural Networks.

[10]  Katta G. Murty,et al.  Nonlinear Programming Theory and Algorithms , 2007, Technometrics.

[11]  Danchi Jiang,et al.  A Lagrangian network for kinematic control of redundant robot manipulators , 1999, IEEE Trans. Neural Networks.

[12]  Shengwei Zhang,et al.  Lagrange programming neural networks , 1992 .

[13]  R. Serth,et al.  Gross error detection and data reconciliation in steam-metering systems , 1986 .

[14]  Zdzisław Denkowski,et al.  Set-Valued Analysis , 2021 .

[15]  Qingshan Liu,et al.  A One-Layer Recurrent Neural Network with a Discontinuous Activation Function for Linear Programming , 2008, Neural Computation.

[16]  N. Maratos,et al.  Non-feasible gradient projection recurrent neural network for equality constrained optimization , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[17]  Long Cheng,et al.  Recurrent Neural Network for Non-Smooth Convex Optimization Problems With Application to the Identification of Genetic Regulatory Networks , 2011, IEEE Transactions on Neural Networks.

[18]  O. Mangasarian.  PSEUDO-CONVEX FUNCTIONS , 1965 .

[19]  Xiaolin Hu,et al.  Design of Recurrent Neural Networks for Solving Constrained Least Absolute Deviation Problems , 2010, IEEE Transactions on Neural Networks.

[20]  Laura Carosi,et al.  Some Classes of Pseudoconvex Fractional Functions via the Charnes-Cooper Transformation , 2007 .

[21]  I. Stancu-Minasian.  Nonlinear Fractional Programming , 1997 .

[22]  G. Gladwell,et al.  Solid mechanics and its applications , 1990 .

[23]  Xiaolin Hu,et al.  Solving Pseudomonotone Variational Inequalities and Pseudoconvex Optimization Problems Using the Projection Neural Network , 2006, IEEE Transactions on Neural Networks.

[24]  D. Himmelblau,et al.  Optimization of Chemical Processes , 1987 .

[25]  Nicholas G. Maratos,et al.  A Nonfeasible Gradient Projection Recurrent Neural Network for Equality-Constrained Optimization Problems , 2008, IEEE Transactions on Neural Networks.

[26]  Siegfried Schaible,et al.  On strong pseudomonotonicity and (semi)strict quasimonotonicity , 1993 .

[27]  Ferenc Forgó,et al.  Fixed Point and Equilibrium Theorems in Pseudoconvex and Related Spaces , 1999, J. Glob. Optim..

[28]  Shengwei Zhang,et al.  Second-order neural nets for constrained optimization , 1992, IEEE Trans. Neural Networks.

[29]  W. A. Heenan,et al.  DETECTION OF GROSS ERRORS IN NONLINEARLY CONSTRAINED DATA: A CASE STUDY , 1987 .

[30]  Derya B. Özyurt,et al.  Theory and practice of simultaneous data reconciliation and gross error detection for chemical processes , 2004, Comput. Chem. Eng..

[31]  J. P. Lasalle.  Some Extensions of Liapunov's Second Method , 1960 .

[32]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[33]  Qingshan Liu,et al.  A One-Layer Recurrent Neural Network With a Discontinuous Hard-Limiting Activation Function for Quadratic Programming , 2008, IEEE Transactions on Neural Networks.

[34]  Jun Wang,et al.  A deterministic annealing neural network for convex programming , 1994, Neural Networks.

[35]  S. Karamardian,et al.  Seven kinds of monotone maps , 1990 .

[36]  Jun Wang,et al.  A neurodynamic optimization approach to constrained sparsity maximization based on alternative objective functions , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[37]  A. Bacciotti,et al.  Stability and Stabilization of Discontinuous Systems and Nonsmooth Lyapunov Functions , 1999 .

[38]  Jun Wang,et al.  A projection neural network and its application to constrained optimization problems , 2002 .

[39]  Xiaolin Hu,et al.  Design of General Projection Neural Networks for Solving Monotone Linear Variational Inequalities and Linear and Quadratic Optimization Problems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[40]  Jun Wang,et al.  A recurrent neural network with exponential convergence for solving convex quadratic program and related linear piecewise equations , 2004, Neural Networks.

[41]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[42]  Mauro Forti,et al.  Generalized neural network for nonsmooth nonlinear programming problems , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[43]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[44]  James F. Davis,et al.  Gross error detection when variance-covariance matrices are unknown , 1993 .

[45]  Qingshan Liu,et al.  A Recurrent Neural Network for Non-smooth Convex Programming Subject to Linear Equality and Bound Constraints , 2006, ICONIP.