A Discrete-Time Neural Network for Optimization Problems With Hybrid Constraints

Recurrent neural networks have become a prominent tool for optimizations including linear or nonlinear variational inequalities and programming, due to its regular mathematical properties and well-defined parallel structure. This brief presents a general discrete-time recurrent network for linear variational inequalities and related optimization problems with hybrid constraints. In contrary to the existing discrete-time networks, this general model can operate not only on bound constraints, but also on hybrid constraints comprised of inequality, equality and bound constraints. The model has dynamical properties of global convergence, asymptotical and exponential convergences under some weaker conditions. Numerical examples demonstrate its efficacy and performance.

[1]  Patrick T. Harker,et al.  Finite-dimensional variational inequality and nonlinear complementarity problems: A survey of theory, algorithms and applications , 1990, Math. Program..

[2]  Lihong Huang,et al.  Global asymptotic stability of delayed neural networks with discontinuous neuron activations , 2009, Neurocomputing.

[3]  Xue-Bin Liang,et al.  A recurrent neural network for nonlinear continuously differentiable optimization over a compact convex subset , 2001, IEEE Trans. Neural Networks.

[4]  Abdesselam Bouzerdoum,et al.  Neural network for quadratic optimization with bound constraints , 1993, IEEE Trans. Neural Networks.

[5]  Meiqin Liu,et al.  Delayed Standard Neural Network Models for Control Systems , 2007, IEEE Transactions on Neural Networks.

[6]  A. Tesi,et al.  New conditions for global stability of neural networks with application to linear and quadratic programming problems , 1995 .

[7]  Leon O. Chua,et al.  Neural networks for nonlinear programming , 1988 .

[8]  Stefen Hui,et al.  Solving linear programming problems with neural networks: a comparative study , 1995, IEEE Trans. Neural Networks.

[9]  Xiaolin Hu,et al.  Design of General Projection Neural Networks for Solving Monotone Linear Variational Inequalities and Linear and Quadratic Optimization Problems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  J. Pang,et al.  On a Generalization of a Normal Map and Equation , 1995 .

[11]  Fengjian Yang,et al.  Exponential stability of a class of impulsive neural networks with variable delays , 2009, 2009 IEEE International Conference on Automation and Logistics.

[12]  Vu Ngoc Phat.  New stabilization criteria for linear time-varying systems with state delay and norm-bounded uncertainties , 2002, IEEE Trans. Autom. Control..

[13]  Qunjing Wang,et al.  Global Robust Stabilizing Control for a Dynamic Neural Network System , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[14]  B. Curtis Eaves,et al.  On the basic theorem of complementarity , 1971, Math. Program..

[15]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[16]  Jun Wang,et al.  A recurrent neural network for nonlinear optimization with a continuously differentiable objective function and bound constraints , 2000, IEEE Trans. Neural Networks Learn. Syst..

[17]  Jun Wang,et al.  A general projection neural network for solving monotone variational inequalities and related optimization problems , 2004, IEEE Transactions on Neural Networks.

[18]  K. Gu.  An integral inequality in the stability problem of time-delay systems , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[19]  Malur K. Sundareshan,et al.  Exponential stability and a systematic synthesis of a neural network for quadratic minimization , 1991, Neural Networks.

[20]  Xiaolin Hu,et al.  A Recurrent Neural Network for Solving a Class of General Variational Inequalities , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Bingsheng He,et al.  A neural network model for monotone linear asymmetric variational inequalities , 2000, IEEE Trans. Neural Networks Learn. Syst..

[22]  Guanrong Chen,et al.  LMI-based approach for asymptotically stability analysis of delayed neural networks , 2002 .

[23]  María José Pérez-Ilzarbe.  Convergence analysis of a discrete-time recurrent neural network to perform quadratic real optimization with bound constraints , 1998, IEEE Trans. Neural Networks.

[24]  Xiaofeng Liao,et al.  Robust stability for interval Hopfield neural networks with time delay , 1998, IEEE Trans. Neural Networks.

[25]  Zhang Yi,et al.  Estimate of exponential convergence rate and exponential stability for neural networks , 1999, IEEE Trans. Neural Networks.

[26]  Xin-Ping Guan,et al.  Output Feedback Stabilization for Time-Delay Nonlinear Interconnected Systems Using Neural Networks , 2008, IEEE Transactions on Neural Networks.

[27]  Xuvans Lou,et al.  On Robust Stabilization of A Class of Neural Networks with Time-Varying Delays , 2006, 2006 International Conference on Computational Intelligence and Security.

[28]  Jun Wang,et al.  Global exponential stability of recurrent neural networks for solving optimization and related problems , 2000, IEEE Trans. Neural Networks Learn. Syst..

[29]  Kay Chen Tan,et al.  Global exponential stability of discrete-time neural networks for constrained quadratic optimization , 2004, Neurocomputing.

[30]  Liqun Qi,et al.  A novel neural network for variational inequalities with linear and nonlinear constraints , 2005, IEEE Transactions on Neural Networks.

[31]  Michael A. Shanblatt,et al.  Linear and quadratic programming neural network analysis , 1992, IEEE Trans. Neural Networks.

[32]  Jun Wang,et al.  A projection neural network and its application to constrained optimization problems , 2002 .

[33]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[34]  Daniel W. C. Ho,et al.  Pinning Stabilization of Linearly Coupled Stochastic Neural Networks via Minimum Number of Controllers , 2009, IEEE Transactions on Neural Networks.

[35]  Jun Wang,et al.  Global exponential periodicity and global exponential stability of a class of recurrent neural networks with various activation functions and time-varying delays , 2007, Neural Networks.