A new neural network for l1-norm programming

This paper presents a new neural network for solving l1-norm problems with equality and box constraints by introducing a new vector. The proposed model is proved to be Lyapunov stable and converges to an exact optimal solution of the original problem for every starting point. Compared with some existing continuous-time neural networks, the proposed model has the fewest neurons and a low complexity. The simulation results show the validity and transient behavior of the proposed model.

[1]  J. P. Lasalle.  The stability of dynamical systems , 1976 .

[2]  Zhishun Wang,et al.  Robust time delay estimation of bioelectric signals using least absolute deviation neural network , 2005, IEEE Transactions on Biomedical Engineering.

[3]  Youshen Xia,et al.  A Compact Cooperative Recurrent Neural Network for Computing General Constrained $L_1$ Norm Estimators , 2009, IEEE Transactions on Signal Processing.

[4]  P. Tseng,et al.  Modified Projection-Type Methods for Monotone Variational Inequalities , 1996 .

[5]  L. Liao,et al.  A neural network for monotone variational inequalities with linear constraints , 2003 .

[6]  R. D. Murphy,et al.  Iterative solution of nonlinear equations , 1994 .

[7]  Xiaolin Hu,et al.  Design of Recurrent Neural Networks for Solving Constrained Least Absolute Deviation Problems , 2010, IEEE Transactions on Neural Networks.

[8]  Xing-Bao Gao,et al.  A novel neural network for nonlinear convex programming , 2004, IEEE Trans. Neural Networks.

[9]  Wei Bian,et al.  Neural Network for Solving Constrained Convex Optimization Problems With Global Attractivity , 2013, IEEE Transactions on Circuits and Systems I: Regular Papers.

[10]  Youshen Xia,et al.  An Extended Projection Neural Network for Constrained Optimization , 2004, Neural Computation.

[11]  Jun Wang,et al.  A One-Layer Recurrent Neural Network for Constrained Nonsmooth Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Yaqiu Liu,et al.  Neural network for nonsmooth pseudoconvex optimization with general constraints , 2014, Neurocomputing.

[13]  Yanjun Shen,et al.  Finite-time recurrent neural networks for solving nonlinear optimization problems and their application , 2016, Neurocomputing.

[14]  L. Liao,et al.  Improvements of Some Projection Methods for Monotone Nonlinear Variational Inequalities , 2002 .

[15]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[16]  J. Hopfield,et al.  Computing with neural circuits: a model. , 1986, Science.

[17]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[18]  L. Liao,et al.  A neural network for a class of convex quadratic minimax problems with constraints , 2004, IEEE Transactions on Neural Networks.

[19]  D. Kinderlehrer,et al.  An introduction to variational inequalities and their applications , 1980 .

[20]  Xiaolin Hu,et al.  Another Simple Recurrent Neural Network for Quadratic and Linear Programming , 2009, ISNN.

[21]  James A. Cadzow.  Minimum l1, l2, and l∞ Norm Approximate Solutions to an Overdetermined System of Linear Equations , 2002, Digit. Signal Process..

[22]  Jun Wang,et al.  Neural networks for solving least absolute and related problems , 1998, Neurocomputing.

[23]  Wei Xing Zheng,et al.  Discrete-Time Neural Network for Fast Solving Large Linear $L_{1}$ Estimation Problems and its Application to Image Restoration , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Chuandong Li,et al.  A recurrent neural network for optimal real-time price in smart grid , 2015, Neurocomputing.

[25]  Li-Zhi Liao,et al.  A New Projection-Based Neural Network for Constrained Variational Inequalities , 2009, IEEE Transactions on Neural Networks.

[26]  Jianfeng Hu,et al.  A neural network for ℓ1-ℓ2 minimization based on scaled gradient projection: Application to compressed sensing , 2016, Neurocomputing.

[27]  Mordecai Avriel,et al.  Nonlinear programming , 1976 .

[28]  Li-Zhi Liao,et al.  A New One-Layer Neural Network for Linear and Quadratic Programming , 2010, IEEE Transactions on Neural Networks.

[29]  J. Cheung,et al.  Minimum fuel neural networks and their applications to overcomplete signal representations , 2000 .

[30]  Mohamed S. Kamel,et al.  Cooperative Recurrent Neural Networks for the Constrained $L_{1}$ Estimator , 2007, IEEE Transactions on Signal Processing.

[31]  Edgar N. Sánchez,et al.  Real-time implementation of neural optimal control and state estimation for a linear induction motor , 2015, Neurocomputing.

[32]  Patrick T. Harker,et al.  Finite-dimensional variational inequality and nonlinear complementarity problems: A survey of theory, algorithms and applications , 1990, Math. Program..

[33]  Mila Nikolova,et al.  Fast Nonconvex Nonsmooth Minimization Methods for Image Restoration and Reconstruction , 2010, IEEE Transactions on Image Processing.

[34]  Mohamed S. Kamel,et al.  A Generalized Least Absolute Deviation Method for Parameter Estimation of Autoregressive Signals , 2008, IEEE Transactions on Neural Networks.

[35]  Amit Bhaya,et al.  Control Liapunov function design of neural networks that solve convex optimization and variational inequality problems , 2009, Neurocomputing.

[36]  Xiaolin Hu,et al.  A New Recurrent Neural Network for Solving Convex Quadratic Programming Problems With an Application to the $k$-Winners-Take-All Problem , 2009, IEEE Transactions on Neural Networks.

[37]  Xiaolin Hu,et al.  Solving Generally Constrained Generalized Linear Variational Inequalities Using the General Projection Neural Networks , 2007, IEEE Transactions on Neural Networks.

[38]  Zhishun Wang,et al.  Constrained Least Absolute Deviation Neural Networks , 2008, IEEE Transactions on Neural Networks.

[39]  Tingwen Huang,et al.  A One-Layer Recurrent Neural Network for Real-Time Portfolio Optimization With Probability Criterion , 2013, IEEE Transactions on Cybernetics.

[40]  A. Ruszczynski,et al.  Nonlinear Optimization , 2006 .

[41]  Gholam Ali Montazer,et al.  An improved radial basis function neural network for object image retrieval , 2015, Neurocomputing.

[42]  Paul Tseng,et al.  A Modified Forward-backward Splitting Method for Maximal Monotone Mappings 1 , 1998 .

[43]  Jing Wang,et al.  A Neural Network for a Class of Horizontal Linear Complementary Problems , 2011, 2011 Seventh International Conference on Computational Intelligence and Security.

[44]  Li-Zhi Liao,et al.  A Novel Neural Network for a Class of Convex Quadratic Minimax Problems , 2006, Neural Computation.