A one-layer discrete-time projection neural network for support vector classification

This paper presents a one-layer discrete-time projection neural network described by difference equations for real-time support vector classification (SVC). The SVC is first formulated as a convex quadratic programming problem, and then a recurrent neural network with one-layer structure is designed for training the support vector machine. Furthermore, simulation results on two illustrative examples are given to demonstrate the effectiveness and performance of the proposed neural network.

[1]  D. Kinderlehrer,et al.  An introduction to variational inequalities and their applications , 1980 .

[2]  R. Ruth,et al.  Stability of dynamical systems , 1988 .

[3]  S. Sathiya Keerthi,et al.  A Modified Finite Newton Method for Fast Solution of Large Scale Linear SVMs , 2005, J. Mach. Learn. Res..

[4]  Jun Wang,et al.  A Novel Recurrent Neural Network for Solving Nonlinear Optimization Problems With Inequality Constraints , 2008, IEEE Transactions on Neural Networks.

[5]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[6]  J Wang,et al.  Analysis and design of primal-dual assignment networks , 1998, IEEE Trans. Neural Networks.

[7]  Olvi L. Mangasarian,et al.  A Finite Newton Method for Classi cation Problems , 2001 .

[8]  Jun Wang,et al.  A projection neural network and its application to constrained optimization problems , 2002 .

[9]  Xiaolin Hu,et al.  An Alternative Recurrent Neural Network for Solving Variational Inequalities and Related Optimization Problems , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Katta G. Murty,et al.  Nonlinear Programming Theory and Algorithms , 2007, Technometrics.

[11]  Olvi L. Mangasarian,et al.  A finite newton method for classification , 2002, Optim. Methods Softw..

[12]  Leon O. Chua,et al.  Neural networks for nonlinear programming , 1988 .

[13]  Qingshan Liu,et al.  A One-Layer Recurrent Neural Network for Pseudoconvex Optimization Subject to Linear Equality Constraints , 2011, IEEE Transactions on Neural Networks.

[14]  Jinde Cao,et al.  A Novel Recurrent Neural Network With One Neuron and Finite-Time Convergence for $k$-Winners-Take-All Operation , 2010, IEEE Transactions on Neural Networks.

[15]  Qingshan Liu,et al.  A One-Layer Projection Neural Network for Nonsmooth Optimization Subject to Linear Equalities and Bound Constraints , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Abdesselam Bouzerdoum,et al.  Neural network for quadratic optimization with bound constraints , 1993, IEEE Trans. Neural Networks.

[17]  Jinde Cao,et al.  A Novel Recurrent Neural Network with Finite-Time Convergence for Linear Programming , 2010, Neural Computation.

[18]  Jinde Cao,et al.  Global exponential stability of discrete-time recurrent neural network for solving quadratic programming problems subject to linear constraints , 2011, Neurocomputing.

[19]  Yongqing Yang,et al.  Global exponential system of projection neural networks for system of generalized variational inequalities and related nonlinear minimax problems , 2010, Neurocomputing.

[20]  Michael A. Shanblatt,et al.  Linear and quadratic programming neural network analysis , 1992, IEEE Trans. Neural Networks.

[21]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[22]  Jun Wang,et al.  A deterministic annealing neural network for convex programming , 1994, Neural Networks.

[23]  Jun Wang,et al.  A one-layer recurrent neural network for support vector machine learning , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[25]  Mauro Forti,et al.  Generalized neural network for nonsmooth nonlinear programming problems , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[26]  Qingshan Liu,et al.  A One-Layer Recurrent Neural Network With a Discontinuous Hard-Limiting Activation Function for Quadratic Programming , 2008, IEEE Transactions on Neural Networks.