VLSI Design of an SVM Learning Core on Sequential Minimal Optimization Algorithm

The sequential minimal optimization (SMO) algorithm has been extensively employed to train the support vector machine (SVM). This work presents an efficient application specific integrated circuit chip design for sequential minimal optimization. This chip is implemented as an intellectual property core, suitable for use in an SVM-based recognition system on a chip. The proposed SMO chip was tested and found to be fully functional, using a prototype system based on the Altera DE2 board with a Cyclone II 2C70 field-programmable gate array.

[1]  Chih-Jen Lin,et al.  The analysis of decomposition methods for support vector machines , 2000, IEEE Trans. Neural Networks Learn. Syst..

[2]  Ta-Wen Kuan,et al.  Ubiquitous and Robust Text-Independent Speaker Recognition for Home Automation Digital Life , 2008, UIC.

[3]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[4]  Paul E. Hasler,et al.  Analog VLSI implementation of support vector machine learning and classification , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[5]  Ta-Wen Kuan,et al.  VLSI design of sequential minimal optimization algorithm for SVM learning , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[6]  Chih-Jen Lin,et al.  A Study on SMO-Type Decomposition Methods for Support Vector Machines , 2006, IEEE Transactions on Neural Networks.

[7]  Jun Guo,et al.  Global Convergence of SMO Algorithm for Support Vector Regression , 2008, IEEE Transactions on Neural Networks.

[8]  Davide Anguita,et al.  A digital architecture for support vector machines: theory, algorithm, and FPGA implementation , 2003, IEEE Trans. Neural Networks.

[9]  Gert Cauwenberghs,et al.  Silicon Support Vector Machine with On-Line Learning , 2003, Int. J. Pattern Recognit. Artif. Intell..

[10]  S. Sathiya Keerthi,et al.  Which Is the Best Multiclass SVM Method? An Empirical Study , 2005, Multiple Classifier Systems.

[11]  Hui-Ling Huang,et al.  ESVM: Evolutionary support vector machine for automatic feature selection and classification of microarray data , 2007, Biosyst..

[12]  S. Sathiya Keerthi,et al.  Improvements to Platt's SMO Algorithm for SVM Classifier Design , 2001, Neural Computation.

[13]  Gert Cauwenberghs,et al.  Kerneltron: Support Vector 'Machine' in Silicon , 2002, SVM.

[14]  Alex Acero,et al.  Spoken Language Processing: A Guide to Theory, Algorithm and System Development , 2001 .

[15]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[16]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[17]  Christos-Savvas Bouganis,et al.  A scalable FPGA architecture for non-linear SVM training , 2008, 2008 International Conference on Field-Programmable Technology.

[18]  Gert Cauwenberghs,et al.  Sub-Microwatt Analog VLSI Support Vector Machine for Pattern Classification and Sequence Estimation , 2004, NIPS.

[19]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[20]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[21]  Kurt Keutzer,et al.  Fast support vector machine training and classification on graphics processors , 2008, ICML '08.

[22]  Norikazu Takahashi,et al.  Rigorous proof of termination of SMO algorithm for support vector Machines , 2005, IEEE Transactions on Neural Networks.

[23]  Alain Billionnet,et al.  Using a Mixed Integer Quadratic Programming Solver for the Unconstrained Quadratic 0-1 Problem , 2007, Math. Program..

[24]  J. Platt.  Sequential Minimal Optimization : A Fast Algorithm for Training Support Vector Machines , 1998 .

[25]  Hua-feng Chen,et al.  A parallel and scalable digital architecture for training support vector machines , 2009, Journal of Zhejiang University SCIENCE C.

[26]  Federico Girosi,et al.  Support Vector Machines: Training and Applications , 1997 .

[27]  Shantanu Chakrabartty,et al.  An Energy-Scalable Margin Propagation-Based Analog VLSI Support Vector Machine , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[28]  B. Venkataramani,et al.  FPGA Implementation of Support Vector Machine Based Isolated Digit Recognition System , 2009, 2009 22nd International Conference on VLSI Design.

[29]  John C. Platt.  Using Analytic QP and Sparseness to Speed Training of Support Vector Machines , 1998, NIPS.

[30]  Steve Renals,et al.  Speaker verification using sequence discriminant support vector machines , 2005, IEEE Transactions on Speech and Audio Processing.

[31]  William M. Campbell,et al.  Speaker Verification Using Support Vector Machines and High-Level Features , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[32]  S. Chakrabartty,et al.  Sub-Microwatt Analog VLSI Trainable Pattern Classifier , 2007, IEEE Journal of Solid-State Circuits.

[33]  Davide Anguita,et al.  Learning algorithm for nonlinear support vector machines suited for digital VLSI , 1999 .

[34]  J. Bunch,et al.  A computational method for the indefinite quadratic programming problem , 1980 .

[35]  Edward Y. Chang,et al.  Using one-class and two-class SVMs for multiclass image annotation , 2005, IEEE Transactions on Knowledge and Data Engineering.

[36]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[37]  Horacio Lamela,et al.  An analogue circuit for sequential minimal optimization for support vector machines , 2008, SPIE Defense + Commercial Sensing.