SVM-Like Algorithms and Architectures for Embedded Computational Intelligence

This paper considers implementation of computational intelligence paradigms on resource-constrained platforms, an issue of the day for the age of invisible computing and smart sensors. This necessitates the development of ``light'' yet efficient hardware-friendly algorithms relying on a scanty power supplies and able to operate in stand-alone manner. The scope of the presented work is twofold. Firstly, we propose a new SVM-like approximated algorithm suitable for embedded systems due to good robustness and sparsity properties. Support vectors are considered as parameters of the outer optimization problem, whereas the inner one is solved using the primal representation, which reduces computational complexity and memory usage. Along with classical Gaussian kernel, a recently proposed hardware-friendly kernel, whose calculation requires only shift and add operations, is considered. Experimental results on several well-known data sets demonstrate the validity of the proposed approach, which in many cases outperforms the original RSVM using the same number of vectors. Secondly, we implement such kind of algorithm on a resource-constrained device such as a simple 8-bit microcontroller. The case-study considered further in this work is the design of a node of a wireless video-sensor network performing people detection, and a simple resource-constrained FPSLIC-based platform from Atmel is considered as a target device.

[1]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[2]  Matthias W. Seeger,et al.  Using the Nyström Method to Speed Up Kernel Machines , 2000, NIPS.

[3]  S. Sathiya Keerthi,et al.  Building Support Vector Machines with Reduced Classifier Complexity , 2006, J. Mach. Learn. Res..

[4]  Kristofer S. J. Pister,et al.  Smart Dust: Communicating with a Cubic-Millimeter Computer , 2001, Computer.

[5]  Deborah Estrin,et al.  Habitat monitoring with sensor networks , 2004, CACM.

[6]  Bernhard Schölkopf,et al.  A Direct Method for Building Sparse Kernel Learning Algorithms , 2006, J. Mach. Learn. Res..

[7]  David J. Spiegelhalter,et al.  Machine Learning, Neural and Statistical Classification , 2009 .

[8]  Yuh-Jye Lee,et al.  RSVM: Reduced Support Vector Machines , 2001, SDM.

[9]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[10]  Chih-Jen Lin,et al.  A study on reduced support vector machines , 2003, IEEE Trans. Neural Networks.

[11]  Gunnar Rätsch,et al.  Soft Margins for AdaBoost , 2001, Machine Learning.

[12]  Dariu Gavrila,et al.  An Experimental Study on Pedestrian Classification , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Yu Hen Hu,et al.  Vehicle classification in distributed sensor networks , 2004, J. Parallel Distributed Comput..

[14]  Gabor Karsai,et al.  Smart Dust: communicating with a cubic-millimeter computer , 2001 .

[15]  Bernhard Schölkopf,et al.  Building Sparse Large Margin Classifiers , 2005, ICML.

[16]  Olivier Chapelle,et al.  Training a Support Vector Machine in the Primal , 2007, Neural Computation.

[17]  T. Poggio,et al.  A Contour-Based Moving Object Detection and Tracking , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[18]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[19]  Davide Anguita,et al.  Feed-Forward Support Vector Machine Without Multipliers , 2006, IEEE Transactions on Neural Networks.

[20]  Bernhard Schölkopf,et al.  Sparse Greedy Matrix Approximation for Machine Learning , 2000, International Conference on Machine Learning.