Time Complexity Analysis of Support Vector Machines (SVM) in LibSVM

Support Vector Machines (SVM) is one of machine learning methods that can be used to perform classification task. Many researchers using SVM library to accelerate their research development. Using such a library will save their time and avoid to write codes from scratch. LibSVM is one of SVM library that has been widely used by researchers to solve their problems. The library also integrated to WEKA, one of popular Data Mining tools. This article contain results of our work related to complexity analysis of Support Vector Machines. Our work has focus on SVM algorithm and its implementation in LibSVM. We also using two popular programming languages i.e C++ and Java with three different dataset to test our analysis and experiment. The results of our research has proved that the complexity of SVM (LibSVM) is O(n3) and the time complexity shown that C++ faster than Java, both in training and testing, beside that the data growth will be affect and increase the time of computation.

[1]  Jason Weston,et al.  Multi-Class Support Vector Machines , 1998 .

[2]  Wanli Liu,et al.  A fuzzy rough support vector regression machine , 2012, 2012 9th International Conference on Fuzzy Systems and Knowledge Discovery.

[3]  Dell Zhang,et al.  Question classification using support vector machines , 2003, SIGIR.

[4]  R. Brereton,et al.  Support vector machines for classification and regression. , 2010, The Analyst.

[5]  JinXing Che.  Support vector regression based on optimal training subset and adaptive particle swarm optimization algorithm , 2013, Appl. Soft Comput..

[6]  Sonali Agarwal,et al.  Weighted support vector regression approach for remote healthcare monitoring , 2011, 2011 International Conference on Recent Trends in Information Technology (ICRTIT).

[7]  J. Wade Davis,et al.  Statistical Pattern Recognition , 2003, Technometrics.

[8]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[9]  Hassiba Nemmour,et al.  Multi-Class SVMs Based on Fuzzy Integral Mixture for Handwritten Digit Recognition , 2006, Geometric Modeling and Imaging--New Trends (GMAI'06).

[10]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[11]  Weimin Huang,et al.  Weighted Support Vector Regression Algorithm Based on Data Description , 2008, 2008 ISECS International Colloquium on Computing, Communication, Control, and Management.

[12]  Johan A. K. Suykens,et al.  Weighted least squares support vector machines: robustness and sparse approximation , 2002, Neurocomputing.

[13]  Peng Zhang,et al.  ε-Proximal support vector machine for binary classification and its application in vehicle recognition , 2015, Neurocomputing.

[14]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[15]  Divya Tomar,et al.  Prediction of Profitability of Industries using Weighted SVR , 2011 .

[16]  Michael Rabadi,et al.  Kernel Methods for Machine Learning , 2015 .

[17]  Ivor W. Tsang,et al.  Core Vector Machines: Fast SVM Training on Very Large Data Sets , 2005, J. Mach. Learn. Res..

[18]  S. Gunn.  Support Vector Machines for Classification and Regression , 1998 .

[19]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[20]  G. Wahba,et al.  Multicategory Support Vector Machines , Theory , and Application to the Classification of Microarray Data and Satellite Radiance Data , 2004 .