A Hybrid Approach Support Vector Machine (SVM) - Neuro Fuzzy For Fast Data Classification

In recent decade, support vector machine (SVM) was a machine learning method that widely used in several application domains. It was due to SVM has a good performance for solving data classification problems, particularly in non-linear case. Nevertheless, several studies indicated that SVM still has some inadequacies, especially the high time complexity in testing phase that is caused by increasing the number of support vector for high dimensional data. To address this problem, we propose a hybrid approach SVM – Neuro Fuzzy (SVMNF), which neuro fuzzy here is used to avoid influence of support vector in testing phase of SVM. Moreover, our approach is also equipped with a feature selection that can reduce data attributes in testing phase, so that it can improve the effectiveness of time computation. Based on our evaluation in real benchmark datasets, our approach outperformed SVM in testing phase for solving data classification problems without significantly affecting the accuracy of SVM.

[1]  Qing Li,et al.  Adaptive simplification of solution for support vector machine , 2007, Pattern Recognit..

[2]  Tao Liu,et al.  Fast pruning superfluous support vectors in SVMs , 2013, Pattern Recognit. Lett..

[3]  Sungzoon Cho,et al.  Pattern selection for support vector regression based response modeling , 2012, Expert Syst. Appl..

[4]  Christopher J. C. Burges,et al.  Simplified Support Vector Decision Rules , 1996, ICML.

[5]  Sungzoon Cho,et al.  Neighborhood PropertyBased Pattern Selection for Support Vector Machines , 2007, Neural Computation.

[6]  Krisantus Sembiring.  PENERAPAN TEKNIK SUPPORT VECTOR MACHINE UNTUK PENDETEKSIAN INTRUSI PADA JARINGAN , 2009 .

[7]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[8]  Madan Gopal,et al.  A hybrid SVM based decision tree , 2010, Pattern Recognit..

[9]  Jie Ji,et al.  A Hybrid SVM Based on Nearest Neighbor Rule , 2013, Int. J. Wavelets Multiresolution Inf. Process..

[10]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[11]  Cheng-Lin Liu,et al.  Handwritten digit recognition: benchmarking of state-of-the-art techniques , 2003, Pattern Recognit..

[12]  Atalay Barkana,et al.  Speeding up the scaled conjugate gradient algorithm and its application in neuro-fuzzy classifier training , 2009, Soft Comput..

[13]  Tom Downs,et al.  Exact Simplification of Support Vector Solutions , 2002, J. Mach. Learn. Res..

[14]  Bayram Cetisli,et al.  Development of an adaptive neuro-fuzzy classifier using linguistic hedges: Part 1 , 2010, Expert Syst. Appl..

[15]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[16]  Hang Joon Kim,et al.  Support Vector Machines for Texture Classification , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Budi Santosa,et al.  DATA MINING : Teknik Pemanfaatan Data untuk Keperluan Bisnis , 2011 .

[18]  Harris Drucker,et al.  Learning algorithms for classification: A comparison on handwritten digit recognition , 1995 .

[19]  Sungzoon Cho,et al.  Approximating support vector machine with artificial neural network for fast prediction , 2014, Expert Syst. Appl..

[20]  Mt Prof. Dr. M. Isa Irawan.  PERBANDINGAN METODE LEARNING VECTOR QUANTIZATION (LVQ) DAN SUPPORT VECTOR MACHINE (SVM) UNTUK PREDIKSI PENYAKIT JANTUNG KORONER , 2015 .

[21]  Jih Pin Yeh,et al.  Optimal reduction of solutions for support vector machines , 2009, Appl. Math. Comput..

[22]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[23]  Chen Lin,et al.  Neural Information Processing -letters and Reviews Simplify Support Vector Machines by Iterative Learning , 2022 .

[24]  Bayram Cetisli,et al.  The effect of linguistic hedges on feature selection: Part 2 , 2010, Expert Syst. Appl..

[25]  Francis Eng Hock Tay,et al.  Support vector machine with adaptive parameters in financial time series forecasting , 2003, IEEE Trans. Neural Networks.