A Novel Approach to Heterogeneous Multi-class SVM Classification

The usability of multi-class support vector machine for processing and classifying heterogeneous data has defined in proposed study. Multi-class approaches are machine learning algorithms that construct a new subset of learning classifiers and then classify new models by adding the results of the base classifiers in various ways (characteristically by weighted or un-weighted voting). To construct the multi-class support vector machine classifier into subsets, first we have to decide different kernel tricks for getting better results. However, processing heterogeneous data by support vector machine based on different kernel functions have rarely used. The training time, cross-validation, classification accuracy of single class and multi-class are evaluated here. The sum rule for combining the subsets of multi-class classifiers has been used in this study. The experimental results analysis shows that our proposed multi-class approach achieves highest accuracy with heterogeneous data in comparison with other methods.

[1]  Charu C. Aggarwal,et al.  On the design and quantification of privacy preserving data mining algorithms , 2001, PODS.

[2]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[3]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[4]  Edward Y. Chang,et al.  Parallelizing Support Vector Machines on Distributed Computers , 2007, NIPS.

[5]  Koby Crammer,et al.  On the Algorithmic Implementation of Multiclass Kernel-based Vector Machines , 2002, J. Mach. Learn. Res..

[6]  Ewa Lechman,et al.  Catalyzing Development through ICT Adoption: The Developing World Experience , 2016 .

[7]  Harleen Kaur,et al.  Predictive analysis and modelling football results using machine learning approach for English Premier League , 2019, International Journal of Forecasting.

[8]  Rong Chen,et al.  Collective Mining of Bayesian Networks from Distributed Heterogeneous Data , 2004, Knowl. Inf. Syst..

[9]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[10]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[11]  Nello Cristianini,et al.  Support vector machines , 2009 .

[12]  Lin Ma,et al.  Empirical analysis of support vector machine ensemble classifiers , 2009, Expert Syst. Appl..

[13]  Bernd Bischl,et al.  Support Vector Machines on Large Data Sets: Simple Parallel Approaches , 2012, GfKl.

[14]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[15]  A. Owen,et al.  A Bayesian framework for combining heterogeneous data sources for gene function prediction (in Saccharomyces cerevisiae) , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Ewa Lechman,et al.  Catalyzing Development through ICT Adoption , 2017 .

[17]  Jason Weston,et al.  Support vector machines for multi-class pattern recognition , 1999, ESANN.

[18]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[19]  Kurt Hornik,et al.  Misc Functions of the Department of Statistics (e1071), TU Wien , 2014 .

[20]  Klaus R. Dittrich,et al.  Three decades of data integration - All problems solved? , 2004, IFIP Congress Topical Sessions.

[21]  Atish P. Sinha,et al.  An efficient algorithm for generating generalized decision forests , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[22]  J. Mercer Functions of Positive and Negative Type, and their Connection with the Theory of Integral Equations , 1909 .

[23]  Bernard F. Buxton,et al.  Performance Degradation in Boosting , 2001, Multiple Classifier Systems.

[24]  Victor I. Chang,et al.  A Proposed Solution and Future Direction for Blockchain-Based Heterogeneous Medicare Data in Cloud Environment , 2018, Journal of Medical Systems.