A Comparison among Support Vector Machine and other Machine Learning Classification Algorithms

Predication of terrorist groups that responsible of terrorist attacks is a challenging task and a promising research area. There are many methods that have been developed to address this challenge ranging from supervised to unsupervised methods. The main objective of this research is to conduct a detailed comparative study among Support Vector Machine as one of the successful prediction classifiers that proved highly performance and other supervised machine learning classification and hybrid classification algorithms. Whereas most promising methods are based on support vector machine (SVM); so there is a need for a comprehensive analysis on prediction accuracy of supervised machine learning algorithms on different experimental conditions, and hence in this research we compare predictive accuracy and comprehensibility of explicit, implicit, and hybrid machine learning models and algorithms. This research based on predicting terrorist groups responsible of attacks in Middle East & North Africa from year 2004 up to 2008 by comparing various standard, ensemble, hybrid, and hybrid ensemble machine learning methods and focusing on SVM. The compared classifiers are categorized into main four types namely; Standard Classifiers, Hybrid Classifiers, Ensemble Classifiers, and Hybrid Ensemble Classifiers. In our study we conduct three different experiments on the used real data, afterwards we compare the obtained results according to four different performance measures. Experiments were carried out using real world data represented by Global terrorism Database (GTD) from National Consortium for the study of terrorism and Responses of Terrorism (START).

[1]  Eibe Frank,et al.  Logistic Model Trees , 2003, Machine Learning.

[2]  Paul E. Utgoff,et al.  Perceptron Trees : A Case Study in ybrid Concept epresentations , 1999 .

[3]  Kuo-Chen Chou,et al.  Prediction of Protein Structural Classes by Support Vector Machines , 2002, Comput. Chem..

[4]  João Gama,et al.  Functional Trees , 2001, Machine Learning.

[5]  Thomas G. Dietterich An Experimental Comparison of Three Methods for Constructing Ensembles of Decision Trees: Bagging, Boosting, and Randomization , 2000, Machine Learning.

[6]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[7]  Carla E. Brodley,et al.  Multivariate decision trees , 2004, Machine Learning.

[8]  Giner Alor-Hernández,et al.  Improving Accuracy of Decision Trees Using Clustering Techniques , 2013, J. Univers. Comput. Sci..

[9]  V. Vapnik Pattern recognition using generalized portrait method , 1963 .

[10]  Ricardo Vilalta,et al.  Metalearning - Applications to Data Mining , 2008, Cognitive Technologies.

[11]  Martin Brown,et al.  Network Performance Assessment for Neurofuzzy Data Modelling , 1997, IDA.

[12]  Usman Qamar,et al.  Terrorist Group Prediction Using Data Classification , 2014 .

[13]  John R. Anderson,et al.  MACHINE LEARNING An Artificial Intelligence Approach , 2009 .

[14]  Przemyslaw Kazienko,et al.  Boosting-based Multi-label Classification , 2013, J. Univers. Comput. Sci..

[15]  Sotiris B. Kotsiantis,et al.  Machine learning: a review of classification and combining techniques , 2006, Artificial Intelligence Review.

[16]  T. Barbu,et al.  SVM-based Human Cell Detection Technique using Histograms of Oriented Gradients , 2012 .

[17]  Alexander J. Smola,et al.  Support Vector Method for Function Approximation, Regression Estimation and Signal Processing , 1996, NIPS.

[18]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[19]  Michal Wozniak,et al.  Hybrid Classifiers - Methods of Data, Knowledge, and Classifier Combination , 2013, Studies in Computational Intelligence.

[20]  Ron Kohavi,et al.  Scaling Up the Accuracy of Naive-Bayes Classifiers: A Decision-Tree Hybrid , 1996, KDD.

[21]  Vladislav Miškovic,et al.  Machine Learning of Hybrid Classification Models for Decision Support , 2014 .

[22]  Tzung-Pei Hong,et al.  An Integrated MFFP-tree Algorithm for Mining Global Fuzzy Rules from Distributed Databases , 2013, J. Univers. Comput. Sci..

[23]  Ian H. Witten,et al.  Data Mining: Practical Machine Learning Tools and Techniques, 3/E , 2014 .

[24]  Robert A. Lordo,et al.  Learning from Data: Concepts, Theory, and Methods , 2001, Technometrics.

[25]  Przemyslaw Kazienko,et al.  Boosting Algorithm with Sequence-Loss Cost Function for Structured Prediction , 2010, HAIS.

[26]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[27]  Krzysztof J. Cios,et al.  Hybrid inductive machine learning: an overview of CLIP algorithms , 2002 .

[28]  J. R. Quinlan Learning With Continuous Classes , 1992 .