A modified multi objective heuristic for effective feature selection in text classification

Text categorization is the process of sorting text documents into one or more predefined categories or classes of similar documents. Differences in the results of such categorization arise from the feature set chosen to base the association of a given document with a given category. This process is challenging mainly because there can be large number of discriminating words which render many of the current algorithms unable to complete this. For most of these tasks there exist both relevant as well as irrelevant features. The objective here is to bring about a text classification on the basis of the features selected and also pre-processing to bring down the dimensionality and increase the accuracy of classification of the feature vector. Here the most commonly used methods are meta-heuristic algorithms in order to facilitate selection. Artificial fish swarm algorithm (AFSA) takes the underlying intelligence of the behaviour of fish swarming to combat the problems of optimization as well as the combinatorial problems. This method has been greatly successful in diverse applications but does suffer from certain limitations like not having multiplicity. Therefore, a modification has been proposed to AFSA which is MAFSA that has a crossover in its operation in order to bring about an improvement in the text classification selection. SVM or Support Vector Machine, Adaboost classifiers and naïve bayes are all used here. MAFSA has proved itself to be superior to AFSA in terms of precision and also the selected feature numbers.

[1]  M. Ramya,et al.  Different Type of Feature Selection for Text Classification , 2014 .

[2]  Bin Wang,et al.  Text Classification Using Support Vector Machine with Mixture of Kernel , 2012 .

[3]  Rajul Jain,et al.  Feature Selection for Effective Text Classification using Semantic Information , 2015 .

[4]  Shasha Wang,et al.  Adapting naive Bayes tree for text classification , 2015, Knowledge and Information Systems.

[5]  HeHaibo,et al.  A Bayesian Classification Approach Using Class-Specific Features for Text Categorization , 2016 .

[6]  Masoumeh Zareapoor,et al.  Feature Extraction or Feature Selection for Text Classification: A Case Study on Phishing Email Detection , 2015 .

[7]  Mohammad Aizat bin Basir,et al.  Comparison on Swarm Algorithms for Feature Selections/Reductions , 2014 .

[8]  Ibrahim El-Henawy,et al.  A Hybrid Swarm Intelligence Technique for Solving Integer Multi-objective Problems , 2014 .

[9]  Kuan-Cheng Lin,et al.  Feature Selection for Support Vector Machines Base on Modified Artificial Fish Swarm Algorithm , 2015 .

[10]  Bo Tang,et al.  A Bayesian Classification Approach Using Class-Specific Features for Text Categorization , 2016, IEEE Transactions on Knowledge and Data Engineering.

[11]  T. Devi,et al.  A COMPARATIVE ANALYSIS OF META AND TREE CLASSIFICATION ALGORITHMS USING WEKA , 2016 .

[12]  Ying Wu,et al.  Knowledge-based artificial fish-swarm algorithm , 2011 .

[13]  Gaurav S. Chavan,et al.  A Survey of Various Machine Learning Techniques for Text Classification , 2014 .

[14]  George D. C. Cavalcanti,et al.  Data-driven global-ranking local feature selection methods for text categorization , 2015, Expert Syst. Appl..

[15]  Bo Tang,et al.  Toward Optimal Feature Selection in Naive Bayes for Text Categorization , 2016, IEEE Transactions on Knowledge and Data Engineering.

[16]  Yi-Hung Huang,et al.  Feature Selection and Parameter Optimization of Support Vector Machines Based on Modified Cat Swarm Optimization , 2015, Int. J. Distributed Sens. Networks.

[17]  Jean-Charles Lamirel,et al.  Optimizing text classification through efficient feature selection based on quality metric , 2014, Journal of Intelligent Information Systems.

[18]  V Korde,et al.  TEXT CLASSIFICATION AND CLASSIFIERS: A SURVEY , 2012 .

[19]  Kashif Javed,et al.  A two-stage Markov blanket based feature selection algorithm for text classification , 2015, Neurocomputing.

[20]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.

[21]  Shasha Wang,et al.  Deep feature weighting for naive Bayes and its application to text classification , 2016, Eng. Appl. Artif. Intell..

[22]  Mehdi Hosseinzadeh Aghdam,et al.  Feature Selection Using Particle Swarm Optimization in Text Categorization , 2015, J. Artif. Intell. Soft Comput. Res..

[23]  Serkan Gunal.  Hybrid feature selection for text classification , 2012 .

[24]  Kuan-Cheng Lin,et al.  Feature Selection and Parameter Optimization of Support Vector Machines Based on Modified Artificial Fish Swarm Algorithms , 2015 .

[25]  Sébastien Fournier,et al.  The Impact of Conceptualization on Text Classification , 2012, WISE.

[26]  陈毅东,et al.  An Improved Artificial Fish Swarm Algorithm based on Hybrid Behavior Selection , 2013 .

[27]  Jianhua Guo,et al.  Feature subset selection using naive Bayes for text classification , 2015, Pattern Recognit. Lett..