A novel mutual information based ant colony classifier

By constructing a list of IF-THEN rules, the traditional ant colony optimization (ACO) has been successfully applied on data classification with not only a promising accuracy but also a user comprehensibility. However, as the collected data to be classified usually contain large volumes and redundant features, it is challenging to further improve the classification accuracy and meanwhile reduce the computational time for ACO. This paper proposes a novel hybrid mutual information based ant colony algorithm (mr2 AM+) for classification. First, a maximum relevance minimum redundancy feature selection method is used to select the most informative and discriminative attributes in a dataset. Then, we use the enhanced ACO classifier (i.e., AM+) to perform the classification. Experimental results show that the proposed mr2AM+ outperforms other seven state-of-art related classification algorithms in terms of accuracy and the size of model.

[1]  Jiujun Cheng,et al.  Ant colony optimization with clustering for solving the dynamic location routing problem , 2016, Appl. Math. Comput..

[2]  MengChu Zhou,et al.  Routing in Internet of Vehicles: A Review , 2015, IEEE Transactions on Intelligent Transportation Systems.

[3]  Zhe Xu,et al.  Ant Colony Optimization with Neighborhood Search for Dynamic TSP , 2016, ICSI.

[4]  Yiqiao Cai,et al.  Differential Evolution With Neighborhood and Direction Information for Numerical Optimization , 2013, IEEE Transactions on Cybernetics.

[5]  Jiujun Cheng,et al.  Automatic Composition of Semantic Web Services Based on Fuzzy Predicate Petri Nets , 2015, IEEE Transactions on Automation Science and Engineering.

[6]  J. Ross Quinlan,et al.  Improved Use of Continuous Attributes in C4.5 , 1996, J. Artif. Intell. Res..

[7]  Qiuzhen Lin,et al.  A novel multiple rule sets data classification algorithm based on ant colony algorithm , 2016, Appl. Soft Comput..

[8]  Jiujun Cheng,et al.  Incorporation of Solvent Effect into Multi-Objective Evolutionary Algorithm for Improved Protein Structure Prediction , 2018, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[9]  Alex Alves Freitas,et al.  A New Sequential Covering Strategy for Inducing Classification Rules With Ant Colony Algorithms , 2013, IEEE Transactions on Evolutionary Computation.

[10]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[11]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[12]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Hiroki Tamura,et al.  Batch type local search-based adaptive neuro-fuzzy inference system (ANFIS) with self-feedbacks for time-series prediction , 2009, Neurocomputing.

[14]  Alex Alves Freitas,et al.  Data mining with an ant colony optimization algorithm , 2002, IEEE Trans. Evol. Comput..

[15]  Monique Snoeck,et al.  Classification With Ant Colony Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[16]  Huan Liu,et al.  Efficient Feature Selection via Analysis of Relevance and Redundancy , 2004, J. Mach. Learn. Res..

[17]  Yan Wang,et al.  Gravitational search algorithm combined with chaos for unconstrained numerical optimization , 2014, Appl. Math. Comput..

[18]  Jiujun Cheng,et al.  An approximate logic neuron model with a dendritic structure , 2016, Neurocomputing.

[19]  Wei Wang,et al.  Improved Clonal Selection Algorithm Combined with Ant Colony Optimization , 2008, IEICE Trans. Inf. Syst..

[20]  Sheng Li,et al.  Multi-valued Neural Network Trained by Differential Evolution for Synthesizing Multiple-Valued Functions , 2015, 2015 2nd International Conference on Information Science and Control Engineering.

[21]  Alex Alves Freitas,et al.  Inducing decision trees with an ant colony optimization algorithm , 2012, Appl. Soft Comput..

[22]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[23]  Keinosuke Fukunaga,et al.  Effects of Sample Size in Classifier Design , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Zibin Zheng,et al.  Multiobjective Vehicle Routing Problems With Simultaneous Delivery and Pickup and Time Windows: Formulation, Instances, and Algorithms , 2016, IEEE Transactions on Cybernetics.

[25]  Jiahai Wang,et al.  Financial time series prediction using a dendritic neuron model , 2016, Knowl. Based Syst..

[26]  Yiqiao Cai,et al.  Differential Evolution Enhanced With Multiobjective Sorting-Based Mutation Operators , 2014, IEEE Transactions on Cybernetics.