EPACO: a novel ant colony optimization for emerging patterns based classification

In this paper, a novel approach for discovering emerging patterns has been proposed. Majority of the existing algorithms for the discovery of emerging patterns are tree-based which involve growth and shrinking of trees for this purpose. These algorithms follow greedy search approach for discovery of emerging patterns. The proposed approach utilizes the diversity of ant colony optimization and avoids complexity and greedy search of tree-based algorithms for discovery of emerging patterns. The experiments show that the proposed approach provides higher accuracy than existing state of the art classifiers as well as emerging pattern-based classifiers.

[1]  Steven Guan,et al.  An incremental approach to genetic-algorithms-based classification , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  Mehdi Khashei,et al.  A new hybrid artificial neural networks and fuzzy regression model for time series forecasting , 2008, Fuzzy Sets Syst..

[3]  A. R. Baig,et al.  HYBRID ASSOCIATIVE CLASSIFICATION ALGORITHM USING ANT COLONY OPTIMIZATION , 2011 .

[4]  S. R. Samantaray,et al.  Variational Mode Decomposition and Decision Tree Based Detection and Classification of Power Quality Disturbances in Grid-Connected Distributed Generation System , 2018, IEEE Transactions on Smart Grid.

[5]  Michelangelo Ceci,et al.  Discovering Emerging Patterns in Spatial Databases: A Multi-relational Approach , 2007, PKDD.

[6]  Xindong Wu,et al.  Mining emerging patterns by streaming feature selection , 2012, KDD.

[7]  Barbara H. Kwasnik,et al.  The Role of Classification in Knowledge Representation and Discovery , 1999, Libr. Trends.

[8]  Hamad Alhammady.  A novel approach for mining emerging patterns in data streams , 2007, 2007 9th International Symposium on Signal Processing and Its Applications.

[9]  C. Escazut,et al.  Classifier systems evolving multi-agent system with distributed elitism , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[10]  Kotagiri Ramamohanarao,et al.  Exploring constraints to efficiently mine emerging patterns from large high-dimensional datasets , 2000, KDD '00.

[11]  Theofanis Sapatinas,et al.  Discriminant Analysis and Statistical Pattern Recognition , 2005 .

[12]  P. Harrington.  Support vector machine classification trees based on fuzzy entropy of classification. , 2017 .

[13]  J. Mohammadzadeh,et al.  Social Networks Classification using DBN Neural Network based on Genetic Algorithm , 2016 .

[14]  María José del Jesús,et al.  KEEL: a software tool to assess evolutionary algorithms for data mining problems , 2008, Soft Comput..

[15]  Ian H. Witten,et al.  Generating Accurate Rule Sets Without Global Optimization , 1998, ICML.

[16]  Bo Liu,et al.  Density-Based Heuristic for Rule Discovery with Ant-Miner , 2002 .

[17]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[18]  Kotagiri Ramamohanarao,et al.  A weighting scheme based on emerging patterns for weighted support vector machines , 2005, 2005 IEEE International Conference on Granular Computing.

[19]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[20]  Marco Dorigo,et al.  Optimization, Learning and Natural Algorithms , 1992 .

[21]  José Francisco Martínez Trinidad,et al.  Cascading an Emerging Pattern Based Classifier , 2010, MCPR.

[22]  Kotagiri Ramamohanarao,et al.  The Space of Jumping Emerging Patterns and Its Incremental Maintenance Algorithms , 2000, ICML.

[23]  Peter de Boves Harrington,et al.  Support vector machine classification trees based on fuzzy entropy of classification. , 2017, Analytica chimica acta.

[24]  Michelangelo Ceci,et al.  Emerging Pattern Based Classification in Relational Data Mining , 2008, DEXA.

[25]  Mohammad Saniee Abadeh,et al.  SubLex: Generating subjectivity lexicons using genetic algorithm for subjectivity classification of big social data , 2016, 2016 1st Conference on Swarm Intelligence and Evolutionary Computation (CSIEC).

[26]  Pedro M. Domingos,et al.  On the Optimality of the Simple Bayesian Classifier under Zero-One Loss , 1997, Machine Learning.

[27]  Sang-Ho Lee,et al.  Application of Emerging Patterns for Multi-source Bio-Data Classification and Analysis , 2005, ICNC.

[28]  Kotagiri Ramamohanarao,et al.  Fast discovery and the generalization of strong jumping emerging patterns for building compact and accurate classifiers , 2006, IEEE Transactions on Knowledge and Data Engineering.

[29]  Aboul Ella Hassanien,et al.  GNRCS: Hybrid Classification System based on Neutrosophic Logic and Genetic Algorithm , 2016, 2016 12th International Computer Engineering Conference (ICENCO).

[30]  Maybin K. Muyeba,et al.  A Framework to Mine High-Level Emerging Patterns by Attribute-Oriented Induction , 2011, IDEAL.

[31]  Roman Podraza,et al.  KTDA: emerging patterns based data analysis system , 2006, Ann. UMCS Informatica.

[32]  Alex Alves Freitas,et al.  Data mining with an ant colony optimization algorithm , 2002, IEEE Trans. Evol. Comput..

[33]  Debin Zhao,et al.  Building Emerging Pattern (EP) Random forest for recognition , 2010, 2010 IEEE International Conference on Image Processing.

[34]  Kotagiri Ramamohanarao,et al.  DeEPs: A New Instance-Based Lazy Discovery and Classification System , 2004, Machine Learning.

[35]  S. Cessie,et al.  Ridge Estimators in Logistic Regression , 1992 .

[36]  José Francisco Martínez Trinidad,et al.  A New Emerging Pattern Mining Algorithm and Its Application in Supervised Classification , 2010, PAKDD.

[37]  Tiago Ferra de Sousa,et al.  Particle Swarm based Data Mining Algorithms for classification tasks , 2004, Parallel Comput..

[38]  Alex Alves Freitas,et al.  cAnt-Miner: An Ant Colony Classification Algorithm to Cope with Continuous Attributes , 2008, ANTS Conference.

[39]  Marco Dorigo,et al.  Distributed Optimization by Ant Colonies , 1992 .

[40]  Abdulhamit Subasi,et al.  Comparison of decision tree algorithms for EMG signal classification using DWT , 2015, Biomed. Signal Process. Control..

[41]  Steven Salzberg,et al.  Programs for Machine Learning , 2004 .

[42]  Abdul Rauf Baig,et al.  A correlation-based ant miner for classification rule discovery , 2012, Neural Computing and Applications.

[43]  Peng Shi,et al.  A novel approach of mining strong jumping emerging patterns based on BSC-tree , 2014, Int. J. Syst. Sci..

[44]  Hussein A. Abbass,et al.  Classification rule discovery with ant colony optimization , 2003, IEEE/WIC International Conference on Intelligent Agent Technology, 2003. IAT 2003..

[45]  G. McLachlan.  Discriminant Analysis and Statistical Pattern Recognition , 1992 .

[46]  William W. Cohen.  Fast Effective Rule Induction , 1995, ICML.

[47]  Shixiong Xia,et al.  An Improved KNN Text Classification Algorithm Based on Clustering , 2009, J. Comput..

[48]  Bruno Crémilleux,et al.  Discovering Emerging Graph Patterns from Chemicals , 2009, ISMIS.

[49]  Krzysztof Walczak,et al.  Classification based on the highest impact jumping emerging patterns , 2009, 2009 International Multiconference on Computer Science and Information Technology.

[50]  J. Bailey,et al.  Efficient Mining of Contrast Patterns and Their Applications to Classification , 2005, 2005 3rd International Conference on Intelligent Sensing and Information Processing.

[51]  Amit P. Ganatra,et al.  Modified RAAT (Reduced Apriori Algorithm Using Tag) for Efficiency Improvement with EP(Emerging Patterns) and JEP(Jumping EP) , 2010, 2010 International Conference on Advances in Computer Engineering.

[52]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[53]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[54]  Jian Lu,et al.  epSICAR: An Emerging Patterns based approach to sequential, interleaved and Concurrent Activity Recognition , 2009, 2009 IEEE International Conference on Pervasive Computing and Communications.

[55]  José Francisco Martínez Trinidad,et al.  Fuzzy emerging patterns for classifying hard domains , 2011, Knowledge and Information Systems.

[56]  Zhou Wang,et al.  Exploiting Maximal Emerging Patterns for Classification , 2004, Australian Conference on Artificial Intelligence.

[57]  Jinyan Li,et al.  Efficient mining of emerging patterns: discovering trends and differences , 1999, KDD '99.

[58]  Lijuan Lu,et al.  An improved algorithm of mining Strong Jumping Emerging Patterns based on sorted SJEP-Tree , 2010, 2010 IEEE Fifth International Conference on Bio-Inspired Computing: Theories and Applications (BIC-TA).

[59]  Kotagiri Ramamohanarao,et al.  Noise Tolerant Classification by Chi Emerging Patterns , 2004, PAKDD.

[60]  Hua-Fu Li,et al.  Discovering emerging melody patterns from customer query data streams of music service , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[61]  Yong Yin,et al.  The classification prognosis models of hepatitis b virus reactivation based on Bayes and support vector machine after feature extraction of genetic algorithm , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[62]  Stephen D. Bay,et al.  The UCI KDD archive of large data sets for data mining research and experimentation , 2000, SKDD.

[63]  Monique Snoeck,et al.  Classification With Ant Colony Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[64]  D. A. Adeniyi,et al.  Automated web usage data mining and recommendation system using K-Nearest Neighbor (KNN) classification method , 2016 .

[65]  Steven L. Salzberg,et al.  Book Review: C4.5: Programs for Machine Learning by J. Ross Quinlan. Morgan Kaufmann Publishers, Inc., 1993 , 1994, Machine Learning.