Application of Ant Colony Algorithm for Classification and Rule Generation of Data

Ant Colony Optimization (ACO) algorithm has been applied to data mining recently. In this paper an algorithm for data mining called Ant-Miner is used(Ant Colony Algorithm-based Data Miner). The goal of Ant-Miner is to extract classification rules from data. The algorithm is inspired by both research on the behavior of real ant colonies and some data mining concepts and principles. In this paper the application of Ant Miner Algorithm for classification of data for the weather dataset is proposed using dotnet technology. Result shows that the slightly modified Ant Miner algorithm is capable of classifying the weather dataset more efficiently.

[1]  Luca Maria Gambardella,et al.  Ant Algorithms for Discrete Optimization , 1999, Artificial Life.

[2]  J. Ross Quinlan,et al.  Generating Production Rules from Decision Trees , 1987, IJCAI.

[3]  Padhraic Smyth,et al.  From Data Mining to Knowledge Discovery in Databases , 1996, AI Mag..

[4]  Alex Alves Freitas,et al.  Understanding the Crucial Role of Attribute Interaction in Data Mining , 2001, Artificial Intelligence Review.

[5]  Ivan Bratko,et al.  Trading Accuracy for Simplicity in Decision Trees , 1994, Machine Learning.

[6]  Heitor Silvério Lopes,et al.  AN EVOLUTIONARY APPROACH TO SIMULATE COGNITIVE FEEDBACK LEARNING IN MEDICAL DOMAIN , 1997 .

[7]  Alex Alves Freitas,et al.  Mining Very Large Databases with Parallel Processing , 1997, The Kluwer International Series on Advances in Database Systems.

[8]  David W. Aha,et al.  Simplifying decision trees: A survey , 1997, The Knowledge Engineering Review.

[9]  Takanori Shibata,et al.  Genetic Algorithms And Fuzzy Logic Systems Soft Computing Perspectives , 1997 .

[10]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[11]  Marco Dorigo,et al.  The ant colony optimization meta-heuristic , 1999 .

[12]  Peter Clark,et al.  Rule Induction with CN2: Some Recent Improvements , 1991, EWSL.

[13]  Peter Clark,et al.  The CN2 Induction Algorithm , 1989, Machine Learning.

[14]  W. Spears,et al.  For Every Generalization Action, Is There Really an Equal and Opposite Reaction? , 1995, ICML.

[15]  Alex A. Freitas.  Data Mining with Evolutionary Algorithms: Research Directions - Papers from the AAAI Workshop , 1999 .

[16]  Cullen Schaffer,et al.  A Conservation Law for Generalization Performance , 1994, ICML.

[17]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[18]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[19]  Ning Zhang,et al.  An Ant Colony Optimization Algorithm for Learning Classification Rules , 2006, 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings)(WI'06).

[20]  Cullen Schaffer.  Overfitting avoidance as bias , 2004, Machine Learning.

[21]  Padhraic Smyth,et al.  From Data Mining to Knowledge Discovery: An Overview , 1996, Advances in Knowledge Discovery and Data Mining.

[22]  Ron Kohavi,et al.  Error-Based and Entropy-Based Discretization of Continuous Features , 1996, KDD.

[23]  Yves Kodratoff,et al.  Machine Learning — EWSL-91 , 1991, Lecture Notes in Computer Science.

[24]  Marco Dorigo,et al.  Swarm intelligence: from natural to artificial systems , 1999 .

[25]  Vasant Dhar,et al.  Discovering Interesting Patterns for Investment Decision Making with GLOWER ☹—A Genetic Learner Overlaid with Entropy Reduction , 2000, Data Mining and Knowledge Discovery.

[26]  Jason Catlett,et al.  Overprvning Large Decision Trees , 1991, IJCAI.

[27]  Riccardo Poli,et al.  New ideas in optimization , 1999 .