Discovering fuzzy classification rules using Genetic Network Programming

Classification rule mining is an active data mining research area. Most related studies have shown how binary valued datasets are handled. However, datasets in real-world applications, usually consist of fuzzy and quantitative values. As a result, the idea to combine the different approaches with fuzzy set theory has been applied more frequently in recent years. Fuzzy sets can help to overcome the so-called sharp boundary problem by allowing partial memberships to the different sets, not only 1 and 0. On the other hand, fuzzy sets theory has been shown to be a very useful tool because the mined rules are expressed in linguistic terms, which are more natural and understandable for human beings. This paper proposes the combination of fuzzy set theory and ldquogenetic network programmingrdquo (GNP) for discovering fuzzy classification rules from given quantitative data. GNP, as an extension of genetic algorithms (GA) and genetic programming (GP), is an evolutionary optimization technique that uses directed graph structures as genes instead of strings and trees; this feature contributes creating quite compact programs and implicitly memorizing past action sequences. At last, experimental results conducted on a real world database verify the performance of the proposed method.

[1]  Kotaro Hirasawa,et al.  Comparison between Genetic Network Programming (GNP) and Genetic Programming (GP) , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[2]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[3]  Rajeev Motwani,et al.  Beyond market baskets: generalizing association rules to correlations , 1997, SIGMOD '97.

[4]  Dr. Alex A. Freitas Data Mining and Knowledge Discovery with Evolutionary Algorithms , 2002, Natural Computing Series.

[5]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[6]  Shingo Mabu,et al.  A Graph-Based Evolutionary Algorithm: Genetic Network Programming (GNP) and Its Extension Using Reinforcement Learning , 2007, Evolutionary Computation.

[7]  Kotaro Hirasawa,et al.  Class Association Rule Mining with Chi-Squared Test Using Genetic Network Programming , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[8]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[9]  Kotaro Hirasawa,et al.  Comparison between genetic network programming and genetic programming using evolution of ant's behaviors , 2001 .

[10]  Kotaro Hirasawa,et al.  Genetic Network Programming with Acquisition Mechanisms of Association Rules , 2006, J. Adv. Comput. Intell. Intell. Informatics.

[11]  H. Ishibuchi,et al.  Distributed representation of fuzzy rules and its application to pattern classification , 1992 .