Combined method of genetic programming and association rule algorithm

Genetic programming (GP) usually has a wide search space and a high flexibility. Therefore, GP may search for global optimum solution. But, in general, GPs learning speed is not so fast. An apriori algorithm is one of association rule algorithms. It can be applied to a large database. But it is difficult to define its parameters without experience. We propose a rule generation technique from a database using GP combined with an association rule algorithm. It takes rules generated by the association rule algorithm as initial individual of GP. The learning speed of GP is improved by the combined algorithm. To verify the effectiveness of the proposed method, we apply it to the decision tree construction problem from the University of California at Irvine (UCI) machine-learning repository, and rule discovery problem from the occurrence of the hypertension database. We compare the results of the proposed method with prior ones.

[1]  Osamu Katai,et al.  Attribute Generation Based on Association Rules , 2002, Knowledge and Information Systems.

[2]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[3]  Michael J. A. Berry,et al.  Data mining techniques - for marketing, sales, and customer support , 1997, Wiley computer publishing.

[4]  John R. Koza,et al.  Genetic Programming II , 1992 .

[5]  Hiroshi Motoda,et al.  Feature Extraction, Construction and Selection , 1998 .

[6]  Ayahiko Niimi,et al.  Extended genetic programming using reinforcement learning operation , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[7]  Ayahiko Niimi,et al.  Genetic programming combined with association rule algorithm for decision tree construction , 2000, KES'2000. Fourth International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies. Proceedings (Cat. No.00TH8516).

[8]  Hiroshi Motoda,et al.  Feature Extraction, Construction and Selection: A Data Mining Perspective , 1998 .

[9]  Ayahiko Niimi,et al.  Object oriented approach to combined learning of decision tree and ADF GP , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[10]  Takumi Ichimura,et al.  Knowledge based approach to structure level adaptation of neural networks , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[11]  Rakesh Agarwal,et al.  Fast Algorithms for Mining Association Rules , 1994, VLDB 1994.

[12]  Ayahiko Niimi,et al.  Rule Discovery Technique Using Genetic Programming Combined with Apriori Algorithm , 2000, Discovery Science.

[13]  J. R. Quinlan.  Constructing Decision Trees , 1993 .

[14]  Ron Kohavi,et al.  Feature Selection for Knowledge Discovery and Data Mining , 1998 .