Combining neural network, genetic algorithm and symbolic learning approach to discover knowledge from databases

Classification, which involves finding rules that partition a given data set into disjoint groups, is one class of data mining problems. Approaches proposed so far for mining classification rules for databases are mainly decision tree based on symbolic learning methods. In this paper, we combine artificial neural network, genetic algorithm and symbol learning methods to find classification rules. Some experiments have demonstrated that our method generates rules of better performance than the decision tree approach and the number of extracted rules is fewer than that of C4.5.

[1]  Jude Shavlik,et al.  Refinement ofApproximate Domain Theories by Knowledge-Based Neural Networks , 1990, AAAI.

[2]  Geoffrey E. Hinton.  Connectionist Learning Procedures , 1989, Artif. Intell..

[3]  Lu Yuchang,et al.  Multistrategy learning using genetic algorithms and neural networks for pattern classification , 1996, 1996 IEEE International Conference on Systems, Man and Cybernetics. Information Intelligence and Systems (Cat. No.96CH35929).

[4]  LiMin Fu,et al.  Rule Generation from Neural Networks , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[5]  Philip S. Yu,et al.  Data Mining: An Overview from a Database Perspective , 1996, IEEE Trans. Knowl. Data Eng..

[6]  Victor Ciesielski,et al.  Using a Hybrid Neural/Expert System for Data Base Mining in Market Survey Data , 1996, KDD.

[7]  Jude W. Shavlik,et al.  Using Sampling and Queries to Extract Rules from Trained Neural Networks , 1994, ICML.

[8]  Stephen I. Gallant,et al.  Connectionist expert systems , 1988, CACM.

[9]  Leslie G. Valiant,et al.  A theory of the learnable , 1984, STOC '84.

[10]  Yoichi Hayashi,et al.  A Neural Expert System with Automated Extraction of Fuzzy If-Then Rules , 1990, NIPS.

[11]  Ryszard S. Michalski,et al.  A Theory and Methodology of Inductive Learning , 1983, Artificial Intelligence.

[12]  C. L. Giles,et al.  Rule refinement with recurrent neural networks , 1993, IEEE International Conference on Neural Networks.

[13]  Ishwar K. Sethi,et al.  Symbolic approximation of feedforward neural networks , 1994 .

[14]  Huan Liu,et al.  Understanding Neural Networks via Rule Extraction , 1995, IJCAI.

[15]  Zhaohui Zhang,et al.  Extracting rules from a GA-pruned neural network , 1996, 1996 IEEE International Conference on Systems, Man and Cybernetics. Information Intelligence and Systems (Cat. No.96CH35929).