An investigation into the application of neural networks, fuzzy logic, genetic algorithms, and rough sets to automated knowledge acquisition for classification problems

Abstract This paper presents some highlights in the application of neural networks, fuzzy logic, genetic algorithms, and rough sets to automated knowledge acquisition. These techniques are capable of dealing with inexact and imprecise problem domains and have been demonstrated to be useful in the solution of classification problems. It addresses the issue of the application of appropriate evaluation criteria such as rule base accuracy and comprehensibility for new knowledge acquisition techniques. An empirical study is then described in which three approaches to knowledge acquisition are investigated. The first approach combines neural networks and fuzzy logic, the second, genetic algorithms and fuzzy logic, and in the third a rough sets approach has been examined, and compared. In this study neural network and genetic algorithm fuzzy rule induction systems have been developed and applied to three classification problems. Rule induction software based on rough sets theory was also used to generate and test rule bases for the same data. A comparison of these approaches with the C4.5 inductive algorithm was also carried out. Our research to date indicates that, based on the evaluation criteria used, the genetic/fuzzy approach compares more than favourably with the neuro/fuzzy and rough set approaches. On the data sets used the genetic algorithm system displays a higher accuracy of classification and rule base comprehensibility than the C4.5 inductive algorithm.

[1]  Alistair Munro,et al.  Evolving fuzzy rule based controllers using genetic algorithms , 1996, Fuzzy Sets Syst..

[2]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[3]  Tharam S. Dillon,et al.  Automated knowledge acquisition , 1994, Prentice Hall International series in computer science and engineering.

[4]  P.E. Maher,et al.  Uncertain reasoning in an ID3 machine learning framework , 1993, [Proceedings 1993] Second IEEE International Conference on Fuzzy Systems.

[5]  Naoki Hara,et al.  Fuzzy rule extraction from a multilayered neural network , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[6]  Derek A. Linkens,et al.  Learning systems in intelligent control: an appraisal of fuzzy, neural and genetic algorithm control applications , 1996 .

[7]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[8]  Wiley E. Thompson,et al.  Methodology for designing an optimum fuzzy tracker using genetic algorithms , 1994, Defense, Security, and Sensing.

[9]  Wojciech Ziarko,et al.  The Discovery, Analysis, and Representation of Data Dependencies in Databases , 1991, Knowledge Discovery in Databases.

[10]  Hisao Ishibuchi,et al.  Linguistic rule extraction from neural networks and genetic-algorithm-based rule selection , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[11]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[12]  C. Matthews,et al.  Fuzzy rule extraction from a trained multilayer neural network , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[13]  Jacques Periaux,et al.  Genetic Algorithms in Engineering and Computer Science , 1996 .

[14]  Nikola Kasabov,et al.  Learning Fuzzy Production Rules For Approximate Reasoning In Connectionist Production Systems , 1993 .

[15]  LiMin Fu,et al.  Rule Generation from Neural Networks , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[16]  H. Ishibuchi,et al.  Selecting fuzzy rules by genetic algorithm for classification problems , 1993, [Proceedings 1993] Second IEEE International Conference on Fuzzy Systems.

[17]  Masayoshi Tomizuka,et al.  Automatic design of fuzzy systems using genetic algorithms and its application to lateral vehicle guidance , 1993 .

[18]  Ilona Jagielska,et al.  Automated knowledge acquisition for a fuzzy classification problem , 1995, Proceedings 1995 Second New Zealand International Two-Stream Conference on Artificial Neural Networks and Expert Systems.

[19]  F. Herrera A General Study on Genetic Fuzzy Systems , 1993 .

[20]  Jerzy W. Grzymala-Busse,et al.  Rough Sets , 1995, Commun. ACM.

[21]  William Frawley,et al.  Knowledge Discovery in Databases , 1991 .