Improving a Pittsburgh learnt fuzzy rule base using feature subset selection

This paper investigates the problem of feature subset selection as a preprocessing step to a method which learns fuzzy rule bases using genetic algorithm (GA) implementing the Pittsburgh approach. Four feature subset selection methods are investigated in the context of learning fuzzy rule bases. Two of them are filter methods namely, the Relief-E and the C-Focus. The other two are wrapper methods using GA as their search process; one implements the instance-based method 1-NN and the other, the constructive neural network algorithm DistAI. Results of the experiments conducted in three domains are presented and discussed; they show that methods which learn fuzzy rule bases can benefit from feature subset selection methods.

[1]  Igor Kononenko,et al.  Estimating Attributes: Analysis and Extensions of RELIEF , 1994, ECML.

[2]  Francisco Herrera,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2004, Fuzzy Sets Syst..

[3]  Jihoon Yang,et al.  Feature Subset Selection Using a Genetic Algorithm , 1998, IEEE Intell. Syst..

[4]  P. Langley.  Selection of Relevant Features in Machine Learning , 1994 .

[5]  Thomas G. Dietterich,et al.  Learning Boolean Concepts in the Presence of Many Irrelevant Features , 1994, Artif. Intell..

[6]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[7]  Pat Langley,et al.  Selection of Relevant Features and Examples in Machine Learning , 1997, Artif. Intell..

[8]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[9]  Ron Kohavi,et al.  Irrelevant Features and the Subset Selection Problem , 1994, ICML.

[10]  Stephen F. Smith,et al.  A learning system based on genetic adaptive algorithms , 1980 .

[11]  Larry A. Rendell,et al.  The Feature Selection Problem: Traditional Methods and a New Algorithm , 1992, AAAI.

[12]  DistAl: An inter-pattern distance-based constructive learning algorithm , 1999, Intell. Data Anal..

[13]  Yufei Yuan,et al.  A genetic algorithm for generating fuzzy classification rules , 1996, Fuzzy Sets Syst..

[14]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[15]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[16]  José Manuel Benítez,et al.  C-FOCUS: A continuous extension of FOCUS , 2003 .