A Fuzzy Complementary Criterion for structure learning of a neuro-fuzzy classifier

In this paper, the use of a Fuzzy Complementary Criterion (FuzCoC) for structure learning of a neuro-fuzzy classifier arranged in layers is proposed. The FuzCoC has been recently proposed as an effective criterion for feature selection. Simulation results in a large number of benchmark problems revealed the capability of this method in selecting small subsets of powerful and complementary features even in high dimensional feature sets. In this paper, the FuzCoC method is used not only to reduce the dimensions of the original feature space, but also to identify complementary generic fuzzy neuron classifiers (FNCs) arranged in layers. The chosen generic classifiers are then combined using a decision fusion operator to construct a descendant FNC at the next layer with enhanced classification capabilities. The proposed structure learning algorithm is a modified version of the Group Method of Data Handling (GMDH) algorithm which incorporates the FuzCoC method simultaneous as a pre-feature selection method and as a method to identify complementary generic classifiers to be combined in the next layer. Simulation results demonstrate the capabilities of the proposed method in building accurate neuro-fuzzy classifiers with reduced computational demands.

[1]  Rudolf Kruse,et al.  A neuro-fuzzy method to learn fuzzy classification rules from data , 1997, Fuzzy Sets Syst..

[2]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[3]  Antonio González Muñoz,et al.  Table Ii Tc Pattern Recognition Result for 120 Eir Satellite Image Cases Selection of Relevant Features in a Fuzzy Genetic Learning Algorithm , 2001 .

[4]  Peter Clark,et al.  The CN2 Induction Algorithm , 1989, Machine Learning.

[5]  Sanmay Das,et al.  Filters, Wrappers and a Boosting-Based Hybrid for Feature Selection , 2001, ICML.

[6]  Jeen-Shing Wang,et al.  Self-adaptive neuro-fuzzy inference systems for classification applications , 2002, IEEE Trans. Fuzzy Syst..

[7]  Ioannis B. Theocharis,et al.  Decision Fusion of GA Self-Organizing Neuro-Fuzzy Multilayered Classifiers for Land Cover Classification Using Textural and Spectral Features , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Lipo Wang,et al.  Data dimensionality reduction with application to simplifying RBF network structure and improving classification performance , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Moshe Ben-Bassat,et al.  35 Use of distance measures, information measures and error bounds in feature evaluation , 1982, Classification, Pattern Recognition and Reduction of Dimensionality.

[10]  James C. Bezdek,et al.  Decision templates for multiple classifier fusion: an experimental comparison , 2001, Pattern Recognit..

[11]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[12]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[13]  Igor Kononenko,et al.  Estimating Attributes: Analysis and Extensions of RELIEF , 1994, ECML.

[14]  Ioannis B. Theocharis,et al.  A multilayered neuro-fuzzy classifier with self-organizing properties , 2008, Fuzzy Sets Syst..

[15]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Hon Keung Kwan,et al.  Fuzzy classifications using fuzzy inference networks , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[17]  Ioannis B. Theocharis,et al.  SVM-FuzCoC: A novel SVM-based feature selection method using a fuzzy complementary criterion , 2010, Pattern Recognit..

[18]  Chih-Ming Chen,et al.  An efficient fuzzy classifier with feature selection based on fuzzy entropy , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[19]  Leszek Rutkowski,et al.  Flexible Neuro-Fuzzy Systems: Structures, Learning and Performance Evaluation—L. Rutkowski (Boston, MA: Kluwer Academic Publishers, 2004, ISBN: 1-402-08042-5) Reviewed by A. E. Gaweda , 2006, IEEE Transactions on Neural Networks.

[20]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[21]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[22]  Jon Atli Benediktsson,et al.  The effect of classifier agreement on the accuracy of the combined classifier in decision level fusion , 2001, IEEE Trans. Geosci. Remote. Sens..