Evolvable Subsethood Product Fuzzy Neural Network for Pattern Classification

This paper presents an evolvable version of a novel subsethood product fuzzy neural inference system (ESuPFuNIS). The original SuPFuNIS model20 employs only fuzzy weights, and accepts both numeric and linguistic inputs. All numeric inputs are fuzzified using a feature specific fuzzifier. The model composes fuzzy signals from the input layer with fuzzy weights using a mutual subsethood measure. Rule nodes use a product aggregation operator. Outputs from the network are generated using volume defuzzification. Here we replace the original gradient descent learning procedure with a genetic optimization technique and report considerable improvements in classification accuracy and rule economy on three benchmark problems. Real-coded genetic algorithms (RGA's) have been employed to search for an optimal set of network parameters. We demonstrate the classification capabilities of the network on Ripley's synthetic two class data, Iris data and Forensic glass data. In all the problems considered, the GA based classifier performs better than its gradient descent counterpart in terms of classification accuracy as well as rule economy.

[1]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[2]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[3]  Robert A. Lordo,et al.  Learning from Data: Concepts, Theory, and Methods , 2001, Technometrics.

[4]  Yoshua Bengio,et al.  Pattern Recognition and Neural Networks , 1995 .

[5]  Francisco Herrera,et al.  Gradual distributed real-coded genetic algorithms , 2000, IEEE Trans. Evol. Comput..

[6]  Saman K. Halgamuge,et al.  Neural networks in designing fuzzy systems for real world applications , 1994 .

[7]  James M. Keller,et al.  Fuzzy Models and Algorithms for Pattern Recognition and Image Processing , 1999 .

[8]  Bart Kosko,et al.  Fuzzy Engineering , 1996 .

[9]  Abdollah Homaifar,et al.  Simultaneous design of membership functions and rule sets for fuzzy controllers using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[10]  Khaled Belarbi,et al.  Genetic algorithm for the design of a class of fuzzy controllers: an alternative approach , 2000, IEEE Trans. Fuzzy Syst..

[11]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[12]  Nikola K. Kasabov,et al.  Learning fuzzy rules and approximate reasoning in fuzzy neural networks and hybrid systems , 1996, Fuzzy Sets Syst..

[13]  N. Kasabov,et al.  Rule insertion and rule extraction from evolving fuzzy neural networks: algorithms and applications for building adaptive, intelligent expert systems , 1999, FUZZ-IEEE'99. 1999 IEEE International Fuzzy Systems. Conference Proceedings (Cat. No.99CH36315).

[14]  Magne Setnes,et al.  GA-fuzzy modeling and classification: complexity and performance , 2000, IEEE Trans. Fuzzy Syst..

[15]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[16]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[17]  Marco Russo,et al.  Genetic fuzzy learning , 2000, IEEE Trans. Evol. Comput..

[18]  Sankar K. Pal,et al.  Fuzzy multi-layer perceptron, inferencing and rule generation , 1995, IEEE Trans. Neural Networks.

[19]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[20]  Sushmita Mitra,et al.  Neuro-fuzzy rule generation: survey in soft computing framework , 2000, IEEE Trans. Neural Networks Learn. Syst..

[21]  Rudolf Kruse,et al.  A neuro-fuzzy method to learn fuzzy classification rules from data , 1997, Fuzzy Sets Syst..

[22]  Lutz Prechelt,et al.  PROBEN 1 - a set of benchmarks and benchmarking rules for neural network training algorithms , 1994 .

[23]  Satish Kumar,et al.  Subsethood-product fuzzy neural inference system (SuPFuNIS) , 2002, IEEE Trans. Neural Networks.

[24]  Marco Russo,et al.  FuGeNeSys-a fuzzy genetic neural system for fuzzy modeling , 1998, IEEE Trans. Fuzzy Syst..

[25]  Nikola Kasabov,et al.  Neuro-Fuzzy Techniques for Intelligent Information Systems , 1999 .

[26]  Nikola K. Kasabov,et al.  HyFIS: adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems , 1999, Neural Networks.