A novel evolutionary TSK-subsethood model and its parallel implementation

A novel evolutionary TSK-subsethood fuzzy-neural network model along with its parallel implementation on a LAM/MPI cluster is presented in this paper. The proposed four-layered network is inspired by the subsethood class of models, which have ability to seamlessly compose numeric and linguistic data simultaneously. The proposed model embeds TSK rules into the network architecture, while transmitting information using subsethood products and a linear weighted sum of fuzzy sets. L-R arithmetic is used in the internal operation of the network. Differential evolution learning is employed to evolve tunable parameters of the network. A parallel implementation using a master-slave approach efficiently distributes the computational load of string evaluations on a LAM/MPI cluster.The proposed model is tested on two benchmark problems: Iris Classification, Mackey Glass time series prediction.

[1]  Satish Kumar,et al.  Differential Evolution Based On-Line Feature Analysis in an Asymmetric Subsethood Product Fuzzy Neural Network , 2004, ICONIP.

[2]  Marco Russo,et al.  Genetic fuzzy learning , 2000, IEEE Trans. Evol. Comput..

[3]  E. H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Man Mach. Stud..

[4]  Riccardo Poli,et al.  New ideas in optimization , 1999 .

[5]  Nikhil R. Pal,et al.  Genetic programming for simultaneous feature selection and classifier design , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Hak-Keung Lam,et al.  Tuning of the structure and parameters of a neural network using an improved genetic algorithm , 2003, IEEE Trans. Neural Networks.

[7]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[8]  Peter Raeth,et al.  Book review: Fuzzy Engineering by Bart Kosko (Prentice Hall, 1997) , 1998, SGAR.

[9]  Satish Kumar,et al.  Subsethood-product fuzzy neural inference system (SuPFuNIS) , 2002, IEEE Trans. Neural Networks.

[10]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[12]  Sankar K. Pal,et al.  Neuro-Fuzzy Pattern Recognition: Methods in Soft Computing , 1999 .

[13]  Xin Yao,et al.  A new evolutionary system for evolving artificial neural networks , 1997, IEEE Trans. Neural Networks.

[14]  Nikola Kasabov,et al.  Neuro-Fuzzy Techniques for Intelligent Information Systems , 1999 .

[15]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[16]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[17]  Sankar K. Pal,et al.  Multilayer perceptron, fuzzy sets, and classification , 1992, IEEE Trans. Neural Networks.

[18]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[19]  Tao Jiang,et al.  Efficient and robust feature extraction by maximum margin criterion , 2003, IEEE Transactions on Neural Networks.

[20]  Deniz Erdogmus,et al.  Feature selection in MLPs and SVMs based on maximum output information , 2004, IEEE Transactions on Neural Networks.

[21]  Bart Kosko,et al.  Fuzzy Engineering , 1996 .

[22]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[23]  James C. Bezdek,et al.  Nearest prototype classification: clustering, genetic algorithms, or random search? , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[24]  Satish Kumar,et al.  Asymmetric subsethood-product fuzzy neural inference system (ASuPFuNIS) , 2005, IEEE Transactions on Neural Networks.

[25]  Olga Kosheleva,et al.  IEEE International Conference on Fuzzy Systems , 1996 .

[26]  Tung-Kuan Liu,et al.  Tuning the structure and parameters of a neural network by using hybrid Taguchi-genetic algorithm , 2006, IEEE Trans. Neural Networks.