Hybrid fuzzy set-based polynomial neural networks and their development with the aid of genetic optimization and information granulation

We introduce a new architecture of feed-forward neural networks called hybrid fuzzy set-based polynomial neural networks (HFSPNNs) that are composed of heterogeneous feed-forward neural networks such as polynomial neural networks (PNNs) and fuzzy set-based polynomial neural networks (FSPNNs). We develop their comprehensive design methodology by embracing mechanisms of genetic optimization and information granulation. The construction of information granulation-driven HFSPNN exploits fundamental technologies of computational intelligence (CI), namely fuzzy sets, neural networks, and genetic algorithms (GAs). The architecture of the resulting information granulation-driven genetically optimized HFSPNN results from a synergistic usage of the hybrid system generated by combining original fuzzy set-based polynomial neurons (FSPNs)-based FSPNN with polynomial neurons (PNs)-based PNN. The design of the conventional genetically optimized HFPNN exploits the extended Group Method of Data Handling (GMDH) whose some essential parameters of the network being tuned with the use of genetic algorithms throughout the overall development process. Two general optimization mechanisms are explored. First, the structural optimization is realized via GAs while the ensuing detailed parametric optimization is carried out in the setting of a standard least square method-based learning. The performance of the gHFSPNN is quantified through extensive experimentation where we considered a number of modeling benchmarks (synthetic and experimental data already experimented with in fuzzy or neurofuzzy modeling).

[1]  Francisco Herrera,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2004, Fuzzy Sets Syst..

[2]  Vladimir Cherkassky,et al.  Comparison of adaptive methods for function estimation from samples , 1996, IEEE Trans. Neural Networks.

[3]  Lin-Lin Huang,et al.  Face detection from cluttered images using a polynomial neural network , 2003, Neurocomputing.

[4]  Euntai Kim,et al.  A Simple Identified Sugeno-Type Fuzzy Model via Double Clustering , 1998, Inf. Sci..

[5]  Kenneth A. De Jong,et al.  Are Genetic Algorithms Function Optimizers? , 1992, PPSN.

[6]  Antonio F. Gómez-Skarmeta,et al.  About the use of fuzzy clustering techniques for fuzzy model identification , 1999, Fuzzy Sets Syst..

[7]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[8]  Bart Kosko,et al.  Fuzzy function approximation with ellipsoidal rules , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Ingemar Lundström,et al.  Neural networks and abductive networks for chemical sensor signals: a case comparison , 1995 .

[10]  Ali Moeini,et al.  Evolutionary design of generalized polynomial neural networks for modelling and prediction of explosive forming process , 2005 .

[11]  T. Martin McGinnity,et al.  Predicting a Chaotic Time Series using Fuzzy Neural network , 1998, Inf. Sci..

[12]  Sung-Kwun Oh,et al.  Rule-based multi-FNN identification with the aid of evolutionary fuzzy granulation , 2004, Knowl. Based Syst..

[13]  Hitoshi Iba,et al.  Polynomial harmonic GMDH learning networks for time series modeling , 2003, Neural Networks.

[14]  Yu-Geng Xi,et al.  A clustering algorithm for fuzzy model identification , 1998, Fuzzy Sets Syst..

[15]  Sung-Kwun Oh,et al.  Polynomial neural networks architecture: analysis and design , 2003, Comput. Electr. Eng..

[16]  Narasimhan Sundararajan,et al.  An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  SUNG-KWUN OH,et al.  Hybrid Fuzzy Polynomial Neural Networks , 2002, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[18]  K. Asai,et al.  Fuzzy linear programming problems with fuzzy numbers , 1984 .

[19]  Sung-Kwun Oh,et al.  The design of self-organizing Polynomial Neural Networks , 2002, Inf. Sci..

[20]  Yin Wang,et al.  A self-organizing neural-network-based fuzzy system , 1999, Fuzzy Sets Syst..

[21]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[22]  Jacek M. Leski,et al.  A new artificial neural network based fuzzy inference system with moving consequents in if-then rules and selected applications , 1999, Fuzzy Sets Syst..

[23]  R. Tong The evaluation of fuzzy models derived from experimental data , 1980 .

[24]  Witold Pedrycz,et al.  Linguistic models as a framework of user-centric system modeling , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[25]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[26]  Yinghua Lin,et al.  A new approach to fuzzy-neural system modeling , 1995, IEEE Trans. Fuzzy Syst..

[27]  Sung-Kwun Oh,et al.  Self-organizing polynomial neural networks based on polynomial and fuzzy polynomial neurons: analysis and design , 2004, Fuzzy Sets Syst..

[28]  Sung-Kwun Oh,et al.  Self-organizing neural networks with fuzzy polynomial neurons , 2002, Appl. Soft Comput..

[29]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[30]  Euntai Kim,et al.  A new approach to fuzzy modeling , 1997, IEEE Trans. Fuzzy Syst..

[31]  Sung-Kwun Oh,et al.  Fuzzy Polynomial Neuron-Based Self-Organizing Neural Networks , 2003, Int. J. Gen. Syst..

[32]  Sung-Kwun Oh,et al.  Identification of fuzzy systems by means of an auto-tuning algorithm and its application to nonlinear systems , 2000, Fuzzy Sets Syst..

[33]  Seok-Beom Roh,et al.  Genetic Optimization of Fuzzy Polynomial Neural Networks , 2007, IEEE Transactions on Industrial Electronics.

[34]  W. Pedrycz An identification algorithm in fuzzy relational systems , 1984 .

[35]  Sung-Kwun Oh,et al.  A New Modeling Approach to Fuzzy-Neural Networks Architecture , 2001 .

[36]  Sung-Kwun Oh,et al.  Genetically optimized fuzzy polynomial neural networks , 2006, IEEE Transactions on Fuzzy Systems.

[37]  Nariman Sepehri,et al.  A polynomial network modeling approach to a class of large-scale hydraulic systems , 1996 .

[38]  Sung-Kwun Oh,et al.  Hybrid identification in fuzzy-neural networks , 2003, Fuzzy Sets Syst..

[39]  O Seong-Gwon,et al.  A Study on the Optimal Design of Polynomial Neural Networks Structure , 2000 .

[40]  Agostino Di Ciaccio,et al.  Improving nonparametric regression methods by bagging and boosting , 2002 .

[41]  Sung-Kwun Oh,et al.  Optimization of Fuzzy Set-Fuzzy Systems based on IG by Means of GAs with Successive Tuning Method , 2008 .

[42]  C. James Li,et al.  Automatic structure and parameter training methods for modeling of mechanical systems by recurrent neural networks , 1999 .

[43]  Yong-Zai Lu,et al.  Fuzzy Model Identification and Self-Learning for Dynamic Systems , 1987, IEEE Transactions on Systems, Man, and Cybernetics.