Hybrid Fuzzy Polynomial Neural Networks

We propose a hybrid architecture based on a combination of fuzzy systems and polynomial neural networks. The resulting Hybrid Fuzzy Polynomial Neural Networks (HFPNN) dwells on the ideas of fuzzy rule-based computing and polynomial neural networks. The structure of the network comprises of fuzzy polynomial neurons (FPNs) forming the nodes of the first (input) layer of the HFPNN and polynomial neurons (PNs) that are located in the consecutive layers of the network. In the FPN (that forms a fuzzy inference system), the generic rules assume the form "if A then y = P(x)" where A is a fuzzy relation in the condition space while P(x) is a polynomial standing in the conclusion part of the rule. The conclusion part of the rules, especially the regression polynomial uses several types of high-order polynomials such as constant, linear, quadratic, and modified quadratic. As the premise part of the rules, both triangular and Gaussian-like membership functions are considered. Each PN of the network realizes a polynomial type of partial description (PD) of the mapping between input and out variables. HFPNN is a flexible neural architecture whose structure is based on the Group Method of Data Handling (GMDH) and developed through learning. In particular, the number of layers of the PNN is not fixed in advance but is generated in a dynamic way. The experimental part of the study involves two representative numerical examples such as chaotic time series and Box-Jenkins gas furnace data.

[1]  Stanley J. Farlow,et al.  Self-Organizing Methods in Modeling: Gmdh Type Algorithms , 1984 .

[2]  Shyh Hwang,et al.  An identification algorithm in fuzzy relational systems , 1996, Soft Computing in Intelligent Systems and Information Processing. Proceedings of the 1996 Asian Fuzzy Systems Symposium.

[3]  L X Wang,et al.  Fuzzy basis functions, universal approximation, and orthogonal least-squares learning , 1992, IEEE Trans. Neural Networks.

[4]  Ingemar Lundström,et al.  Neural networks and abductive networks for chemical sensor signals: a case comparison , 1995 .

[5]  T. Martin McGinnity,et al.  Predicting a Chaotic Time Series using Fuzzy Neural network , 1998, Inf. Sci..

[6]  Tianping Chen,et al.  Approximation capability to functions of several variables, nonlinear functionals and operators by radial basis function neural networks , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[7]  Sung-Kwun Oh,et al.  Identification of fuzzy systems by means of an auto-tuning algorithm and its application to nonlinear systems , 2000, Fuzzy Sets Syst..

[8]  Nariman Sepehri,et al.  A polynomial network modeling approach to a class of large-scale hydraulic systems , 1996 .

[9]  Sung-Kwun Oh,et al.  The hybrid multi-layer inference architecture and algorithm of FPNN based on FNN and PNN , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[10]  O Seong-Gwon,et al.  A Study on the Optimal Design of Polynomial Neural Networks Structure , 2000 .

[11]  A. Lapedes,et al.  Nonlinear Signal Processing Using Neural Networks , 1987 .

[12]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[13]  Sung-Kwun Oh,et al.  A study on the self-organizing polynomial neural networks , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[14]  Hong Chen,et al.  Approximation capability to functions of several variables, nonlinear functionals, and operators by radial basis function neural networks , 1993, IEEE Trans. Neural Networks.

[15]  A. G. Ivakhnenko,et al.  Polynomial Theory of Complex Systems , 1971, IEEE Trans. Syst. Man Cybern..

[16]  Euntai Kim,et al.  A Simple Identified Sugeno-Type Fuzzy Model via Double Clustering , 1998, Inf. Sci..

[17]  R. Scott Crowder,et al.  Predicting the Mackey-Glass Timeseries With Cascade-Correlation Learning , 1990 .

[18]  Yinghua Lin,et al.  A new approach to fuzzy-neural system modeling , 1995, IEEE Trans. Fuzzy Syst..

[19]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[20]  Yu-Geng Xi,et al.  Nonlinear system modeling by competitive learning and adaptive fuzzy inference system , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[21]  W. Pedrycz.  An identification algorithm in fuzzy relational systems , 1984 .

[22]  Yong-Zai Lu,et al.  Fuzzy Model Identification and Self-Learning for Dynamic Systems , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[23]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[24]  R. Tong.  The evaluation of fuzzy models derived from experimental data , 1980 .

[25]  J.-S.R. Jang,et al.  Predicting chaotic time series with fuzzy if-then rules , 1993, [Proceedings 1993] Second IEEE International Conference on Fuzzy Systems.