Particle Swarm Optimization of the Fuzzy Integrators for Time Series Prediction Using Ensemble of IT2FNN Architectures

This paper describes the construction of intelligent hybrid architectures and the optimization of the fuzzy integrators for time series prediction; interval type-2 fuzzy neural networks (IT2FNN). IT2FNN used hybrid learning algorithm techniques (gradient descent backpropagation and gradient descent with adaptive learning rate backpropagation). The IT2FNN is represented by Takagi–Sugeno–Kang reasoning. Therefore this TSK IT2FNN is represented as an adaptive neural network with hybrid learning in order to automatically generate an interval type-2 fuzzy logic system (TSK IT2FLS). We use interval type-2 and type-1 fuzzy systems to integrate the output (forecast) of each Ensemble of ANFIS models. Particle Swarm Optimization (PSO) was used for the optimization of membership functions (MFs) parameters of the fuzzy integrators. The Mackey-Glass time series is used to test of performance of the proposed architecture. Simulation results show the effectiveness of the proposed approach.

[1]  Jerry M. Mendel,et al.  Type-2 fuzzy logic systems , 1999, IEEE Trans. Fuzzy Syst..

[2]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[3]  J. Mendel.  Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions , 2001 .

[4]  P. Melin,et al.  A hybrid learning algorithm for Interval Type-2 Fuzzy Neural Networks in time series prediction for the case of air pollution , 2008, NAFIPS 2008 - 2008 Annual Meeting of the North American Fuzzy Information Processing Society.

[5]  Oscar Castillo,et al.  A Hybrid Learning Algorithm for Interval Type-2 Fuzzy Neural Networks: The Case of Time Series Prediction , 2008, Soft Computing for Hybrid Intelligent Systems.

[6]  Jerry M. Mendel,et al.  Applications of Type-2 Fuzzy Logic Systems to Forecasting of Time-series , 1999, Inf. Sci..

[7]  Yoshiki Uchikawa,et al.  On fuzzy modeling using fuzzy neural networks with the back-propagation algorithm , 1992, IEEE Trans. Neural Networks.

[8]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[9]  Piero P. Bonissone,et al.  Evolutionary algorithms + domain knowledge = real-world evolutionary computation , 2006, IEEE Transactions on Evolutionary Computation.

[10]  Martin T. Hagan,et al.  Neural network design , 1995 .

[11]  Yu-Ching Lin,et al.  System Identification and Adaptive Filter Using a Novel Fuzzy Neuro System , 2007 .

[12]  Lotfi A. Zadeh,et al.  Fuzzy logic = computing with words , 1996, IEEE Trans. Fuzzy Syst..

[13]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[14]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[15]  Kalyanmoy Deb,et al.  A population-based algorithm-generator for real-parameter optimization , 2005, Soft Comput..

[16]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[17]  Witold Pedrycz,et al.  Fuzzy evolutionary computation , 1997 .

[18]  Oscar Castillo,et al.  Optimization of type-2 fuzzy systems based on bio-inspired methods: A concise review , 2012, Inf. Sci..

[19]  Chi-Hsu Wang,et al.  Dynamical optimal training for interval type-2 fuzzy neural network (T2FNN) , 2003, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  Patricia Melin,et al.  An Ensemble Neural Network Architecture with Fuzzy Response Integration for Complex Time Series Prediction , 2009, Evolutionary Design of Intelligent Systems in Modeling, Simulation and Control.

[21]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[22]  Dongrui Wu,et al.  Genetic learning and performance evaluation of interval type-2 fuzzy logic controllers , 2006, Eng. Appl. Artif. Intell..

[23]  Martha Pulido,et al.  Particle swarm optimization of ensemble neural networks with fuzzy aggregation for time series prediction of the Mexican Stock Exchange , 2014, Inf. Sci..

[24]  M. Sugeno,et al.  Derivation of Fuzzy Control Rules from Human Operator's Control Actions , 1983 .

[25]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[26]  Jerry M. Mendel,et al.  A vector similarity measure for linguistic approximation: Interval type-2 and type-1 fuzzy sets , 2008, Inf. Sci..

[27]  Yu-Ching Lin,et al.  Type-2 Fuzzy Neuro System Via Input-to-State-Stability Approach , 2007, ISNN.

[28]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[29]  Michael N. Vrahatis,et al.  Particle Swarm Optimization and Intelligence: Advances and Applications , 2010 .

[30]  Chin-Teng Lin,et al.  Dynamic optimal learning rates of a certain class of fuzzy neural networks and its applications with genetic algorithm , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[31]  Oscar Castillo,et al.  Time series prediction using ensembles of ANFIS models with genetic optimization of interval type-2 and type-1 fuzzy integrators , 2014, Int. J. Hybrid Intell. Syst..

[32]  Oscar Castillo,et al.  A new approach for time series prediction using ensembles of ANFIS models , 2012, Expert Syst. Appl..

[33]  Hani Hagras.  Comments on "Dynamical Optimal Training for Interval Type-2 Fuzzy Neural Network (T2FNN) , 2006, IEEE Trans. Syst. Man Cybern. Part B.

[34]  Oscar Castillo,et al.  Optimization of type-2 fuzzy weight for neural network using genetic algorithm and particle swarm optimization , 2013, 2013 World Congress on Nature and Biologically Inspired Computing.

[35]  Witold Pedrycz.  Fuzzy Modelling: Paradigms and Practice , 2011 .

[36]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[37]  Lawrence W. Lan,et al.  Genetic fuzzy logic controller: an iterative evolution algorithm with new encoding method , 2005, Fuzzy Sets Syst..

[38]  Lotfi A. Zadeh,et al.  Fuzzy logic, neural networks, and soft computing , 1993, CACM.

[39]  Daniela Panno,et al.  An integrated fuzzy-GA approach for buffer management , 2006, IEEE Transactions on Fuzzy Systems.

[40]  Richard A. Davis,et al.  Introduction to time series and forecasting , 1998 .

[41]  Ebrahim H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Hum. Comput. Stud..