Sequential Adaptive Fuzzy Inference System for Function Approximation Problems

In the classic approaches to design a fuzzy inference system, the fuzzy rules are determined by a domain expert a priori and then they are maintained unchanged during the learning. These fixed fuzzy rules may not be appropriate in real-time applications where the environment or model often meets unpredicted disturbances or damages. Hence, poor performance may be observed. In comparison to the conventional methods, fuzzy inference systems based on neural networks, called fuzzy-neural systems, have begun to exhibit great potential for adapting to the changes by utilizing the learning ability and adaptive capability of neural networks. Thus, a fuzzy inference system can be built using the standard structure of neural networks. Nevertheless, the determination of the number of fuzzy rules and the adjustment of the parameters in the if-then fuzzy rules are still open issues. A sequential adaptive fuzzy inference system (SAFIS) is developed to determine the number of fuzzy rules during learning and modify the parameters in fuzzy rules simultaneously. SAFIS uses the concept of influence of a fuzzy rule for adding and removing rules during learning. The influence of a fuzzy rule is defined as its contribution to the system output in a statistical sense when the input data is uniformly distributed. When there is no addition of fuzzy rules, only the parameters of the “closest” (in a Euclidean sense) rule are updated using an extended Kalman filter (EKF) scheme. The performance of SAFIS is evaluated based on some function approximation problems, via, nonlinear system identification problems and a chaotic time-series prediction problem. Results indicate that SAFIS produces similar or better accuracies with lesser number of rules compared to other algorithms.

[1]  T. Martin McGinnity,et al.  An approach for on-line extraction of fuzzy rules using a self-organising fuzzy neural network , 2005, Fuzzy Sets Syst..

[2]  Madan M. Gupta,et al.  On the principles of fuzzy neural networks , 1994 .

[3]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[4]  Narasimhan Sundararajan,et al.  An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Witold Pedrycz,et al.  Fuzzy-set based models of neurons and knowledge-based networks , 1993, IEEE Trans. Fuzzy Syst..

[6]  Meng Joo Er,et al.  Dynamic fuzzy neural networks-a novel approach to function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[7]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[8]  Witold Pedrycz,et al.  Fuzzy control and fuzzy systems , 1989 .

[9]  Y Lu,et al.  A Sequential Learning Scheme for Function Approximation Using Minimal Radial Basis Function Neural Networks , 1997, Neural Computation.

[10]  Jerry M. Mendel,et al.  A fuzzy logic method for modulation classification in nonideal environments , 1999, IEEE Trans. Fuzzy Syst..

[11]  Stephen L. Chiu,et al.  Selecting Input Variables for Fuzzy Models , 1996, J. Intell. Fuzzy Syst..

[12]  Kwang Bo Cho,et al.  Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction , 1996, Fuzzy Sets Syst..

[13]  John C. Platt A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[14]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  John Yen,et al.  Extracting fuzzy rules for system modeling using a hybrid of genetic algorithms and Kalman filter , 1999, Fuzzy Sets Syst..

[16]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[17]  Babak Nadjar Araabi,et al.  An online predictor model as adaptive habitually linear and transiently nonlinear model , 2010, Evol. Syst..

[18]  V. Miranda,et al.  Prediction of LV substation load curves with fuzzy inference systems , 2004, 2004 International Conference on Probabilistic Methods Applied to Power Systems.

[19]  Ebrahim H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Hum. Comput. Stud..

[20]  José de Jesús Rubio,et al.  SOFMLS: Online Self-Organizing Fuzzy Modified Least-Squares Network , 2009, IEEE Transactions on Fuzzy Systems.

[21]  Vladimír Olej,et al.  Prediction of gross domestic product development by Takagi-Sugeno fuzzy inference systems , 2005, 5th International Conference on Intelligent Systems Design and Applications (ISDA'05).

[22]  Dimitar Filev,et al.  On-Line Evolution of Takagi-Sugeno Fuzzy Models , 2004, IFAC Proceedings Volumes.

[23]  Visakan Kadirkamanathan,et al.  A Function Estimation Approach to Sequential Learning with Neural Networks , 1993, Neural Computation.

[24]  Abraham Kandel,et al.  Fuzzy Expert Systems , 1991 .

[25]  R. Iqdour,et al.  A rule based fuzzy model for the prediction of daily solar radiation , 2004, 2004 IEEE International Conference on Industrial Technology, 2004. IEEE ICIT '04..

[26]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[27]  Chuen-Tsai Sun,et al.  Functional equivalence between radial basis function networks and fuzzy inference systems , 1993, IEEE Trans. Neural Networks.

[28]  Sushmita Mitra,et al.  Neuro-fuzzy rule generation: survey in soft computing framework , 2000, IEEE Trans. Neural Networks Learn. Syst..

[29]  Narasimhan Sundararajan,et al.  A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation , 2005, IEEE Transactions on Neural Networks.

[30]  Babak Nadjar Araabi,et al.  Recursive Gath–Geva clustering as a basis for evolving neuro-fuzzy modeling , 2010, Evol. Syst..

[31]  Plamen P. Angelov,et al.  Simpl_eTS: a simplified method for learning evolving Takagi-Sugeno fuzzy models , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[32]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[33]  B. Karthikeyan,et al.  Partial discharge pattern classification using fuzzy expert system , 2004, Proceedings of the 2004 IEEE International Conference on Solid Dielectrics, 2004. ICSD 2004..