Stability of Evolving Fuzzy Systems Based on Data Clouds

Evolving fuzzy systems (EFSs) are now well developed and widely used, thanks to their ability to self-adapt both their structures and parameters online. Since the concept was first introduced two decades ago, many different types of EFSs have been successfully implemented. However, there are only very few works considering the stability of the EFSs, and these studies were limited to certain types of membership functions with specifically predefined parameters, which largely increases the complexity of the learning process. At the same time, stability analysis is of paramount importance for control applications and provides the theoretical guarantees for the convergence of the learning algorithms. In this paper, we introduce the stability proof of a class of EFSs based on data clouds, which are grounded at the AnYa type fuzzy systems and the recently introduced empirical data analytics (EDA) methodological framework. By employing data clouds, the class of EFSs of AnYa type considered in this paper avoids the traditional way of defining membership functions for each input variable in an explicit manner and its learning process is entirely data driven. The stability of the considered EFS of AnYa type is proven through the Lyapunov theory, and the proof of stability shows that the average identification error converges to a small neighborhood of zero. Although, the stability proof presented in this paper is specially elaborated for the considered EFS, it is also applicable to general EFSs. The proposed method is illustrated with Box–Jenkins gas furnace problem, one nonlinear system identification problem, Mackey–Glass time series prediction problem, eight real-world benchmark regression problems as well as a high-frequency trading prediction problem. Compared with other EFSs, the numerical examples show that the considered EFS in this paper provides guaranteed stability as well as a better approximation accuracy.

[1]  Edwin Lughofer,et al.  FLEXFIS: A Robust Incremental Learning Approach for Evolving Takagi–Sugeno Fuzzy Models , 2008, IEEE Transactions on Fuzzy Systems.

[2]  Paramasivan Saratchandran,et al.  Sequential Adaptive Fuzzy Inference System (SAFIS) for nonlinear system identification and prediction , 2006, Fuzzy Sets Syst..

[3]  Mahardhika Pratama,et al.  GENEFIS: Toward an Effective Localist Network , 2014, IEEE Transactions on Fuzzy Systems.

[4]  Plamen P. Angelov,et al.  On-line Design of Takagi-Sugeno Models , 2003, IFSA.

[5]  Yung C. Shin,et al.  Construction of fuzzy systems using least-squares method and genetic algorithm , 2003, Fuzzy Sets Syst..

[6]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[7]  Frank Klawonn,et al.  Effects of drift and noise on the optimal sliding window size for data stream regression models , 2017 .

[8]  Xiaowei Gu,et al.  Empirical Data Analytics , 2017, Int. J. Intell. Syst..

[9]  Xiaoou Li,et al.  Fuzzy identification using fuzzy neural networks with stable learning algorithms , 2004, IEEE Transactions on Fuzzy Systems.

[10]  Plamen P. Angelov,et al.  PANFIS: A Novel Incremental Learning Machine , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[11]  T. Martin McGinnity,et al.  An approach for on-line extraction of fuzzy rules using a self-organising fuzzy neural network , 2005, Fuzzy Sets Syst..

[12]  Fernando Gomide,et al.  Evolving Possibilistic Fuzzy Modeling for Realized Volatility Forecasting With Jumps , 2017, IEEE Transactions on Fuzzy Systems.

[13]  Yuni Xia,et al.  StreamFitter: A Real Time Linear Regression Analysis System for Continuous Data Streams , 2011, DASFAA.

[14]  Sundaram Suresh,et al.  A meta-cognitive sequential learning algorithm for neuro-fuzzy inference system , 2012, Appl. Soft Comput..

[15]  Plamen P. Angelov,et al.  Correntropy-Based Evolving Fuzzy Neural System , 2018, IEEE Transactions on Fuzzy Systems.

[16]  John Yen,et al.  Extracting fuzzy rules for system modeling using a hybrid of genetic algorithms and Kalman filter , 1999, Fuzzy Sets Syst..

[17]  José de Jesús Rubio,et al.  SOFMLS: Online Self-Organizing Fuzzy Modified Least-Squares Network , 2009, IEEE Transactions on Fuzzy Systems.

[18]  Dejan Dovzan,et al.  Implementation of an Evolving Fuzzy Model (eFuMo) in a Monitoring System for a Waste-Water Treatment Process , 2015, IEEE Transactions on Fuzzy Systems.

[19]  P. Angelov,et al.  Evolving rule-based models: A tool for intelligent adaptation , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[20]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[21]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[22]  Junfei Qiao,et al.  A Self-Organizing Fuzzy Neural Network Based on a Growing-and-Pruning Algorithm , 2010, IEEE Transactions on Fuzzy Systems.

[23]  Plamen P. Angelov,et al.  Empirical Fuzzy Sets , 2018, Int. J. Intell. Syst..

[24]  Walmir M. Caminhas,et al.  Multivariable Gaussian Evolving Fuzzy Modeling System , 2011, IEEE Transactions on Fuzzy Systems.

[25]  Plamen Angelov,et al.  Autonomous Learning Systems: From Data Streams to Knowledge in Real-time , 2013 .

[26]  P. Angelov,et al.  Evolving Fuzzy Systems from Data Streams in Real-Time , 2006, 2006 International Symposium on Evolving Fuzzy Systems.

[27]  Plamen P. Angelov,et al.  A new type of simplified fuzzy rule-based system , 2012, Int. J. Gen. Syst..

[28]  Klaus Nordhausen,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition by Trevor Hastie, Robert Tibshirani, Jerome Friedman , 2009 .

[29]  Edwin Lughofer,et al.  SparseFIS: Data-Driven Learning of Fuzzy Systems With Sparsity Constraints , 2010, IEEE Transactions on Fuzzy Systems.

[30]  Plamen P. Angelov,et al.  Uniformly Stable Backpropagation Algorithm to Train a Feedforward Neural Network , 2011, IEEE Transactions on Neural Networks.

[31]  Mahardhika Pratama,et al.  Generalized smart evolving fuzzy systems , 2015, Evol. Syst..

[32]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[33]  N. Sundararajan,et al.  Extended sequential adaptive fuzzy inference system for classification problems , 2011, Evol. Syst..

[34]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[35]  Plamen P. Angelov,et al.  Simpl_eTS: a simplified method for learning evolving Takagi-Sugeno fuzzy models , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[36]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[37]  Robert Babuska,et al.  Fuzzy Modeling for Control , 1998 .

[38]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.