Statistically Evolving Fuzzy Inference System for Non-Gaussian Noises

Non-Gaussian noises always exist in the nonlinear system, which usually lead to inconsistency and divergence of the regression and identification applications. The conventional evolving fuzzy systems (EFSs) in common sense have succeeded to conquer the uncertainties and external disturbance employing the specific variable structure characteristic. However, non-Gaussian noises would trigger the frequent changes of structure under the transient criteria, which severely degrades performance. Statistical criterion provides an informed choice of the strategies of the structure evolution, utilizing the approximation uncertainty as the observation of model sufficiency. The approximation uncertainty can be always decomposed into model uncertainty term and noise term, and is suitable for the non-Gaussian noise condition, especially relaxing the traditional Gaussian assumption. In this paper, a novel incremental statistical evolving fuzzy inference system (SEFIS) is proposed, which has the capacity of updating the system parameters, and evolving the structure components to integrate new knowledge in the new process characteristic, system behavior, and operating conditions with non-Gaussian noises. The system generates a new rule based on the statistical model sufficiency which gives so insight into whether models are reliable and their approximations can be trusted. The nearest rule presents the inactive rule under the current data stream and further would be deleted without losing any information and accuracy of the subsequent trained models when the model sufficiency is satisfied. In our work, an adaptive maximum correntropy extend Kalman filter (AMCEKF) is derived to update the parameters of the evolving rules to cope with the non-Gaussian noises problems to further improve the robustness of parameter updating process. The parameter updating process shares an estimate of the uncertainty with the criteria of the structure evolving process to make the computation less of a burden dramatically. The simulation studies show that the proposed SEFIS has faster learning speed and is more accurate than the existing evolving fuzzy systems (EFSs) in the case of noise-free and noisy conditions.

[1]  Aparajita Sengupta,et al.  Likelihood function modeling of particle filter in presence of non-stationary non-gaussian measurement noise , 2010, Signal Process..

[2]  Edwin Lughofer,et al.  FLEXFIS: A Robust Incremental Learning Approach for Evolving Takagi–Sugeno Fuzzy Models , 2008, IEEE Transactions on Fuzzy Systems.

[3]  Chin-Teng Lin,et al.  Identification and Prediction of Dynamic Systems Using an Interactively Recurrent Self-Evolving Fuzzy Neural Network , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Plamen Angelov,et al.  Evolving Fuzzy Modeling Using Participatory Learning , 2010 .

[5]  Chih-Min Lin,et al.  Wavelet-TSK-Type Fuzzy Cerebellar Model Neural Network for Uncertain Nonlinear Systems , 2019, IEEE Transactions on Fuzzy Systems.

[6]  Xiao-Jun Zeng,et al.  A Self-Evolving Fuzzy System Which Learns Dynamic Threshold Parameter by Itself , 2019, IEEE Transactions on Fuzzy Systems.

[7]  Mahardhika Pratama,et al.  A novel Spatio-Temporal Fuzzy Inference System (SPATFIS) and its stability analysis , 2019, Inf. Sci..

[8]  Igor Skrjanc,et al.  Evolving fuzzy and neuro-fuzzy approaches in clustering, regression, identification, and classification: A Survey , 2019, Inf. Sci..

[9]  Sreenatha G. Anavatti,et al.  PALM: An Incremental Construction of Hyperplanes for Data Stream Regression , 2018, IEEE Transactions on Fuzzy Systems.

[10]  Fernando Gomide,et al.  Evolving Possibilistic Fuzzy Modeling for Realized Volatility Forecasting With Jumps , 2017, IEEE Transactions on Fuzzy Systems.

[11]  Plamen P. Angelov,et al.  PANFIS: A Novel Incremental Learning Machine , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Zhixin Yang,et al.  Robust and Noise-Insensitive Recursive Maximum Correntropy-Based Evolving Fuzzy System , 2020, IEEE Transactions on Fuzzy Systems.

[13]  Narasimhan Sundararajan,et al.  Online Sequential Fuzzy Extreme Learning Machine for Function Approximation and Classification Problems , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Kwang Bo Cho,et al.  Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction , 1996, Fuzzy Sets Syst..

[15]  Richard D. Braatz,et al.  On the "Identification and control of dynamical systems using neural networks" , 1997, IEEE Trans. Neural Networks.

[16]  T. Martin McGinnity,et al.  An approach for on-line extraction of fuzzy rules using a self-organising fuzzy neural network , 2005, Fuzzy Sets Syst..

[17]  W. Cleveland Robust Locally Weighted Regression and Smoothing Scatterplots , 1979 .

[18]  Plamen P. Angelov,et al.  Evolving Fuzzy-Rule-Based Classifiers From Data Streams , 2008, IEEE Transactions on Fuzzy Systems.

[19]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[20]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  José de Jesús Rubio,et al.  SOFMLS: Online Self-Organizing Fuzzy Modified Least-Squares Network , 2009, IEEE Transactions on Fuzzy Systems.

[22]  Plamen P. Angelov,et al.  Simpl_eTS: a simplified method for learning evolving Takagi-Sugeno fuzzy models , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[23]  Walmir M. Caminhas,et al.  Multivariable Gaussian Evolving Fuzzy Modeling System , 2011, IEEE Transactions on Fuzzy Systems.

[24]  Plamen P. Angelov,et al.  Correntropy-Based Evolving Fuzzy Neural System , 2018, IEEE Transactions on Fuzzy Systems.

[25]  Paramasivan Saratchandran,et al.  Sequential Adaptive Fuzzy Inference System (SAFIS) for nonlinear system identification and prediction , 2006, Fuzzy Sets Syst..

[26]  Narasimhan Sundararajan,et al.  A Metacognitive Neuro-Fuzzy Inference System (McFIS) for Sequential Classification Problems , 2013, IEEE Transactions on Fuzzy Systems.

[27]  N. Sundararajan,et al.  Extended sequential adaptive fuzzy inference system for classification problems , 2011, Evol. Syst..