Extreme Learning for Evolving Hybrid Neural Networks

This paper addresses a structure and introduces an evolving learning approach to train uninorm-based hybrid neural networks using extreme learning concepts. Evolving systems are high level adaptive systems able to simultaneously modify their structures and parameters from a stream of data, online. Learning from data streams is a contemporary and challenging issue due to the increasing rate of the size and temporal availability of data, turning traditional learning methods impracticable. Uninorm-based neurons, rooted in triangular norms and co norms, generalize fuzzy neurons. Uninorms bring flexibility and generality to fuzzy neuron models as they can behave like triangular norms, triangular co norms, or in between by adjusting identity elements. This feature adds a form of plasticity in neural network modeling. An online clustering method is used to granulate the input space, and a scheme based on extreme learning is developed to train the neural network. Computational results show that the learning approach is competitive when compared with alternative evolving modeling methods.

[1]  Witold Pedrycz,et al.  Fuzzy-set based models of neurons and knowledge-based networks , 1993, IEEE Trans. Fuzzy Syst..

[2]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[3]  Nikola Kasabov,et al.  Evolving Connectionist Systems: The Knowledge Engineering Approach , 2007 .

[4]  F. Gomide,et al.  Participatory Evolving Fuzzy Modeling , 2006, 2006 International Symposium on Evolving Fuzzy Systems.

[5]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[6]  Fernando Gomide,et al.  New uninorm-based neuron model and fuzzy neural networks , 2010, 2010 Annual Meeting of the North American Fuzzy Information Processing Society.

[7]  F. Gomide,et al.  Participatory Learning in Power Transformers Thermal Modeling , 2008, IEEE Transactions on Power Delivery.

[8]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[9]  Plamen P. Angelov,et al.  Simpl_eTS: a simplified method for learning evolving Takagi-Sugeno fuzzy models , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[10]  P. Angelov,et al.  Evolving Fuzzy Systems from Data Streams in Real-Time , 2006, 2006 International Symposium on Evolving Fuzzy Systems.

[11]  Secundino Soares,et al.  A recurrent neuro-fuzzy network structure and learning procedure , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[12]  Plamen Angelov,et al.  Evolving Fuzzy Rule-Based Models , 2000 .

[13]  Nikola K. Kasabov,et al.  Evolving connectionist systems - the knowledge engineering approach (2. ed.) , 2007 .

[14]  Vladik Kreinovich,et al.  Universal approximation with uninorm-based fuzzy neural networks , 2011, 2011 Annual Meeting of the North American Fuzzy Information Processing Society.

[15]  Witold Pedrycz,et al.  Logic-Based Fuzzy Neurocomputing With Unineurons , 2006, IEEE Transactions on Fuzzy Systems.

[16]  Fernando A. C. Gomide,et al.  Hybrid neurofuzzy computing with nullneurons , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[17]  Edwin Lughofer,et al.  FLEXFIS: A Robust Incremental Learning Approach for Evolving Takagi–Sugeno Fuzzy Models , 2008, IEEE Transactions on Fuzzy Systems.

[18]  Plamen Angelov,et al.  Evolving Takagi‐Sugeno Fuzzy Systems from Streaming Data (eTS+) , 2010 .

[19]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  Daniel F. Leite,et al.  Fuzzy granular evolving modeling for time series prediction , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[21]  Ronald R. Yager,et al.  Uninorm aggregation operators , 1996, Fuzzy Sets Syst..

[22]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[23]  Fernando Gomide,et al.  Uninetworks in time series forecasting , 2009, NAFIPS 2009 - 2009 Annual Meeting of the North American Fuzzy Information Processing Society.