Evolutionary Extreme Learning Machine for the Interval Type-2 Radial Basis Function Neural Network: A Fuzzy Modelling Approach

Evolutionary Extreme Learning Machine (E-ELM) is frequently much more efficient than traditional gradient-based algorithms for the parameter identification of feedforward neural networks. In particular, E-ELM is usually faster and provides a higher trade-off between accuracy and model simplicity. For that reason, this paper shows that an E-ELM that is based on Particle Swarm Optimisation (PSO) and Extreme Learning machine (ELM) can be extended to the Interval Type-2 Radial Basis Function Neural Network (IT2-RBFNN) with a Karnik-Mendel type-reduction layer. To evaluate the efficiency of E-ELM, the IT2-RBFNN is used as an Interval Type-2 Fuzzy Logic System (IT2 FLS) for the modelling of two popular benchmark data sets and for the prediction of chaotic time series. According to our results, E-ELM applied to the IT2-RBFNN not only outperforms adaptive-gradient-based algorithms and provides a better generalisation compared to other existing IT2 fuzzy methodologies, but similarly to pure fuzzy models, the IT2-RBFNN is also able to preserve some model interpretation and transparency.

[1]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[2]  Jerry M. Mendel,et al.  General Type-2 Fuzzy Logic Systems Made Simple: A Tutorial , 2014, IEEE Transactions on Fuzzy Systems.

[3]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[4]  I-Cheng Yeh,et al.  Modeling of strength of high-performance concrete using artificial neural networks , 1998 .

[5]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[6]  Chuen-Tsai Sun,et al.  Functional equivalence between radial basis function networks and fuzzy inference systems , 1993, IEEE Trans. Neural Networks.

[7]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Witold Pedrycz,et al.  Design of Reinforced Interval Type-2 Fuzzy C-Means-Based Fuzzy Classifier , 2018, IEEE Transactions on Fuzzy Systems.

[9]  Oscar Castillo,et al.  An Extension of the Fuzzy Possibilistic Clustering Algorithm Using Type-2 Fuzzy Logic Techniques , 2017, Adv. Fuzzy Syst..

[10]  George Panoutsos,et al.  Fuzzy uncertainty assessment in RBF Neural Networks using neutrosophic sets for multiclass classification , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[11]  J. Mendel Fuzzy logic systems for engineering: a tutorial , 1995, Proc. IEEE.

[12]  George Panoutsos,et al.  A Data-driven fuzzy modelling framework for the classification of imbalanced data , 2016, 2016 IEEE 8th International Conference on Intelligent Systems (IS).

[13]  Longbing Cao,et al.  T2FELA: Type-2 Fuzzy Extreme Learning Algorithm for Fast Training of Interval Type-2 TSK Fuzzy Logic System , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Fei Han,et al.  An improved evolutionary extreme learning machine based on particle swarm optimization , 2013, Neurocomputing.

[15]  Patricia Melin,et al.  A hybrid learning method composed by the orthogonal least-squares and the back-propagation learning algorithms for interval A2-C1 type-1 non-singleton type-2 TSK fuzzy logic systems , 2015, Soft Comput..

[16]  Chia-Feng Juang,et al.  An Interval Type-2 Fuzzy-Neural Network With Support-Vector Regression for Noisy Regression Problems , 2010, IEEE Transactions on Fuzzy Systems.

[17]  Min-Yuan Cheng,et al.  High-performance Concrete Compressive Strength Prediction using Time-Weighted Evolutionary Fuzzy Support Vector Machines Inference Model , 2012 .

[18]  Y Lu,et al.  A Sequential Learning Scheme for Function Approximation Using Minimal Radial Basis Function Neural Networks , 1997, Neural Computation.

[19]  George Panoutsos,et al.  A combined Adaptive Neuro-Fuzzy and Bayesian strategy for recognition and prediction of gait events using wearable sensors , 2017, 2017 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[20]  Yang Shu,et al.  Evolutionary Extreme Learning Machine : Based on Particle Swarm Optimization , 2006 .

[21]  Song Li,et al.  Short-term load forecasting by wavelet transform and evolutionary extreme learning machine , 2015 .

[22]  George Panoutsos,et al.  An ensemble data-driven fuzzy network for laser welding quality prediction , 2017, 2017 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[23]  Tony J. Dodd,et al.  Feeling the Shape: Active Exploration Behaviors for Object Recognition With a Robotic Hand , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[24]  George Panoutsos,et al.  Granular computing neural-fuzzy modelling: A neutrosophic approach , 2013, Appl. Soft Comput..

[25]  Jiuwen Cao,et al.  Protein Sequence Classification with Improved Extreme Learning Machine Algorithms , 2014, BioMed research international.

[26]  Jerry M. Mendel,et al.  Enhanced Karnik--Mendel Algorithms , 2009, IEEE Transactions on Fuzzy Systems.

[27]  Deng Wan Research on Extreme Learning of Neural Networks , 2010 .

[28]  Tony J. Dodd,et al.  Active sensorimotor control for tactile exploration , 2017, Robotics Auton. Syst..

[29]  Oscar Castillo,et al.  Interval Type-2 Fuzzy System Design Based on the Interval Type-2 Fuzzy C-Means Algorithm , 2016, Fuzzy Technology.

[30]  George Panoutsos,et al.  Interval Type-2 Radial Basis Function Neural Network: A Modeling Framework , 2015, IEEE Transactions on Fuzzy Systems.

[31]  Marius Ene,et al.  Neural network-based approach to discriminate healthy people from those with Parkinson's disease , 2008 .

[32]  Jacek M. Zurada,et al.  Convergence of online gradient method for feedforward neural networks with smoothing L1/2 regularization penalty , 2014, Neurocomputing.

[33]  Jerry M. Mendel,et al.  Computing derivatives in interval type-2 fuzzy logic systems , 2004, IEEE Transactions on Fuzzy Systems.