Robust extreme learning fuzzy systems using ridge regression for small and noisy datasets

Fuzzy Extreme Learning Machine (F-ELM) constructs a fuzzy neural networks by embedding fuzzy membership functions and rules into the hidden layer of extreme learning machine (ELM), that is, it can be interpreted as a fuzzy system with the structure of neural network. Although F-ELM has shown the characteristics of fast learning of model parameters, it has poor robustness to small and noisy datasets since its parameters connecting hidden layer with output layer are optimized by least square(LS). In order to overcome this challenge, a Ridge Regression based Extreme Learning Fuzzy System (RR-EL-FS) is presented in this study, which has introduced the strategy of ridge regression into F-ELM to enhance the robustness. The experimental results also validate that the performance of RR-EL-FS is better than F-ELM and some related methods to small and noisy datasets.

[1]  Zhaohong Deng,et al.  Generalized Hidden-Mapping Ridge Regression, Knowledge-Leveraged Inductive Transfer Learning for Neural Networks, Fuzzy Systems and Kernel Methods , 2014, IEEE Transactions on Cybernetics.

[2]  Madasu Hanmandlu,et al.  Generalization of adaptive neuro-fuzzy inference systems , 2000, IEEE Trans. Neural Networks Learn. Syst..

[3]  Jia Dong-li,et al.  Niche particle swarm optimization combined with chaotic mutation , 2007 .

[4]  A. E. Hoerl,et al.  Ridge regression: biased estimation for nonorthogonal problems , 2000 .

[5]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[6]  Hwa Jen Yap,et al.  On Equivalence of FIS and ELM for Interpretable Rule-Based Knowledge Representation , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Arthur E. Hoerl,et al.  Application of ridge analysis to regression problems , 1962 .

[8]  Longbing Cao,et al.  T2FELA: Type-2 Fuzzy Extreme Learning Algorithm for Fast Training of Interval Type-2 TSK Fuzzy Logic System , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[9]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[10]  Chee Peng Lim,et al.  A hybrid neural network model for rule generation and its application to process fault detection and diagnosis , 2007, Eng. Appl. Artif. Intell..

[11]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[12]  Chin-Teng Lin,et al.  A TSK-Type-Based Self-Evolving Compensatory Interval Type-2 Fuzzy Neural Network (TSCIT2FNN) and Its Applications , 2014, IEEE Transactions on Industrial Electronics.

[13]  Thorsten Joachims,et al.  Transductive Inference for Text Classification using Support Vector Machines , 1999, ICML.

[14]  C.A. Coello Coello,et al.  MOPSO: a proposal for multiple objective particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[15]  Jacek M. Leski,et al.  TSK-fuzzy modeling based on /spl epsiv/-insensitive learning , 2005, IEEE Transactions on Fuzzy Systems.

[16]  Wang Shi-tong.  0-Order-L2-Norm-Takagi-Sugeno-Kang Type Transfer Learning Fuzzy System , 2013 .

[17]  Chee Peng Lim,et al.  Improved GART Neural Network Model for Pattern Classification and Rule Extraction With Application to Power Systems , 2011, IEEE Transactions on Neural Networks.

[18]  Zhaohong Deng,et al.  From Minimum Enclosing Ball to Fast Fuzzy Inference System Training on Large Datasets , 2009, IEEE Trans. Fuzzy Syst..

[19]  V. Miranda,et al.  Improving the IEC table for transformer failure diagnosis with knowledge extraction from neural networks , 2005, IEEE Transactions on Power Delivery.

[20]  Zhaohong Deng,et al.  Scalable TSK Fuzzy Modeling for Very Large Datasets Using Minimal-Enclosing-Ball Approximation , 2011, IEEE Transactions on Fuzzy Systems.

[21]  Chia-Feng Juang,et al.  Fuzzy System Learned Through Fuzzy Clustering and Support Vector Machine for Human Skin Color Segmentation , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[22]  Jerome H. Friedman,et al.  On Bias, Variance, 0/1—Loss, and the Curse-of-Dimensionality , 2004, Data Mining and Knowledge Discovery.

[23]  Alexander Gammerman,et al.  Ridge Regression Learning Algorithm in Dual Variables , 1998, ICML.

[24]  Jiang Yizhang,et al.  Fuzzy Subspace Clustering Based Zero-order L2-norm TSK Fuzzy System , 2015 .