Hybrid Learning for General Type-2 TSK Fuzzy Logic Systems

This work is focused on creating fuzzy granular classification models based on general type-2 fuzzy logic systems when consequents are represented by interval type-2 TSK linear functions. Due to the complexity of general type-2 TSK fuzzy logic systems, a hybrid learning approach is proposed, where the principle of justifiable granularity is heuristically used to define an amount of uncertainty in the system, which in turn is used to define the parameters in the interval type-2 TSK linear functions via a dual LSE algorithm. Multiple classification benchmark datasets were tested in order to assess the quality of the formed granular models; its performance is also compared against other common classification algorithms. Shown results conclude that classification performance in general is better than results obtained by other techniques, and in general, all achieved results, when averaged, have a better performance rate than compared techniques, demonstrating the stability of the proposed hybrid learning technique.

[1]  Oscar Castillo,et al.  Generalized Type-2 Fuzzy Systems for controlling a mobile robot and a performance comparison with Interval Type-2 and Type-1 Fuzzy Systems , 2015, Expert Syst. Appl..

[2]  Gavin C. Cawley,et al.  On Over-fitting in Model Selection and Subsequent Selection Bias in Performance Evaluation , 2010, J. Mach. Learn. Res..

[3]  Jerry M. Mendel,et al.  Similarity measures for general type-2 fuzzy sets based on the α-plane representation , 2014, Inf. Sci..

[4]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[5]  Mohammad Hossein Fazel Zarandi,et al.  Multi-central general type-2 fuzzy clustering approach for pattern recognitions , 2016, Inf. Sci..

[6]  Bernhard Sendhoff,et al.  On generating FC3 fuzzy rule systems from data using evolution strategies , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[7]  Shan Sung Liew,et al.  An optimized second order stochastic learning algorithm for neural network training , 2015, Neurocomputing.

[8]  Erol Egrioglu,et al.  Robust learning algorithm for multiplicative neuron model artificial neural networks , 2016, Expert Syst. Appl..

[9]  Andrzej Bargiela,et al.  Toward a Theory of Granular Computing for Human-Centered Information Processing , 2008, IEEE Transactions on Fuzzy Systems.

[10]  Jerry M. Mendel,et al.  General Type-2 Fuzzy Logic Systems Made Simple: A Tutorial , 2014, IEEE Transactions on Fuzzy Systems.

[11]  Jyh-Shing Roger Jang,et al.  Fuzzy Modeling Using Generalized Neural Networks and Kalman Filter Algorithm , 1991, AAAI.

[12]  Oscar Castillo,et al.  Fuzzy granular gravitational clustering algorithm for multivariate data , 2014, Inf. Sci..

[13]  Laécio C. Barros,et al.  Analysis of the dengue risk by means of a Takagi-Sugeno-style model , 2015, Fuzzy Sets Syst..

[14]  Paulo Mateus,et al.  Hybrid learning of Bayesian multinets for binary classification , 2014, Pattern Recognit..

[15]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[16]  Eugênio B. Castelan,et al.  Fuzzy dynamic output feedback control through nonlinear Takagi-Sugeno models , 2015, Fuzzy Sets Syst..

[17]  Xi-Zhao Wang,et al.  Improving Generalization of Fuzzy IF--THEN Rules by Maximizing Fuzzy Entropy , 2009, IEEE Transactions on Fuzzy Systems.

[18]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[19]  Ozan Kocadagli,et al.  A novel hybrid learning algorithm for full Bayesian approach of artificial neural networks , 2015, Appl. Soft Comput..

[20]  Pat Langley,et al.  Estimating Continuous Distributions in Bayesian Classifiers , 1995, UAI.

[21]  Qun Niu,et al.  A Hybrid Learning Method for Constructing Compact Rule-Based Fuzzy Models , 2013, IEEE Transactions on Cybernetics.

[22]  Witold Pedrycz,et al.  The Principle of Justifiable Granularity and an Optimization of Information Granularity Allocation as Fundamentals of Granular Computing , 2011, J. Inf. Process. Syst..

[23]  Ben Niu,et al.  Hybrid learning particle swarm optimizer with genetic disturbance , 2015, Neurocomputing.

[24]  N. Altman An Introduction to Kernel and Nearest-Neighbor Nonparametric Regression , 1992 .

[25]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[26]  Jerry M. Mendel,et al.  Interval Type-2 Fuzzy Logic Systems Made Simple , 2006, IEEE Transactions on Fuzzy Systems.

[27]  Shie-Jue Lee,et al.  Data-Based System Modeling Using a Type-2 Fuzzy Neural Network With a Hybrid Learning Algorithm , 2011, IEEE Transactions on Neural Networks.

[28]  Mohammad Hossein Fazel Zarandi,et al.  Alpha-plane based automatic general type-2 fuzzy clustering based on simulated annealing meta-heuristic algorithm for analyzing gene expression data , 2015, Comput. Biol. Medicine.

[29]  Lotfi A. Zadeh,et al.  Fuzzy sets and information granularity , 1996 .

[30]  Kyu-Han Kim,et al.  Fuzzy model forecasting of offshore bar-shape profiles under high waves , 2014, Expert Syst. Appl..

[31]  Mojtaba Ahmadieh Khanesar,et al.  A systematic design of interval type-2 fuzzy logic system using extreme learning machine for electricity load demand forecasting , 2016 .

[32]  Mohammad Hossein Fazel Zarandi,et al.  Hierarchical collapsing method for direct defuzzification of general type-2 fuzzy sets , 2014, Inf. Sci..

[33]  Claudia-Adina Dragos,et al.  Online identification of evolving Takagi-Sugeno-Kang fuzzy models for crane systems , 2014, Appl. Soft Comput..

[34]  William Stafford Noble,et al.  Support vector machine , 2013 .