Metaheuristic tuning of type-II fuzzy inference systems for data mining

Introduction of the fuzzy-set enabled the modeling of uncertain and noisy information. Type-2 fuzzy set took this further ahead by allowing fuzzy membership function to be fuzzy itself. In this work, we discussed an interval type-2 fuzzy inference system (IT2FIS). The training of the IT2FIS was provided in supervised manner by using metaheuristic algorithms. We comprehensively illustrated the formulation of the IT2FIS into an optimization problem. A precise genotype (a real vector) mapping of IT2FIS and a population-based strategy for optimum rule-base selection is described in this work. Since the IT2FIS learning is computationally difficult and costly, which we described in detail in this work, a comprehensive comparison between the performances of the metaheuristic algorithms were examined. The obtained results suggest that the IT2FIS learning was faster at the initial iterations of the metaheuristic learning, but tend to slow and get stuck in local minima. However, the metaheuristic algorithms, differential evaluation and bacteria foraging optimization offered significantly better results when compared to artificial bee colony, gray wolf optimization, particle swarm optimization and the other fuzzy inference models chosen for comparisons from literature.

[1]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[2]  Chee Peng Lim,et al.  A hybrid neural network model for noisy data regression , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  H. Ishibuchi,et al.  A hybrid fuzzy genetics-based machine learning algorithm: hybridization of Michigan approach and Pittsburgh approach , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[4]  W. Pedrycz,et al.  Fuzzy computing for data mining , 1999, Proc. IEEE.

[5]  Jerry M. Mendel,et al.  On KM Algorithms for Solving Type-2 Fuzzy Set Problems , 2013, IEEE Transactions on Fuzzy Systems.

[6]  Yoshiki Uchikawa,et al.  On fuzzy modeling using fuzzy neural networks with the back-propagation algorithm , 1992, IEEE Trans. Neural Networks.

[7]  David E. Goldberg,et al.  Genetic algorithms and Machine Learning , 1988, Machine Learning.

[8]  Oscar Castillo,et al.  A new approach for dynamic fuzzy logic parameter tuning in Ant Colony Optimization and its application in fuzzy control of a mobile robot , 2015, Appl. Soft Comput..

[9]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[10]  Oscar Castillo,et al.  Optimization of type-2 fuzzy systems based on bio-inspired methods: A concise review , 2012, Inf. Sci..

[11]  Jerry M. Mendel,et al.  Type-2 fuzzy logic systems , 1999, IEEE Trans. Fuzzy Syst..

[12]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[13]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[14]  Chia-Feng Juang,et al.  A Self-Evolving Interval Type-2 Fuzzy Neural Network With Online Structure and Parameter Learning , 2008, IEEE Transactions on Fuzzy Systems.

[15]  Chia-Feng Juang,et al.  An Interval Type-2 Fuzzy-Neural Network With Support-Vector Regression for Noisy Regression Problems , 2010, IEEE Transactions on Fuzzy Systems.

[16]  Oscar Castillo,et al.  A hybrid optimization method with PSO and GA to automatically design Type-1 and Type-2 fuzzy logic controllers , 2015, Int. J. Mach. Learn. Cybern..

[17]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[18]  Fevrier Valdez,et al.  Comparative study of bio-inspired algorithms applied to the optimization of type-1 and type-2 fuzzy controllers for an autonomous mobile robot , 2012, Inf. Sci..

[19]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[20]  Dervis Karaboga,et al.  AN IDEA BASED ON HONEY BEE SWARM FOR NUMERICAL OPTIMIZATION , 2005 .

[21]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[22]  Hani Hagras,et al.  A hierarchical type-2 fuzzy logic control architecture for autonomous mobile robots , 2004, IEEE Transactions on Fuzzy Systems.

[23]  Jerry M. Mendel,et al.  Computing derivatives in interval type-2 fuzzy logic systems , 2004, IEEE Transactions on Fuzzy Systems.

[24]  Oscar Castillo,et al.  Information granule formation via the concept of uncertainty-based information with Interval Type-2 Fuzzy Sets representation and Takagi-Sugeno-Kang consequents optimized with Cuckoo search , 2015, Appl. Soft Comput..

[25]  Francisco Herrera,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2004, Fuzzy Sets Syst..

[26]  JOHN G. CARNEY,et al.  Tuning Diversity in Bagged Ensembles , 2000, Int. J. Neural Syst..

[27]  Kevin M. Passino,et al.  Biomimicry of bacterial foraging for distributed optimization and control , 2002 .

[28]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..