Optimal design of adaptive type-2 neuro-fuzzy systems: A review

Graphical abstractDisplay Omitted HighlightsLearning algorithms of T2FLS are reviewed.Hybrid learning of parameters are reviewed particularly.The learning algorithms for T2FLS are divided into three categories.Comparison of the three categories is discussed at the end. Type-2 fuzzy logic systems have extensively been applied to various engineering problems, e.g. identification, prediction, control, pattern recognition, etc. in the past two decades, and the results were promising especially in the presence of significant uncertainties in the system. In the design of type-2 fuzzy logic systems, the early applications were realized in a way that both the antecedent and consequent parameters were chosen by the designer with perhaps some inputs from some experts. Since 2000s, a huge number of papers have been published which are based on the adaptation of the parameters of type-2 fuzzy logic systems using the training data either online or offline. Consequently, the major challenge was to design these systems in an optimal way in terms of their optimal structure and their corresponding optimal parameter update rules. In this review, the state of the art of the three major classes of optimization methods are investigated: derivative-based (computational approaches), derivative-free (heuristic methods) and hybrid methods which are the fusion of both the derivative-free and derivative-based methods.

[1]  Okyay Kaynak,et al.  Intelligent control of a tractor-implement system using type-2 fuzzy neural networks , 2012, 2012 IEEE International Conference on Fuzzy Systems.

[2]  Robert Ivor John,et al.  Designing generalised type-2 fuzzy logic systems using interval type-2 fuzzy logic systems and simulated annealing , 2012, 2012 IEEE International Conference on Fuzzy Systems.

[3]  Shie-Jue Lee,et al.  Data-Based System Modeling Using a Type-2 Fuzzy Neural Network With a Hybrid Learning Algorithm , 2011, IEEE Transactions on Neural Networks.

[4]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[5]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[6]  Rafael Alcalá,et al.  Techniques for Learning and Tuning Fuzzy Rule-Based Systems for Linguistic Modeling and their Application , 2000 .

[7]  Oscar Castillo,et al.  Particle Swarm Optimization in the Design of Type-2 Fuzzy Systems , 2012 .

[8]  Gerardo M. Mendez,et al.  Orthogonal-least-squares and backpropa- gation hybrid learning algorithm for interval A2-C1 singleton type-2 Takagi-Sugeno-Kang fuzzy logic systems , 2014, Int. J. Hybrid Intell. Syst..

[9]  Zhaohong Deng,et al.  Fuzzy partition based soft subspace clustering and its applications in high dimensional data , 2013, Inf. Sci..

[10]  Yaonan Wang,et al.  A Combination Scheme for Fuzzy Partitions Based on Fuzzy Weighted Majority Voting Rule , 2009, 2009 International Conference on Digital Image Processing.

[11]  P. Shukla,et al.  A new approach for tuning interval type-2 fuzzy knowledge bases using genetic algorithms , 2014 .

[12]  Bart Kosko,et al.  Fuzzy Systems as Universal Approximators , 1994, IEEE Trans. Computers.

[13]  Oscar Castillo,et al.  Optimization of interval type-2 fuzzy systems for image edge detection , 2016, Appl. Soft Comput..

[14]  Byung-In Choi,et al.  Interval Type-2 Fuzzy Membership Function Design and its Application to Radial Basis Function Neural Networks , 2007, 2007 IEEE International Fuzzy Systems Conference.

[15]  Gerardo M. Mendez,et al.  Type-1 Non-singleton Type-2 Takagi-Sugeno-Kang Fuzzy Logic Systems Using the Hybrid Mechanism Composed by a Kalman Type Filter and Back Propagation Methods , 2010, HAIS.

[16]  Hani Hagras,et al.  Big Bang-Big Crunch optimization based interval type-2 fuzzy PID cascade controller design strategy , 2014, Inf. Sci..

[17]  Chia-Feng Juang,et al.  Reinforcement Self-Organizing Interval Type-2 Fuzzy System with ant colony optimization , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[18]  Jamshid Dehmeshki,et al.  An Automatic Approach for Learning and Tuning Gaussian Interval Type-2 Fuzzy Membership Functions Applied to Lung CAD Classification System , 2012, IEEE Transactions on Fuzzy Systems.

[19]  Adisak Sangsongfa,et al.  Optimizing of Interval Type-2 Fuzzy Logic Systems Using Hybrid Heuristic Algorithm Evaluated by Classification , 2013 .

[20]  Panta Lucic,et al.  Computing with Bees: Attacking Complex Transportation Engineering Problems , 2003, Int. J. Artif. Intell. Tools.

[21]  Oscar Castillo,et al.  Universal Approximation of a Class of Interval Type-2 Fuzzy Neural Networks in Nonlinear Identification , 2013, Adv. Fuzzy Syst..

[22]  Francisco Herrera,et al.  Analysis and guidelines to obtain a good uniform fuzzy partition granularity for fuzzy rule-based systems using simulated annealing , 2000, Int. J. Approx. Reason..

[23]  Okyay Kaynak,et al.  A type-2 fuzzy wavelet neural network for system identification and control , 2013, J. Frankl. Inst..

[24]  Phayung Meesad,et al.  An optimal design for type-2 fuzzy logic system using hybrid of chaos firefly algorithm and genetic algorithm and its application to sea level prediction , 2014, J. Intell. Fuzzy Syst..

[25]  E. Komarov,et al.  A fuzzy linear regression model for interval type-2 fuzzy sets , 2012, 2012 Annual Meeting of the North American Fuzzy Information Processing Society (NAFIPS).

[26]  Okyay Kaynak,et al.  Design of an adaptive interval type-2 fuzzy logic controller for the position control of a servo system with an intelligent sensor , 2010, International Conference on Fuzzy Systems.

[27]  Oscar Castillo,et al.  A hybrid learning algorithm for a class of interval type-2 fuzzy neural networks , 2009, Inf. Sci..

[28]  Ching-Hung Lee,et al.  TYPE-2 FUZZY NEURAL NETWORK SYSTEMS AND LEARNING , 2002 .

[29]  M. Ait Kbir,et al.  Hierarchical fuzzy partition for pattern classification with fuzzy if-then rules , 2000, Pattern Recognit. Lett..

[30]  Chi-Hsu Wang,et al.  Dynamical optimal training for interval type-2 fuzzy neural network (T2FNN) , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[31]  Oscar Castillo,et al.  Optimization of the Type-1 and Type-2 fuzzy controller design for the water tank using the Bee Colony Optimization , 2014, 2014 IEEE Conference on Norbert Wiener in the 21st Century (21CW).

[32]  Oscar Castillo,et al.  Bio-Inspired Optimization Methods , 2012 .

[33]  Abdel-Rahman Hedar,et al.  Optimization of interval type-2 fuzzy logic systems using tabu search algorithms , 2014, 2014 Sixth World Congress on Nature and Biologically Inspired Computing (NaBIC 2014).

[34]  Chia-Feng Juang,et al.  Reinforcement Interval Type-2 Fuzzy Controller Design by Online Rule Generation and Q-Value-Aided Ant Colony Optimization , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[35]  Okyay Kaynak,et al.  Adaptive neuro-fuzzy control with sliding mode learning algorithm: Application to Antilock Braking System , 2009, 2009 7th Asian Control Conference.

[36]  Jerry M. Mendel,et al.  Computing derivatives in interval type-2 fuzzy logic systems , 2004, IEEE Transactions on Fuzzy Systems.

[37]  Mojtaba Ahmadieh Khanesar,et al.  Levenberg marquardt algorithm for the training of type-2 fuzzy neuro systems with a novel type-2 fuzzy membership function , 2011, 2011 IEEE Symposium on Advances in Type-2 Fuzzy Logic Systems (T2FUZZ).

[38]  Sung-Kwun Oh,et al.  The Design of Optimized Type-2 Fuzzy Neural Networks and Its Application , 2009 .

[39]  Tien-Chin Wang,et al.  Constructing a fuzzy decision tree by integrating fuzzy sets and entropy , 2006 .

[40]  Juan Luis Castro,et al.  Fuzzy logic controllers are universal approximators , 1995, IEEE Trans. Syst. Man Cybern..

[41]  Mojtaba Ahmadieh Khanesar,et al.  A novel type-2 fuzzy membership function: application to the prediction of noisy data , 2010, 2010 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications.

[42]  Àngela Nebot,et al.  Optimization of fuzzy partitions for inductive reasoning using genetic algorithms , 2007, Int. J. Syst. Sci..

[43]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[44]  Mustapha Hamerlain,et al.  Ant colony optimization of type-2 fuzzy helicopter controller , 2014, 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014).

[45]  Oscar Castillo,et al.  Particle Swarm Optimization for Average Approximation of Interval Type-2 Fuzzy Inference Systems Design in FPGAs for Real Applications , 2013, Recent Advances on Hybrid Intelligent Systems.

[46]  Shie-Jue Lee,et al.  General type-2 fuzzy neural network with hybrid learning for function approximation , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[47]  Robert Ivor John,et al.  New Type-2 Rule Ranking Indices for Designing Parsimonious Interval Type-2 Fuzzy Logic Systems , 2007, 2007 IEEE International Fuzzy Systems Conference.

[48]  D. Stephen Dinagar,et al.  TWO PHASE APPROACH FOR SOLVING TYPE-2 FUZZY LINEAR PROGRAMMING PROBLEM , 2011 .

[49]  Fevrier Valdez,et al.  Comparative study of bio-inspired algorithms applied to the optimization of type-1 and type-2 fuzzy controllers for an autonomous mobile robot , 2012, Inf. Sci..

[50]  Arnaud Devillez,et al.  A fuzzy hybrid hierarchical clustering method with a new criterion able to find the optimal partition , 2002, Fuzzy Sets Syst..

[51]  Shaoyuan Li,et al.  Interval type-2 fuzzy T-S modeling for a heat exchange process on CE117 Process Trainer , 2011, Proceedings of 2011 International Conference on Modelling, Identification and Control.

[52]  James J. Buckley,et al.  Approximations between fuzzy expert systems and neural networks , 1994, Int. J. Approx. Reason..

[53]  Dongrui Wu,et al.  Genetic learning and performance evaluation of interval type-2 fuzzy logic controllers , 2006, Eng. Appl. Artif. Intell..

[54]  Oscar Castillo,et al.  Ant Colony Optimization Algorithms for the Design of Type-2 Fuzzy Systems , 2012 .

[55]  H. Lee-Kwang,et al.  A designing method for type-2 fuzzy logic systems using genetic algorithms , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[56]  Oscar Castillo,et al.  Overview of Genetic Algorithms Applied in the Optimization of Type-2 Fuzzy Systems , 2012 .

[57]  Adel Ali Al-Jumaily,et al.  Training type-2 Fuzzy System by particle swarm optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[58]  Hao Wang,et al.  An Efficient Fuzzy Kohonen Clustering Network Algorithm , 2008, 2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery.

[59]  Chin-Teng Lin,et al.  A TSK-Type-Based Self-Evolving Compensatory Interval Type-2 Fuzzy Neural Network (TSCIT2FNN) and Its Applications , 2014, IEEE Transactions on Industrial Electronics.

[60]  O. Kaynak,et al.  Sliding mode control theory‐based algorithm for online learning in type‐2 fuzzy neural networks: application to velocity control of an electro hydraulic servo system , 2012 .

[61]  Robert John,et al.  Tuning of Type-2 Fuzzy Systems by Simulated A nnealing to Predict Time Series , 2011 .

[62]  Sung-Kwun Oh,et al.  Design of interval type-2 fuzzy neural networks and their optimization using real-coded genetic algorithms , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[63]  Hani Hagras Comments on "Dynamical Optimal Training for Interval Type-2 Fuzzy Neural Network (T2FNN) , 2006, IEEE Trans. Syst. Man Cybern. Part B.

[64]  S. Chakravartya,et al.  A PSO based integrated functional link net and interval type-2 fuzzy logic system for predicting stock market indices , 2015 .

[65]  Olga Poleshchuk,et al.  A Fuzzy Nonlinear Regression Model for Interval Type-2 Fuzzy Sets , 2014 .

[66]  Tadjine Mohamed,et al.  Decentralized RBFNN Type-2 Fuzzy Sliding Mode Controller for Robot Manipulator Driven by Artificial Muscles , 2012 .

[68]  Federico Sanabria,et al.  Towards a coevolutionary approach for interval type-2 fuzzy modeling , 2011, 2011 IEEE Symposium on Advances in Type-2 Fuzzy Logic Systems (T2FUZZ).

[69]  Ujjwal Maulik,et al.  Fuzzy partitioning using a real-coded variable-length genetic algorithm for pixel classification , 2003, IEEE Trans. Geosci. Remote. Sens..

[70]  Mojtaba Ahmadieh Khanesar,et al.  Fuzzy Neural Networks for Real Time Control Applications: Concepts, Modeling and Algorithms for Fast Learning , 2015 .

[71]  Mojtaba Ahmadieh Khanesar,et al.  Extended Kalman Filter Based Learning Algorithm for Type-2 Fuzzy Logic Systems and Its Experimental Evaluation , 2012, IEEE Transactions on Industrial Electronics.

[72]  Jing Hua,et al.  A New Adaptive Kalman Filter Based on Interval Type-2 Fuzzy Logic System ⋆ , 2015 .

[73]  R. John,et al.  Tuning fuzzy systems by simulated annealing to predict time series with added noise , 2010, 2010 UK Workshop on Computational Intelligence (UKCI).

[74]  Jamshid Dehmeshki,et al.  A Genetic type-2 fuzzy logic system for pattern recognition in computer aided detection systems , 2010, International Conference on Fuzzy Systems.

[75]  Steven D. Brown,et al.  Induction of decision trees using fuzzy partitions , 2003 .

[76]  Oscar Castillo,et al.  An optimization method for designing type-2 fuzzy inference systems based on the footprint of uncertainty using genetic algorithms , 2012, Expert Syst. Appl..

[77]  Mojtaba Ahmadieh Khanesar,et al.  Identification of Nonlinear Dynamic Systems Using Type-2 Fuzzy Neural Networks—A Novel Learning Algorithm and a Comparative Study , 2015, IEEE Transactions on Industrial Electronics.

[78]  H. Ishibuchi Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge bases , 2004 .

[79]  Chia-Feng Juang,et al.  A Self-Evolving Interval Type-2 Fuzzy Neural Network With Online Structure and Parameter Learning , 2008, IEEE Transactions on Fuzzy Systems.