A Hybrid Learning Method for Constructing Compact Rule-Based Fuzzy Models

The Takagi-Sugeno-Kang-type rule-based fuzzy model has found many applications in different fields; a major challenge is, however, to build a compact model with optimized model parameters which leads to satisfactory model performance. To produce a compact model, most existing approaches mainly focus on selecting an appropriate number of fuzzy rules. In contrast, this paper considers not only the selection of fuzzy rules but also the structure of each rule premise and consequent, leading to the development of a novel compact rule-based fuzzy model. Here, each fuzzy rule is associated with two sets of input attributes, in which the first is used for constructing the rule premise and the other is employed in the rule consequent. A new hybrid learning method combining the modified harmony search method with a fast recursive algorithm is hereby proposed to determine the structure and the parameters for the rule premises and consequents. This is a hard mixed-integer nonlinear optimization problem, and the proposed hybrid method solves the problem by employing an embedded framework, leading to a significantly reduced number of model parameters and a small number of fuzzy rules with each being as simple as possible. Results from three examples are presented to demonstrate the compactness (in terms of the number of model parameters and the number of rules) and the performance of the fuzzy models obtained by the proposed hybrid learning method, in comparison with other techniques from the literature.

[1]  Bernhard Sendhoff,et al.  On generating FC3 fuzzy rule systems from data using evolution strategies , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[2]  Hisao Ishibuchi,et al.  Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems , 1997, Fuzzy Sets Syst..

[3]  Bing Lam Luk,et al.  Orthogonal-least-squares regression: A unified approach for data modelling , 2009, Neurocomputing.

[4]  John Q. Gan,et al.  Low-level interpretability and high-level interpretability: a unified view of data-driven interpretable fuzzy system modelling , 2008, Fuzzy Sets Syst..

[5]  Jin Bae Park,et al.  Approaches to extended non-quadratic stability and stabilization conditions for discrete-time Takagi-Sugeno fuzzy systems , 2011, Autom..

[6]  Marco Russo,et al.  Genetic fuzzy learning , 2000, IEEE Trans. Evol. Comput..

[7]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[8]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[9]  Changhe Li,et al.  A Self-Learning Particle Swarm Optimizer for Global Optimization Problems , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Kang Li,et al.  A New Fast Algorithm for Fuzzy Rule Selection , 2007, 2007 IEEE International Fuzzy Systems Conference.

[11]  Xiaodong Li,et al.  This article has been accepted for inclusion in a future issue. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 Locating and Tracking Multiple Dynamic Optima by a Particle Swarm Model Using Speciation , 2022 .

[12]  Xia Hong,et al.  Robust neurofuzzy rule base knowledge extraction and estimation using subspace decomposition combined with regularization and D-optimality , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[14]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[15]  M. Lozano,et al.  MOGUL: A methodology to obtain genetic fuzzy rule‐based systems under the iterative rule learning approach , 1999 .

[16]  Bijaya K. Panigrahi,et al.  Exploratory Power of the Harmony Search Algorithm: Analysis and Improvements for Global Numerical Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Wang Yaonan,et al.  RBF Networks-Based Adaptive Inverse Model Control System for Electronic Throttle , 2010, IEEE Transactions on Control Systems Technology.

[18]  George W. Irwin,et al.  A fast method for fuzzy neural network modelling and refinement , 2009, Int. J. Model. Identif. Control..

[19]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[20]  Akbar Esfahanipour,et al.  Adapted Neuro-Fuzzy Inference System on indirect approach TSK fuzzy rule base for stock market analysis , 2010, Expert Syst. Appl..

[21]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[22]  Dragan Kukolj,et al.  Design of adaptive Takagi-Sugeno-Kang fuzzy models , 2002, Appl. Soft Comput..

[23]  Francisco Herrera,et al.  A Review of the Application of Multiobjective Evolutionary Fuzzy Systems: Current Status and Further Directions , 2013, IEEE Transactions on Fuzzy Systems.

[24]  Cheng-Jian Lin,et al.  Design of Neuro-Fuzzy Systems Using a Hybrid Evolutionary Learning Algorithm , 2007, J. Inf. Sci. Eng..

[25]  Chin-Teng Lin,et al.  Efficient Self-Evolving Evolutionary Learning for Neurofuzzy Inference Systems , 2008, IEEE Transactions on Fuzzy Systems.

[26]  George W. Irwin,et al.  A fast nonlinear model identification method , 2005, IEEE Transactions on Automatic Control.

[27]  John Yen,et al.  Simplifying fuzzy rule-based models using orthogonal transformation methods , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[28]  Marzuki Khalid,et al.  Optimization of fuzzy model using genetic algorithm for process control application , 2011, J. Frankl. Inst..

[29]  Xiao-Jun Zeng,et al.  An Evolving-Construction Scheme for Fuzzy Systems , 2010, IEEE Transactions on Fuzzy Systems.

[30]  Jesús Alcalá-Fdez,et al.  KEEL Data-Mining Software Tool: Data Set Repository, Integration of Algorithms and Experimental Analysis Framework , 2011, J. Multiple Valued Log. Soft Comput..

[31]  Jesús Alcalá-Fdez,et al.  Local identification of prototypes for genetic learning of accurate TSK fuzzy rule‐based systems , 2007, Int. J. Intell. Syst..

[32]  Chia-Feng Juang,et al.  Designing Fuzzy-Rule-Based Systems Using Continuous Ant-Colony Optimization , 2010, IEEE Transactions on Fuzzy Systems.

[33]  Hisao Ishibuchi,et al.  Designing fuzzy rule-based classifiers that can visually explain their classification results to human users , 2008, 2008 3rd International Workshop on Genetic and Evolving Systems.

[34]  Chunshien Li,et al.  Adaptive fuzzy approach to function approximation with PSO and RLSE , 2011, Expert Syst. Appl..

[35]  Rudolf Kruse,et al.  Neuro-fuzzy systems for function approximation , 1999, Fuzzy Sets Syst..

[36]  Chin-Teng Lin,et al.  A Hybrid of Cooperative Particle Swarm Optimization and Cultural Algorithm for Neural Fuzzy Networks and Its Prediction Applications , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[37]  Chia-Feng Juang,et al.  Hierarchical Cluster-Based Multispecies Particle-Swarm Optimization for Fuzzy-System Optimization , 2010, IEEE Transactions on Fuzzy Systems.

[38]  Mohammad Teshnehlab,et al.  Novel Hybrid Learning Algorithms for Tuning ANFIS Parameters Using Adaptive Weighted PSO , 2007, 2007 IEEE International Fuzzy Systems Conference.

[39]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[40]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[41]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[42]  George W. Irwin,et al.  A Novel Continuous Forward Algorithm for RBF Neural Modelling , 2007, IEEE Transactions on Automatic Control.

[43]  Z.C. Johanyak,et al.  Sparse Fuzzy System Generation by Rule Base Extension , 2007, 2007 11th International Conference on Intelligent Engineering Systems.

[44]  Ujjwal Maulik,et al.  A study of some fuzzy cluster validity indices, genetic clustering and application to pixel classification , 2005, Fuzzy Sets Syst..

[45]  Chia-Feng Juang,et al.  A hybrid of genetic algorithm and particle swarm optimization for recurrent network design , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[46]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[47]  Robert Ivor John,et al.  On Constructing Parsimonious Type-2 Fuzzy Logic Systems via Influential Rule Selection , 2009, IEEE Transactions on Fuzzy Systems.

[48]  M. Raju,et al.  Optimal Network Reconfiguration of Large-Scale Distribution System Using Harmony Search Algorithm , 2011, IEEE Transactions on Power Systems.

[49]  Xin Chen,et al.  A Modified PSO Structure Resulting in High Exploration Ability With Convergence Guaranteed , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[50]  Sheng Chen,et al.  A New RBF Neural Network With Boundary Value Constraints , 2009, IEEE Trans. Syst. Man Cybern. Part B.

[51]  Bijaya Ketan Panigrahi,et al.  Harmony search algorithm for transmission network expansion planning , 2010 .

[52]  Kwang Bo Cho,et al.  Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction , 1996, Fuzzy Sets Syst..

[53]  John Q. Gan,et al.  Extracting Takagi-Sugeno Fuzzy Rules with Interpretable Submodels via Regularization of Linguistic Modifiers , 2009, IEEE Transactions on Knowledge and Data Engineering.

[54]  Dhanesh Ramachandram,et al.  Dynamic fuzzy clustering using Harmony Search with application to image segmentation , 2009, 2009 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[55]  Nikola K. Kasabov,et al.  On-line learning, reasoning, rule extraction and aggregation in locally optimized evolving fuzzy neural networks , 2001, Neurocomputing.

[56]  Qingzhong Liu,et al.  Predicting injection profiles using ANFIS , 2007, Inf. Sci..

[57]  Alistair Munro,et al.  Evolving fuzzy rule based controllers using genetic algorithms , 1996, Fuzzy Sets Syst..