Towards Efficient Multi-objective Genetic Takagi-Sugeno Fuzzy Systems for High Dimensional Problems

Multi-objective genetic Takagi-Sugeno (TS) fuzzy systems use multiobjective evolutionary algorithms to generate a set of fuzzy rule-based systems of the TS type with different trade-offs between, generally, complexity/interpretability and accuracy. The application of these algorithms requires a large number of TS system generations and evaluations.When we deal with high dimensional data sets, these tasks can be very time-consuming, thus making an adequate exploration of the search space very problematic. In this chapter, we propose two techniques to speed up generation and evaluation of TS systems. The first technique aims to speed up the identification of the consequent parameters of the TS rules, one of the most timeconsuming phases in TS generation. The application of this technique produces as a side-effect a decoupling of the rules in the TS system. Thus, modifications in a rule do not affect the other rules. Exploiting this property, the second technique proposes to store specific values used in the parents, so as to reuse them in the offspring and to avoid wasting time. We show the advantages of the proposed method in terms of computing time saving and improved search space exploration through two examples of multi-objective genetic learning of compact and accurate TS-type fuzzy systems for a high dimensional data set in the regression and time series forecasting domains.

[1]  Bernard De Baets,et al.  Fitness inheritance in multiple objective evolutionary algorithms: A test bench and real-world evaluation , 2008, Appl. Soft Comput..

[2]  Detlef D. Nauck GNU Fuzzy , 2007, 2007 IEEE International Fuzzy Systems Conference.

[3]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[4]  Hisao Ishibuchi,et al.  Selecting linguistic classification rules by two-objective genetic algorithms , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[5]  Nicol N. Schraudolph,et al.  A Fast, Compact Approximation of the Exponential Function , 1999, Neural Computation.

[6]  Alessio Botta,et al.  Context adaptation of fuzzy systems through a multi-objective evolutionary approach based on a novel interpretability index , 2008, Soft Comput..

[7]  Don Coppersmith,et al.  Matrix multiplication via arithmetic progressions , 1987, STOC.

[8]  Giovanni Corsini,et al.  Solving the ocean color inverse problem by using evolutionary multi-objective optimization of neuro-fuzzy systems , 2008, Int. J. Knowl. Based Intell. Eng. Syst..

[9]  Marco Cococcioni The Evolutionary Multiobjective Optimization of Fuzzy Rule-Based Systems Bibliography Page , 2009 .

[10]  G. Corsini,et al.  Approaching the ocean color problem using fuzzy rules , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  Andreas Zell,et al.  Parallelization of Multi-objective Evolutionary Algorithms Using Clustering Algorithms , 2005, EMO.

[12]  Kay Chen Tan,et al.  A distributed Cooperative coevolutionary algorithm for multiobjective optimization , 2006, IEEE Transactions on Evolutionary Computation.

[13]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[14]  Gary B. Lamont,et al.  Considerations in engineering parallel multiobjective evolutionary algorithms , 2003, IEEE Trans. Evol. Comput..

[15]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[16]  Hussein A. Abbass,et al.  Fitness inheritance for noisy evolutionary multi-objective optimization , 2005, GECCO '05.

[17]  Hisao Ishibuchi,et al.  Multiobjective Genetic Fuzzy Systems: Review and Future Research Directions , 2007, 2007 IEEE International Fuzzy Systems Conference.

[18]  Yaochu Jin,et al.  Fuzzy modeling of high-dimensional systems: complexity reduction and interpretability improvement , 2000, IEEE Trans. Fuzzy Syst..

[19]  Francisco Herrera,et al.  Genetic fuzzy systems: taxonomy, current research trends and prospects , 2008, Evol. Intell..

[20]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[21]  Hisao Ishibuchi,et al.  Interpretability Issues in Fuzzy Genetics-Based Machine Learning for Linguistic Modelling , 2003, Modelling with Words.

[22]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  Alessio Botta,et al.  Context adaptation of mamdani fuzzy rule based systems , 2008 .

[24]  Ammar Soukkou,et al.  Multiobjective optimisation of robust Takagi-Sugeno fuzzy neural controller with hybrid learning algorithm , 2007, Int. J. Model. Identif. Control..

[25]  Hisao Ishibuchi,et al.  Three-objective genetics-based machine learning for linguistic rule extraction , 2001, Inf. Sci..

[26]  Kalyanmoy Deb,et al.  Parallelizing multi-objective evolutionary algorithms: cone separation , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[27]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[28]  Beatrice Lazzerini,et al.  Fast Multiobjective Genetic Rule Learning Using an Efficient Method for Takagi-Sugeno Fuzzy Systems Identification , 2008, 2008 Eighth International Conference on Hybrid Intelligent Systems.

[29]  Robert Babuska,et al.  Fuzzy Modeling for Control , 1998 .

[30]  Hisao Ishibuchi,et al.  Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems , 1997, Fuzzy Sets Syst..

[31]  John Yen,et al.  Improving the interpretability of TSK fuzzy models by combining global learning and local learning , 1998, IEEE Trans. Fuzzy Syst..

[32]  Jonathan Lawry,et al.  Modelling with Words , 2003, Lecture Notes in Computer Science.

[33]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[34]  Beatrice Lazzerini,et al.  A Pareto-based multi-objective evolutionary approach to the identification of Mamdani fuzzy systems , 2007, Soft Comput..

[35]  Victor Y. Pan,et al.  Fast Rectangular Matrix Multiplication and Applications , 1998, J. Complex..