A clustering algorithm based TS fuzzy model for tracking dynamical system data

Abstract This paper presents an optimal fuzzy partition based Takagi Sugeno Fuzzy Model (TSFM) in which a novel clustering algorithm, known as Modified Fuzzy C-Regression Model (MFCRM), has been proposed. The objective function of MFCRM algorithm has been developed by considering of geometrical structure of input data and linear functional relation between input–output data. The MFCRM partitions the data space to create fuzzy subspaces (rules). A new validation criterion has been developed for detecting the right number of rules (subspaces) in a given data set. The obtained fuzzy partition is used to build the fuzzy structure and identify the premise parameters. Once, right number of rules and premise parameters have been identified, then consequent parameters have been identified by orthogonal least square (OLS) approach. The cluster validation index has been tested on synthetic data set. The effectiveness of MFCRM based TSFM has been validated on benchmark examples, such as Boiler Turbine system, Mackey–Glass time series data and Box–Jenkins model. The model performance is also validated through high-dimensional data such as Auto-MPG data and Boston Housing data.

[1]  Reza Langari,et al.  Building Sugeno-type models using fuzzy discretization and orthogonal parameter estimation techniques , 1994, NAFIPS/IFIS/NASA '94. Proceedings of the First International Joint Conference of The North American Fuzzy Information Processing Society Biannual Conference. The Industrial Fuzzy Control and Intellige.

[2]  Chung-Chun Kung,et al.  A novel cluster validity criterion for fuzzy c-regression model clustering algorithm , 2003, The 12th IEEE International Conference on Fuzzy Systems, 2003. FUZZ '03..

[3]  R.J. Hathaway,et al.  Switching regression models and fuzzy clustering , 1993, IEEE Trans. Fuzzy Syst..

[4]  George E. Tsekouras,et al.  On the use of the weighted fuzzy c-means in fuzzy modeling , 2005, Adv. Eng. Softw..

[5]  Chung-Chun Kung,et al.  A novel cluster validity criterion for fuzzy C-regression models , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[6]  Zhaohong Deng,et al.  Knowledge-Leverage-Based TSK Fuzzy System Modeling , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[7]  R. Patton,et al.  APPROXIMATION PROPERTIES OF TP MODEL FORMS AND ITS CONSEQUENCES TO TPDC DESIGN FRAMEWORK , 2007 .

[8]  Xueli An,et al.  T-S fuzzy model identification based on a novel fuzzy c-regression model clustering algorithm , 2009, Eng. Appl. Artif. Intell..

[9]  Petia Radeva,et al.  Artificial Intelligence Research and Development , 2005 .

[10]  L X Wang,et al.  Fuzzy basis functions, universal approximation, and orthogonal least-squares learning , 1992, IEEE Trans. Neural Networks.

[11]  Yangyang Li,et al.  Self-representation based dual-graph regularized feature selection clustering , 2016, Neurocomputing.

[12]  Alok Kanti Deb,et al.  Interval type-2 modified fuzzy c-regression model clustering algorithm in TS Fuzzy Model identification , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[13]  Edwin Lughofer,et al.  SparseFIS: Data-Driven Learning of Fuzzy Systems With Sparsity Constraints , 2010, IEEE Transactions on Fuzzy Systems.

[14]  Sung-Kwun Oh,et al.  Reinforced rule-based fuzzy models: Design and analysis , 2017, Knowl. Based Syst..

[15]  Gholamali Heydari,et al.  New Formulation for Representing Higher Order TSK Fuzzy Systems , 2016, IEEE transactions on fuzzy systems.

[16]  Alok Kanti Deb,et al.  TS fuzzy model identification by a novel objective function based fuzzy clustering algorithm , 2014, 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL).

[17]  Uzay Kaymak,et al.  Improved covariance estimation for Gustafson-Kessel clustering , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[18]  A. Bagis.  Fuzzy rule base design using tabu search algorithm for nonlinear system modeling. , 2008, ISA transactions.

[19]  Plamen Angelov,et al.  Evolving Takagi‐Sugeno Fuzzy Systems from Streaming Data (eTS+) , 2010 .

[20]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Hong-Bin Shen,et al.  OptiFel: A Convergent Heterogeneous Particle Swarm Optimization Algorithm for Takagi–Sugeno Fuzzy Modeling , 2014, IEEE Transactions on Fuzzy Systems.

[22]  Belkacem Ould Bouamama,et al.  A dynamic fuzzy model for a drum-boiler-turbine system , 2003, Autom..

[23]  Dejan Dovzan,et al.  Recursive clustering based on a Gustafson–Kessel algorithm , 2011, Evol. Syst..

[24]  Donald Gustafson,et al.  Fuzzy clustering with a fuzzy covariance matrix , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[25]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[26]  Bo Fu,et al.  T–S Fuzzy Model Identification With a Gravitational Search-Based Hyperplane Clustering Algorithm , 2012, IEEE Transactions on Fuzzy Systems.

[27]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[28]  J. Bezdek.  Numerical taxonomy with fuzzy sets , 1974 .

[29]  Witold Pedrycz,et al.  Linguistic models as a framework of user-centric system modeling , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[30]  Xiao-Jun Zeng,et al.  A structure evolving learning method for fuzzy systems , 2010, Evol. Syst..

[31]  Sébastien Destercke,et al.  Building an interpretable fuzzy rule base from data using Orthogonal Least Squares - Application to a depollution problem , 2007, Fuzzy Sets Syst..

[32]  Xiao-Jun Zeng,et al.  A simplified structure evolving method for Mamdani fuzzy system identification and its application to high-dimensional problems , 2013, Inf. Sci..

[33]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[34]  Magne Setnes,et al.  Rule-based modeling: precision and transparency , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[35]  James M. Keller,et al.  A possibilistic fuzzy c-means clustering algorithm , 2005, IEEE Transactions on Fuzzy Systems.

[36]  Dervis Karaboga,et al.  Self-generated fuzzy systems design using artificial bee colony optimization , 2015, Inf. Sci..

[37]  Bernard De Baets,et al.  Comparison of clustering algorithms in the identification of Takagi-Sugeno models: A hydrological case study , 2006, Fuzzy Sets Syst..

[38]  Longbing Cao,et al.  T2FELA: Type-2 Fuzzy Extreme Learning Algorithm for Fast Training of Interval Type-2 TSK Fuzzy Logic System , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[40]  Xiaohui Liu,et al.  Parameter estimation of Takagi-Sugeno fuzzy system using heterogeneous cuckoo search algorithm , 2015, Neurocomputing.

[41]  Euntai Kim,et al.  A transformed input-domain approach to fuzzy modeling , 1998, IEEE Trans. Fuzzy Syst..

[42]  Euntai Kim,et al.  A new approach to fuzzy modeling , 1997, IEEE Trans. Fuzzy Syst..

[43]  Sylvie Galichet,et al.  Structure identification and parameter optimization for non-linear fuzzy modeling , 2002, Fuzzy Sets Syst..

[44]  I. Burhan Türksen,et al.  New Cluster Validity Index with Fuzzy Functions , 2007, Analysis and Design of Intelligent Systems using Soft Computing Techniques.

[45]  Yu-Geng Xi,et al.  A clustering algorithm for fuzzy model identification , 1998, Fuzzy Sets Syst..

[46]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Yinghua Lin,et al.  A new approach to fuzzy-neural system modeling , 1995, IEEE Trans. Fuzzy Syst..

[48]  Shuyuan Yang,et al.  Global discriminative-based nonnegative spectral clustering , 2016, Pattern Recognit..

[49]  Minghao Chen,et al.  Constructing optimized interval type-2 TSK neuro-fuzzy systems with noise reduction property by quantum inspired BFA , 2016, Neurocomputing.

[50]  Longbing Cao,et al.  Minimax Probability TSK Fuzzy System Classifier: A More Transparent and Highly Interpretable Classification Model , 2015, IEEE Transactions on Fuzzy Systems.

[51]  Fei Wang,et al.  Fast semi-supervised clustering with enhanced spectral embedding , 2012, Pattern Recognit..

[52]  Yeung Yam,et al.  SVD-based reduction to MISO TS models , 2003, IEEE Trans. Ind. Electron..

[53]  Young-Il Kim,et al.  A cluster validation index for GK cluster analysis based on relative degree of sharing , 2004, Inf. Sci..

[54]  Alok Kanti Deb,et al.  Block Sparse Representations in Modified Fuzzy C-Regression Model Clustering Algorithm for TS Fuzzy Model Identification , 2015, 2015 IEEE Symposium Series on Computational Intelligence.

[55]  Frank Klawonn,et al.  Improved fuzzy partitions for fuzzy regression models , 2003, Int. J. Approx. Reason..

[56]  Thomas A. Runkler,et al.  Identification of nonlinear systems using regular fuzzy c-elliptotype clustering , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[57]  Xiao-Jun Zeng,et al.  An Output-Constrained Clustering Approach for the Identification of Fuzzy Systems and Fuzzy Granular Systems , 2011, IEEE Transactions on Fuzzy Systems.

[58]  James C. Bezdek,et al.  On cluster validity for the fuzzy c-means model , 1995, IEEE Trans. Fuzzy Syst..

[59]  Fuchun Sun,et al.  A novel T-S fuzzy systems identification with block structured sparse representation , 2014, J. Frankl. Inst..

[60]  V. J. Rayward-Smith,et al.  Fuzzy Cluster Analysis: Methods for Classification, Data Analysis and Image Recognition , 1999 .

[61]  Jung-Hsien Chiang,et al.  Support vector learning mechanism for fuzzy rule-based modeling: a new approach , 2004, IEEE Trans. Fuzzy Syst..

[62]  Isak Gath,et al.  Unsupervised Optimal Fuzzy Clustering , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[63]  Xueli An,et al.  A new T-S fuzzy-modeling approach to identify a boiler-turbine system , 2010, Expert Syst. Appl..

[64]  Chung-Chun Kung,et al.  A study of cluster validity criteria for the fuzzy c-regression models clustering algorithm , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[65]  Keyun Qin,et al.  Some new approaches to constructing similarity measures , 2014, Fuzzy Sets Syst..