Data-Driven Interval Type-2 Neural Fuzzy System With High Learning Accuracy and Improved Model Interpretability

Current studies of type-2 neural fuzzy systems (FSs) (NFSs) primarily focus on building a fuzzy model with high accuracy and disregard the interpretability of fuzzy rules. This paper proposes a data-driven interval type-2 (IT2) NFS with improved model interpretability (DIT2NFS-IP). The DIT2NFS-IP uses IT2 fuzzy sets in its antecedent part and intervals in its zero-order Takagi-Sugeno-Kang-type consequent part for rule form simplicity. The initial rule base is generated by a self-splitting clustering algorithm in the input-output space. The DIT2NFS-IP uses a two-phase parameter-learning algorithm to design an accurate model with improved rule interpretability. In the first phase, a new cost function that considers both accuracy and transparent fuzzy set partition is defined. The antecedent and consequent parameters are learned through gradient descent and rule-ordered recursive least squares algorithms, respectively, to achieve cost function minimization. The second phase performs a fuzzy set reduction, followed by consequent parameter learning to improve accuracy. Comparisons with different type-1 and type-2 FSs in five databased modeling and prediction problems verify the performance of the DIT2NFS-IP in both model accuracy and interpretability.

[1]  Francisco Herrera,et al.  Integration of an Index to Preserve the Semantic Interpretability in the Multiobjective Evolutionary Rule Selection and Tuning of Linguistic Fuzzy Systems , 2010, IEEE Transactions on Fuzzy Systems.

[2]  Jerry M. Mendel,et al.  A Vector Similarity Measure for Interval Type-2 Fuzzy Sets , 2007, 2007 IEEE International Fuzzy Systems Conference.

[3]  Jerry M. Mendel,et al.  Computing derivatives in interval type-2 fuzzy logic systems , 2004, IEEE Transactions on Fuzzy Systems.

[4]  Ralf Mikut,et al.  Interpretability issues in data-based learning of fuzzy systems , 2005, Fuzzy Sets Syst..

[5]  Beatrice Lazzerini,et al.  A Pareto-based multi-objective evolutionary approach to the identification of Mamdani fuzzy systems , 2007, Soft Comput..

[6]  Faiyaz Doctor,et al.  A System-on-Chip Development of a Neuro–Fuzzy Embedded Agent for Ambient-Intelligence Environments , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  J. Casillas Interpretability issues in fuzzy modeling , 2003 .

[8]  Shyi-Ming Chen,et al.  Fuzzy Interpolative Reasoning for Sparse Fuzzy Rule-Based Systems Based on ${\bm \alpha}$-Cuts and Transformations Techniques , 2008, IEEE Transactions on Fuzzy Systems.

[9]  Sung-Kwun Oh,et al.  Identification of Fuzzy Inference System Based on Information Granulation , 2010, KSII Trans. Internet Inf. Syst..

[10]  C.J.H. Mann Similarity and Compatibility in Fuzzy Set Theory – Assessment and Applications , 2002 .

[11]  Hannu Koivisto,et al.  A Dynamically Constrained Multiobjective Genetic Fuzzy System for Regression Problems , 2010, IEEE Transactions on Fuzzy Systems.

[12]  José de Jesús Rubio,et al.  SOFMLS: Online Self-Organizing Fuzzy Modified Least-Squares Network , 2009, IEEE Transactions on Fuzzy Systems.

[13]  Plamen P. Angelov,et al.  Fuzzily Connected Multimodel Systems Evolving Autonomously From Data Streams , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Shyi-Ming Chen,et al.  Weighted Fuzzy Rule Interpolation Based on GA-Based Weight-Learning Techniques , 2011, IEEE Transactions on Fuzzy Systems.

[16]  H. Ishibuchi Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge bases , 2004 .

[17]  M. Sami Fadali,et al.  TSK Fuzzy Function Approximators: Design and Accuracy Analysis , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[19]  László T. Kóczy,et al.  A generalized concept for fuzzy rule interpolation , 2004, IEEE Transactions on Fuzzy Systems.

[20]  Hisao Ishibuchi,et al.  Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems , 1997, Fuzzy Sets Syst..

[21]  Chia-Feng Juang,et al.  A Type-2 Self-Organizing Neural Fuzzy System and Its FPGA Implementation , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[23]  Yaochu Jin,et al.  Fuzzy modeling of high-dimensional systems: complexity reduction and interpretability improvement , 2000, IEEE Trans. Fuzzy Syst..

[24]  J. Mendel Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions , 2001 .

[25]  Hiok Chai Quek,et al.  eFSM—A Novel Online Neural-Fuzzy Semantic Memory Model , 2010, IEEE Transactions on Neural Networks.

[26]  Chia-Feng Juang,et al.  Temporal problems solved by dynamic fuzzy network based on genetic algorithm with variable-length chromosomes , 2004, Fuzzy Sets Syst..

[27]  Chia-Feng Juang,et al.  Human Body Posture Classification by a Neural Fuzzy Network and Home Care System Application , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[28]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[29]  Beatrice Lazzerini,et al.  Multi-objective evolutionary learning of granularity, membership function parameters and rules of Mamdani fuzzy systems , 2009, Evol. Intell..

[30]  Qiang Shen,et al.  Fuzzy Interpolation and Extrapolation: A Practical Approach , 2008, IEEE Transactions on Fuzzy Systems.

[31]  Hani Hagras Comments on "Dynamical Optimal Training for Interval Type-2 Fuzzy Neural Network (T2FNN) , 2006, IEEE Trans. Syst. Man Cybern. Part B.

[32]  José Valente de Oliveira,et al.  Semantic constraints for membership function optimization , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[33]  Mojtaba Ahmadieh Khanesar,et al.  Analysis of the Noise Reduction Property of Type-2 Fuzzy Logic Systems Using a Novel Type-2 Membership Function , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  Witold Pedrycz,et al.  A Gradient-Descent-Based Approach for Transparent Linguistic Interface Generation in Fuzzy Models , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[35]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[36]  Rudolf Kruse,et al.  Neuro-fuzzy systems for function approximation , 1999, Fuzzy Sets Syst..

[37]  Emil Levi,et al.  Identification of complex systems based on neural and Takagi-Sugeno fuzzy model , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[38]  John Q. Gan,et al.  Low-level interpretability and high-level interpretability: a unified view of data-driven interpretable fuzzy system modelling , 2008, Fuzzy Sets Syst..

[39]  Okyay Kaynak,et al.  Type 2 Fuzzy Neural Structure for Identification and Control of Time-Varying Plants , 2010, IEEE Transactions on Industrial Electronics.

[40]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[41]  Chia-Feng Juang,et al.  An Interval Type-2 Fuzzy-Neural Network With Support-Vector Regression for Noisy Regression Problems , 2010, IEEE Transactions on Fuzzy Systems.

[42]  K. Shulman,et al.  Fuzzy logic pharmacokinetic modeling: Application to lithium concentration prediction , 1997, Clinical pharmacology and therapeutics.

[43]  Shyi-Ming Chen,et al.  Fuzzy rule interpolation based on interval type-2 Gaussian fuzzy sets and genetic algorithms , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[44]  Chin-Teng Lin,et al.  An On-Line Self-Constructing Neural Fuzzy Inference Network and Its Applications , 1998 .

[45]  Francisco Herrera,et al.  A Fast and Scalable Multiobjective Genetic Fuzzy System for Linguistic Fuzzy Modeling in High-Dimensional Regression Problems , 2011, IEEE Transactions on Fuzzy Systems.

[46]  Yih-Guang Leu,et al.  Robust Adaptive Controller Design for a Class of Uncertain Nonlinear Systems Using Online T–S Fuzzy-Neural Modeling Approach , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[47]  I. Burhan Türksen,et al.  Discrete Interval Type 2 Fuzzy System Models Using Uncertainty in Learning Parameters , 2007, IEEE Transactions on Fuzzy Systems.

[48]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[49]  Sung-Kwun Oh,et al.  Identification of Fuzzy Inference Systems Using a Multi-objective Space Search Algorithm and Information Granulation , 2011 .

[50]  Edwin Lughofer,et al.  FLEXFIS: A Robust Incremental Learning Approach for Evolving Takagi–Sugeno Fuzzy Models , 2008, IEEE Transactions on Fuzzy Systems.

[51]  Chia-Feng Juang,et al.  A Self-Evolving Interval Type-2 Fuzzy Neural Network With Online Structure and Parameter Learning , 2008, IEEE Transactions on Fuzzy Systems.

[52]  Rui Pedro Paiva,et al.  Interpretability and learning in neuro-fuzzy systems , 2004, Fuzzy Sets Syst..

[53]  Chia-Feng Juang,et al.  Speedup of Implementing Fuzzy Neural Networks With High-Dimensional Inputs Through Parallel Processing on Graphic Processing Units , 2011, IEEE Transactions on Fuzzy Systems.