A neuro-fuzzy network to generate human-understandable knowledge from data

Neuro-fuzzy networks have been successfully applied to extract knowledge from data in the form of fuzzy rules. However, one drawback with the neuro-fuzzy approach is that the fuzzy rules induced by the learning process are not necessarily understandable. The lack of readability is essentially due to the high dimensionality of the parameter space that leads to excessive flexibility in the modification of parameters during learning. In this paper, to obtain readable knowledge from data, we propose a new neuro-fuzzy model and its learning algorithm that works in a parameter space with reduced dimensionality. The dimensionality of the new parameter space is necessary and sufficient to generate human-understandable fuzzy rules, in the sense formally defined by a set of properties. The learning procedure is based on a gradient descent technique and the proposed model is general enough to be applied to other neuro-fuzzy architectures. Simulation studies on a benchmark and a real-life problem are carried out to embody the idea of the paper.

[1]  Witold Pedrycz,et al.  Data Mining Methods for Knowledge Discovery , 1998, IEEE Trans. Neural Networks.

[2]  Chuen-Tsai Sun,et al.  Neuro-fuzzy modeling and control , 1995, Proc. IEEE.

[3]  Chin-Teng Lin,et al.  Neural-Network-Based Fuzzy Logic Control and Decision System , 1991, IEEE Trans. Computers.

[4]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[5]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[6]  Giovanna Castellano,et al.  Simplifying a neuro-fuzzy model , 1996, Neural Processing Letters.

[7]  Saman K. Halgamuge,et al.  Neural networks in designing fuzzy systems for real world applications , 1994 .

[8]  Yo-Ping Huang,et al.  Simplifying fuzzy modeling by both gray relational analysis and data transformation methods , 1999, Fuzzy Sets Syst..

[9]  Giovanna Castellano,et al.  Variable selection using neural-network models , 2000, Neurocomputing.

[10]  Mo-Yuen Chow,et al.  Heuristic constraints enforcement for training of and knowledge extraction from a fuzzy/neural architecture. I. Foundation , 1999, IEEE Trans. Fuzzy Syst..

[11]  Korris Fu-Lai Chung,et al.  On multistage fuzzy neural network modeling , 2000, IEEE Trans. Fuzzy Syst..

[12]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[13]  Giovanna Castellano,et al.  A new Empirical Risk Functional for a Neuro-Fuzzy Classifier , 2000 .

[14]  Detlef Nauck,et al.  Foundations Of Neuro-Fuzzy Systems , 1997 .

[15]  Mo-Yuen Chow,et al.  Heuristic constraints enforcement for training of and rule extraction from a fuzzy/neural architecture. II. Implementation and application , 1999, IEEE Trans. Fuzzy Syst..

[16]  Ahmad Lotfi,et al.  Interpretation preservation of adaptive fuzzy inference systems , 1996, Int. J. Approx. Reason..

[17]  Detlef Nauck Beyond Neuro{fuzzy: Perspectives and Directions , 1995 .

[18]  Constantin V. Negoita,et al.  On Fuzzy Systems , 1978 .

[19]  Shigeo Abe,et al.  A method for fuzzy rules extraction directly from numerical data and its application to pattern classification , 1995, IEEE Trans. Fuzzy Syst..

[20]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[21]  Magne Setnes,et al.  Rule-based modeling: precision and transparency , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[22]  Jacek M. Zurada,et al.  Extraction of linguistic rules from data via neural networks and fuzzy approximation , 2000 .

[23]  Qiang Shen,et al.  From approximative to descriptive models , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[24]  José Valente de Oliveira,et al.  Towards neuro-linguistic modeling: Constraints for optimization of membership functions , 1999, Fuzzy Sets Syst..

[25]  Jacek M. Zurada,et al.  Knowledge-based neurocomputing , 2000 .

[26]  Didier Dubois,et al.  Fuzzy sets and systems ' . Theory and applications , 2007 .

[27]  Visakan Kadirkamanathan,et al.  Statistical Control of RBF-like Networks for Classification , 1997, ICANN.

[28]  O. Mangasarian,et al.  Multisurface method of pattern separation for medical diagnosis applied to breast cytology. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Yoshua Bengio,et al.  Gradient-Based Optimization of Hyperparameters , 2000, Neural Computation.

[30]  Masoud Mohammadian New frontiers in computational intelligence and its applications , 2000 .

[31]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[32]  M. Sugeno,et al.  Structure identification of fuzzy model , 1988 .

[33]  Yaochu Jin,et al.  Fuzzy modeling of high-dimensional systems: complexity reduction and interpretability improvement , 2000, IEEE Trans. Fuzzy Syst..

[34]  Uzay Kaymak,et al.  Similarity measures in fuzzy rule base simplification , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[35]  Rudolf Kruse,et al.  Generating classification rules with the neuro-fuzzy system NEFCLASS , 1996, Proceedings of North American Fuzzy Information Processing.

[36]  Li-Xin Wang,et al.  Analysis and design of hierarchical fuzzy systems , 1999, IEEE Trans. Fuzzy Syst..

[37]  Bernhard Sendhoff,et al.  On generating FC3 fuzzy rule systems from data using evolution strategies , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[38]  L. Zadeh Fuzzy sets as a basis for a theory of possibility , 1999 .

[39]  W. Pedrycz,et al.  An introduction to fuzzy sets : analysis and design , 1998 .

[40]  Lotfi A. Zadeh,et al.  Please Scroll down for Article International Journal of General Systems Fuzzy Sets and Systems* Fuzzy Sets and Systems* , 2022 .

[41]  Hugues Bersini,et al.  Now comes the time to defuzzify neuro-fuzzy models , 1997, Fuzzy Sets Syst..

[42]  Mircea Gh. Negoita Book review of "Data mining methods for knowledge discovery by K. Cios, W. Pedrycz and R. Swiniarski" Kluwer. 1998 , 2000, SKDD.

[43]  Yaochu Jin,et al.  An approach to rule-based knowledge extraction , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[44]  Rudolf Kruse,et al.  Obtaining interpretable fuzzy classification rules from medical data , 1999, Artif. Intell. Medicine.

[45]  T. Ross Fuzzy Logic with Engineering Applications , 1994 .

[46]  Peter Craven,et al.  Smoothing noisy data with spline functions , 1978 .

[47]  Rudolf Kruse,et al.  A neuro-fuzzy method to learn fuzzy classification rules from data , 1997, Fuzzy Sets Syst..

[48]  Wlodzislaw Duch,et al.  A new methodology of extraction, optimization and application of crisp and fuzzy logical rules , 2001, IEEE Trans. Neural Networks.