Knowledge discovery by a neuro-fuzzy modeling framework

In this paper a neuro-fuzzy modeling framework is proposed, which is devoted to discover knowledge from data and represent it in the form of fuzzy rules. The core of the framework is a knowledge extraction procedure that is aimed to identify the structure and the parameters of a fuzzy rule base, through a two-phase learning of a neuro-fuzzy network. In order to obtain reliable and readable knowledge, two further stages are integrated with the knowledge extraction procedure: a pre-processing stage, performing variable selection on the available data to obtain simpler and more reliable fuzzy rules, and a post-processing stage, that granulates outputs of the extracted fuzzy rules so as to provide a validity range of estimated outputs. Moreover, the framework can address complex multi-input multi-output problems. In such case, two distinct modeling strategies can be followed with the opportunity of producing both a single MIMO model or a collection of MISO models. The proposed framework is verified on a real-world case study, involving prediction of chemical composition of ashes produced by combustion processes carried out in thermo-electric generators located in Italy.

[1]  Rudolf Kruse,et al.  Neuro-Fuzzy Systems , 1998 .

[2]  Derek A. Linkens,et al.  Input selection and partition validation for fuzzy modelling using neural network , 1999, Fuzzy Sets Syst..

[3]  Giovanna Castellano,et al.  A neuro-fuzzy system for ash property prediction , 2002 .

[4]  H. Timm,et al.  Fuzzy cluster analysis of classified data , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[5]  Michael Hanss.  On developing enhanced fuzzy models for nonlinear process control , 1997, 1997 Annual Meeting of the North American Fuzzy Information Processing Society - NAFIPS (Cat. No.97TH8297).

[6]  Alexander E. Gegov.  Multilayer fuzzy control of multivariable systems by active decomposition , 1997, Int. J. Intell. Syst..

[7]  Jacek M. Zurada,et al.  Knowledge-based neurocomputing , 2000 .

[8]  Lotfi A. Zadeh,et al.  Please Scroll down for Article International Journal of General Systems Fuzzy Sets and Systems* Fuzzy Sets and Systems* , 2022 .

[9]  Ajith Abraham,et al.  Neuro Fuzzy Systems: Sate-of-the-Art Modeling Techniques , 2001, IWANN.

[10]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[11]  Andrew Luk,et al.  Rival rewarded and randomly rewarded rival competitive learning , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[12]  L. Caponetti,et al.  Classifying Image Pixels by a Neuro-Fuzzy Approach , 2003 .

[13]  Nikola K. Kasabov,et al.  HyFIS: adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems , 1999, Neural Networks.

[14]  Yu-Geng Xi,et al.  Nonlinear system modeling by competitive learning and adaptive fuzzy inference system , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[15]  Rudolf Kruse,et al.  NEFCLASSmdash;a neuro-fuzzy approach for the classification of data , 1995, SAC '95.

[16]  Xiao-Jun Zeng,et al.  Approximation theory of fuzzy systems-SISO case , 1994, IEEE Trans. Fuzzy Syst..

[17]  Aníbal Ollero,et al.  Robust stability constraints for fuzzy model predictive control , 2002, IEEE Trans. Fuzzy Syst..

[18]  Yan Shi,et al.  A new approach of neuro-fuzzy learning algorithm for tuning fuzzy rules , 2000, Fuzzy Sets Syst..

[19]  Li-Xin Wang.  Modeling and control of hierarchical systems with fuzzy systems , 1997, Autom..

[20]  Chuen-Tsai Sun,et al.  Rule-base structure identification in an adaptive-network-based fuzzy inference system , 1994, IEEE Trans. Fuzzy Syst..

[21]  Christopher M. Bishop,et al.  Neural Network for Pattern Recognition , 1995 .

[22]  Xiao-Jun Zeng,et al.  Approximation theory of fuzzy systems-MIMO case , 1995, IEEE Trans. Fuzzy Syst..

[23]  Issam M. Kouatli.  A simplified fuzzy multivariable structure in a manufacturing environment , 1994, J. Intell. Manuf..

[24]  Stephen L. Chiu,et al.  Selecting Input Variables for Fuzzy Models , 1996, J. Intell. Fuzzy Syst..

[25]  Saman K. Halgamuge,et al.  Neural networks in designing fuzzy systems for real world applications , 1994 .

[26]  J. A. Roubos,et al.  Identification of MIMO systems by input-output TS fuzzy models , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[27]  José Mira,et al.  Connectionist Models of Neurons, Learning Processes, and Artificial Intelligence , 2001, Lecture Notes in Computer Science.

[28]  Jacek M. Zurada,et al.  Input selection in data-driven fuzzy modeling , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[29]  Giovanna Castellano,et al.  Fuzzy inference and rule extraction using a neural network , 2000 .

[30]  D. Nauck,et al.  Nefclass | a Neuro{fuzzy Approach for the Classification of Data , 1995 .

[31]  Manuela Battipede,et al.  A comparative design of a MIMO neural adaptive rate damping for a nonlinear helicopter model , 2000, ESANN.

[32]  Harpreet Singh,et al.  A neuro fuzzy logic approach to material processing , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[33]  Gregory Piatetsky-Shapiro,et al.  Advances in Knowledge Discovery and Data Mining , 2004, Lecture Notes in Computer Science.

[34]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[35]  Germano Lambert-Torres,et al.  A genetic-based neuro-fuzzy approach for modeling and control of dynamical systems , 1998, IEEE Trans. Neural Networks.

[36]  Constantin V. Negoita,et al.  On Fuzzy Systems , 1978 .

[37]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[38]  Witold Pedrycz,et al.  Data Mining Methods for Knowledge Discovery , 1998, IEEE Trans. Neural Networks.

[39]  Chin-Teng Lin,et al.  Neural-Network-Based Fuzzy Logic Control and Decision System , 1991, IEEE Trans. Computers.

[40]  J.-S.R. Jang,et al.  Input selection for ANFIS learning , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[41]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[42]  Min He,et al.  Fuzzy modeling and expert optimization control for industrial processes , 1996, IEEE Trans. Control. Syst. Technol..

[43]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[44]  Yucai Zhu,et al.  Some study on identification of ill-conditioned processes for control , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[45]  Giovanna Castellano,et al.  A self-organizing neural fuzzy inference network , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[46]  Isao Hayashi,et al.  A learning method of fuzzy inference rules by descent method , 1992 .

[47]  Erkki Oja,et al.  Rival penalized competitive learning for clustering analysis, RBF net, and curve detection , 1993, IEEE Trans. Neural Networks.

[48]  Detlef Nauck,et al.  Foundations Of Neuro-Fuzzy Systems , 1997 .

[49]  S. Himavathi,et al.  A multi-step approach for modeling MIMO systems from input-output data , 2001, IECON'01. 27th Annual Conference of the IEEE Industrial Electronics Society (Cat. No.37243).

[50]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[51]  J. Neter,et al.  Applied linear statistical models : regression, analysis of variance, and experimental designs , 1974 .