The WM method completed: a flexible fuzzy system approach to data mining

In this paper, the so-called Wang-Mendel (WM) method for generating fuzzy rules from data is enhanced to make it a comprehensive and flexible fuzzy system approach to data description and prediction. In the description part, the core ideas of the WM method are used to develop three methods to extract fuzzy IF-THEN rules from data. The first method shows how to extract rules for the user-specified cases, the second method generates all the rules that can be generated directly from the data, and the third method extrapolates the rules generated by the second method over the entire domain of interest. In the prediction part, two fuzzy predictive models are constructed based on the fuzzy IF-THEN rules extracted by the methods of the description part. The first model gives a continuous output and is suitable for predicting continuous variables, and the second model gives a piecewise constant output and is suitable for predicting categorical variables. We show that by comparing the prediction accuracy of the fuzzy predictive models with different numbers of fuzzy sets covering the input variables, we can rank the importance of the input variables. We also propose an algorithm to optimize the fuzzy predictive models, and show how to use the models to solve pattern recognition problems. Throughout this paper, we use a set of real data from a steel rolling plant to demonstrate the ideas and test the models.

[1]  Gregory Piatetsky-Shapiro,et al.  Advances in Knowledge Discovery and Data Mining , 2004, Lecture Notes in Computer Science.

[2]  Earl Cox,et al.  The fuzzy systems handbook - a practitioner's guide to building, using, and maintaining fuzzy systems , 1994 .

[3]  Jerome H. Friedman Multivariate adaptive regression splines (with discussion) , 1991 .

[4]  Li-Xin Wang,et al.  Adaptive fuzzy systems and control - design and stability analysis , 1994 .

[5]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[6]  Trevor Hastie,et al.  Multivariate adaptive regression splines. Discussions , 1991 .

[7]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[8]  Li-Xin Wang,et al.  Adaptive fuzzy systems and control , 1994 .

[9]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[10]  R. Bellman,et al.  V. Adaptive Control Processes , 1964 .

[11]  Harry Wechsler,et al.  From Statistics to Neural Networks , 1994, NATO ASI Series.

[12]  Lotfi A. Zadeh,et al.  The Concepts of a Linguistic Variable and its Application to Approximate Reasoning , 1975 .

[13]  Robert Groth Data Mining: Building Competitive Advantage , 1999 .

[14]  G. Kane Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[15]  Toshio Odanaka,et al.  ADAPTIVE CONTROL PROCESSES , 1990 .

[16]  Chin-Teng Lin,et al.  Neural-Network-Based Fuzzy Logic Control and Decision System , 1991, IEEE Trans. Computers.

[17]  Li-Xin Wang,et al.  A Course In Fuzzy Systems and Control , 1996 .

[18]  L. A. ZADEH,et al.  The concept of a linguistic variable and its application to approximate reasoning - I , 1975, Inf. Sci..

[19]  J. Friedman Multivariate adaptive regression splines , 1990 .

[20]  Hans-Jürgen Zimmermann,et al.  Fuzzy set theory , 1992 .

[21]  Serge Guillaume,et al.  Designing fuzzy inference systems from data: An interpretability-oriented review , 2001, IEEE Trans. Fuzzy Syst..

[22]  Li-Xin Wang,et al.  Approximation accuracy of some neuro-fuzzy approaches , 2000, IEEE Trans. Fuzzy Syst..

[23]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[24]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .