Fuzzy analysis of statistical evidence

Bayesian classifiers are effective methods for pattern classification, although their assumptions on the belief structure among attributes are not always justified. In this paper, we introduce a new classification method based on the possibility measure, which does not require a precise belief model and, in a sense, it includes the Bayesian classifiers as special cases. This new classification method uses the fuzzy operators to aggregate attributes information (evidence) and it is referred to as fuzzy analysis of statistical evidence (FASE). FASE has several nice properties. It is noise tolerant, it can handle missing values with ease, and it can extract statistical patterns from the data and represent them by knowledge of beliefs, which, in turn, are propositions for an expert system. Thus, from pattern classification to expert systems, FASE provides a linkage from inductive reasoning to deductive reasoning.

[1]  Yuan Yan Chen.  Bernoulli Trials: From a Fuzzy Measure Point of View , 1993 .

[2]  Hisao Ishibuchi,et al.  Neural networks that learn from fuzzy if-then rules , 1993, IEEE Trans. Fuzzy Syst..

[3]  Somnath Mukhopadhyay,et al.  A polynomial time algorithm for the construction and training of a class of multilayer perceptrons , 1993, Neural Networks.

[4]  Sankar K. Pal,et al.  Multilayer perceptron, fuzzy sets, and classification , 1992, IEEE Trans. Neural Networks.

[5]  Stephen I. Gallant,et al.  Perceptron-based learning algorithms , 1990, IEEE Trans. Neural Networks.

[6]  S. Kullback,et al.  Information Theory and Statistics , 1959 .

[7]  Kurt Hornik,et al.  Neural networks and principal component analysis: Learning from examples without local minima , 1989, Neural Networks.

[8]  Robert A. Jacobs,et al.  Increased rates of convergence through learning rate adaptation , 1987, Neural Networks.

[9]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[10]  Eduardo D. Sontag,et al.  Feedback Stabilization Using Two-Hidden-Layer Nets , 1991, 1991 American Control Conference.

[11]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[12]  Jerry M. Mendel,et al.  A fuzzy classifier that uses both crisp samples and linguistic knowledge , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[13]  F. S. Wong,et al.  Fuzzy weighted averages and implementation of the extension principle , 1987 .

[14]  K. Lang,et al.  Learning to tell two spirals apart , 1988 .

[15]  James J. Buckley,et al.  Fuzzy neural network with fuzzy signals and weights , 1993, Int. J. Intell. Syst..

[16]  Hahn-Ming Lee,et al.  A neural network architecture for classification of fuzzy inputs , 1994 .

[17]  M. J. Frank.  On the simultaneous associativity of F(x, y) and x+y-F(x, y). (Short Communication). , 1978 .

[18]  M. J. Frank.  On the simultaneous associativity ofF(x,y) andx +y -F(x,y) , 1979 .

[19]  D. Dubois,et al.  Operations on fuzzy numbers , 1978 .

[20]  Sankar K. Pal,et al.  Fuzzy multi-layer perceptron, inferencing and rule generation , 1995, IEEE Trans. Neural Networks.

[21]  Pedro M. Domingos,et al.  Beyond Independence: Conditions for the Optimality of the Simple Bayesian Classifier , 1996, ICML.

[22]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[23]  Edward H. Shortliffe,et al.  A model of inexact reasoning in medicine , 1990 .

[24]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[25]  Yuan Yan Chen,et al.  Statistical inference based on the possibility and belief measures , 1995 .

[26]  Witold Pedrycz,et al.  Fuzzy sets in pattern recognition: Accomplishments and challenges , 1997, Fuzzy Sets Syst..

[27]  Michael D. Alder,et al.  Adaptive quadratic neural nets , 1992, Pattern Recognit. Lett..

[28]  James J. Buckley,et al.  On using a-cuts to evaluate fuzzy equations , 1990 .

[29]  Y. Ichikawa,et al.  Retaining diversity of genetic algorithms for multivariable optimization and neural network learning , 1993, IEEE International Conference on Neural Networks.

[30]  W. Dong,et al.  Vertex method for computing functions of fuzzy variables , 1987 .

[31]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[32]  Alberto Tesi,et al.  On the Problem of Local Minima in Backpropagation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Lawrence Davis,et al.  Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[34]  Jyh-Yeong Chang,et al.  Fuzzy perceptron learning and its application to classifiers with numerical data and linguistic knowledge , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[35]  Belief logic systems , 1990, [1990] Proceedings. First International Symposium on Uncertainty Modeling and Analysis.

[36]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[37]  James M. Keller,et al.  Incorporating Fuzzy Membership Functions into the Perceptron Algorithm , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Richard Lippmann,et al.  Neural Network Classifiers Estimate Bayesian a posteriori Probabilities , 1991, Neural Computation.