Neural networks for soft decision making

This paper discusses various techniques for soft decision making by neural networks. Decision making problems are described as choosing an action from possible alternatives using available information. In the context of soft decision making, a single action is not always chosen. When it is difficult to choose a single action based on available information, the decision is withheld or a set of promising actions is presented to human users. The ability to handle uncertain information is also required in soft decision making. In this paper, we handle decision making as a classification problem where an input pattern is classified as one of given classes. Class labels in the classification problem correspond to alternative actions in decision making. In this paper, neural networks are used as classification systems, which eventually could be implemented as a part of decision making systems. First we focus on soft decision making by trained neural networks. We assume that the learning of a neural network has already been completed. When a new pattern cannot be classified as a single class with high certainty by the trained neural network, the classification of such a new pattern is rejected. After briefly describing rejection methods based on crisp outputs from the trained neural network, we propose an interval-arithmetic-based rejection method with interval input vectors, and extend it to the case of fuzzy input vectors. Next we describe the learning of neural networks for possibility analysis. The aim of possibility analysis is to present a set of possible classes of a new pattern to human users. Then we describe the learning of neural networks from training patterns with uncertainty. Such training patterns are denoted by interval vectors and fuzzy vectors. Finally we examine the performance of various soft decision making methods described in this paper by computer simulations on commonly used data sets in the literature.

[1]  Hideo Tanaka,et al.  An architecture of neural networks for input vectors of fuzzy numbers , 1992, [1992 Proceedings] IEEE International Conference on Fuzzy Systems.

[2]  Hisao Ishibuchi,et al.  Possibility and necessity pattern classification using neural networks , 1992 .

[3]  G. Alefeld,et al.  Introduction to Interval Computation , 1983 .

[4]  J. Buckley,et al.  Fuzzy neural networks: a survey , 1994 .

[5]  Hideo Tanaka,et al.  An extension of the BP-algorithm to interval input vectors-learning from numerical data and expert's knowledge , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[6]  Gopathy Purushothaman,et al.  Quantum neural networks (QNNs): inherently fuzzy feedforward neural networks , 1997, IEEE Trans. Neural Networks.

[7]  Shouhong Wang,et al.  Fuzzy set representation of neural network classification boundaries , 1991, IEEE Trans. Syst. Man Cybern..

[9]  Hisao Ishibuchi,et al.  Neural networks that learn from fuzzy if-then rules , 1993, IEEE Trans. Fuzzy Syst..

[10]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[11]  Sholom M. Weiss,et al.  Computer Systems That Learn , 1990 .

[12]  Thien M. Ha,et al.  The Optimum Class-Selective Rejection Rule , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Yoram Baram,et al.  Soft nearest neighbor classification , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[14]  Michel Grabisch,et al.  Classification by fuzzy integral: performance and tests , 1994, CVPR 1994.

[15]  Hisao Ishibuchi,et al.  Possibilistic fuzzy classification using neural networks , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[16]  H. Ishibuchi,et al.  Approximate Pattern Classification Using Neural Networks , 1993 .

[17]  C. K. Chow,et al.  On optimum recognition error and reject tradeoff , 1970, IEEE Trans. Inf. Theory.

[18]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[19]  Madan M. Gupta,et al.  Introduction to Fuzzy Arithmetic , 1991 .

[20]  Mario Vento,et al.  A method for improving classification reliability of multilayer perceptrons , 1995, IEEE Trans. Neural Networks.

[21]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[22]  Hisao Ishibuchi,et al.  Fuzzy classification with reject options by fuzzy if-then rules , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[23]  Ivan Flores,et al.  An Optimum Character Recognition System Using Decision Functions , 1958, IRE Trans. Electron. Comput..

[24]  Hisao Ishibuchi,et al.  Learning by fuzzified neural networks , 1995, Int. J. Approx. Reason..