Analysis of Case-Based Representability of Boolean Functions by Monotone Theory

Classification is one of major tasks in case-based reasoning (CBR) and many studies have been done for analyzing properties of case-based classification [1,14,10,15,12,9,13,7]. However, these studies only consider numerical similarity measures whereas there are other kinds of similarity measure for different tasks. Among these measures, HYPO system [2,3] in a legal domain uses a similarity measure based on set inclusion of differences of attributes in cases. In this paper, we give an analysis of representability of boolean functions in case-based classification using the above set inclusion based similarity. We show that such case-based classification has a strong connection between monotone theory studied in [4,11]. Monotone theory is originated from computational learning theory and is used to show learnability of boolean function with polynomial DNF size and polynomial CNF size [4] and is used for deductive reasoning as well [11]. In this paper, we analyze a case-based representability of boolean functions by using the above relationship between the case-based classification by set inclusion based similarity and the monotone theory. We show that any boolean function is representable by a casebase whose size is bounded in polynomial of its DNF size and its CNF size and thus, k-term DNF, k-clause CNF can be efficiently representable in a casebase using set inclusion similarity.

[1]  Derek G. Bridge,et al.  On Concept Space and Hypothesis Space in Case-Based Learning Algorithms , 1995, ECML.

[2]  David L. Waltz,et al.  Toward memory-based reasoning , 1986, CACM.

[3]  Herbert Schorr,et al.  Innovative applications of artificial intelligence 2 , 1989 .

[4]  Steffen Lange,et al.  Case-Based Representation and Learning of Pattern Languages , 1993, Theor. Comput. Sci..

[5]  Ken Satoh,et al.  Translating Case-Based Reasoning into Abductive Logic Programming , 1996, ECAI.

[6]  Simon Kasif,et al.  Best-Case Results for Nearest-Neighbor Learning , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Marc Goodman,et al.  Prism: A Case-Based Telex Classifier , 1990, IAAI.

[8]  David L. Waltz,et al.  Trading MIPS and memory for knowledge engineering , 1992, CACM.

[9]  Ken Satoh,et al.  An Average Predictive Accuracy of the Nearest Neighbor Classifier , 1994, EWCBR.

[10]  Christoph Globig,et al.  Case-Based Representability of Classes of Boolean Functions , 1996, ECAI.

[11]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[12]  Vincent Aleven,et al.  A Logical Representation for Relevance Criteria , 1993, EWCBR.

[13]  Dan Roth,et al.  Reasoning with Models , 1994, Artif. Intell..

[14]  Agnar Aamodt,et al.  Case-Based Reasoning Research and Development , 1995, Lecture Notes in Computer Science.

[15]  Kevin D. Ashley Modeling legal argument - reasoning with cases and hypotheticals , 1991, Artificial intelligence and legal reasoning.

[16]  David W. Aha,et al.  Towards a Better Understanding of Memory-based Reasoning Systems , 1994, ICML.

[17]  Nader H. Bshouty Exact Learning Boolean Function via the Monotone Theory , 1995, Inf. Comput..

[18]  Seishi Okamoto,et al.  An Average-Case Analysis of k-Nearest Neighbor Classifier , 1995, ICCBR.