Nested Hyper-Rectangles for Exemplar-Based Learning

Exemplar-based learning is a theory in which learning is accomplished by storing points in Euclidean n-space, En. This paper presents a new theory in which these points are generalized to become hyper-rectangles. These hyper-rectangles, in turn, may be nested to arbitrary depth inside one another. This representation scheme is sharply different from the usual inductive learning paradigms, which learn by replacing boolean formulae by more general formulae, or by creating decision trees. The theory is described and then compared to other inductive learning theories. An implementation, Each, has been tested empirically on three different domains: predicting the recurrence of breast cancer, classifying iris flowers, and predicting survival times for heart attack patients. In each case, the results are compared to published results using the same data sets and different machine learning algorithms. Each performs as well as or better than other algorithms on all of the data sets.

[1]  Steven L. Salzberg Pinpointing good hypotheses with heuristics , 1986 .

[2]  Donald A. Waterman,et al.  Pattern-Directed Inference Systems , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  David Haussler,et al.  Learnability and the Vapnik-Chervonenkis dimension , 1989, JACM.

[4]  Brian Everitt,et al.  Cluster analysis , 1974 .

[5]  Alan Bundy,et al.  An Analytical Comparison of Some Rule-Learning Programs , 1985, Artif. Intell..

[6]  Gerald DeJong,et al.  Learning Schemata for Natural Language Processing , 1985, IJCAI.

[7]  Chris Thornton Hypercuboid-Formation Behaviour of Two Learning Algorithms , 1987, IJCAI.

[8]  David W. Aha,et al.  Noise-Tolerant Instance-Based Learning Algorithms , 1989, IJCAI.

[9]  A. J. Dunning,et al.  Short and long term predictive value of admission wall motion score in acute myocardial infarction. A cross sectional echocardiographic study of 345 patients. , 1986, British heart journal.

[10]  Stuart L. Crawford Extensions to the CART Algorithm , 1989, Int. J. Man Mach. Stud..

[11]  Leslie G. Valiant,et al.  A theory of the learnable , 1984, STOC '84.

[12]  Steven Salzberg Heuristics for Inductive Learning , 1985, IJCAI.

[13]  Tom M. Mitchell,et al.  MODEL-DIRECTED LEARNING OF PRODUCTION RULES1 , 1978 .

[14]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[15]  A. Tversky,et al.  Judgment under Uncertainty , 1982 .

[16]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[17]  Tom M. Mitchell,et al.  LEAP: A Learning Apprentice for VLSI Design , 1985, IJCAI.

[18]  Tom Michael Mitchell Version spaces: an approach to concept learning. , 1979 .

[19]  Nada Lavrac,et al.  The Multi-Purpose Incremental Learning System AQ15 and Its Testing Application to Three Medical Domains , 1986, AAAI.

[20]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .