Generalization versus classification

Abstract The problem of generalizing from specific instances to descriptions of underlying concepts is represented abstractly as the problem of inductive inference. A similarly abstract rendition of the problem of classifying concepts from a collection into one of a finite set a categories is introduced. The mathematical representations of generalization and classification admit to rigorous comparisons. We show similarities as well as differences between the problems of generalization and classification. Some characterizations of an interesting, potentially practical, restriction of the classification problem are presented.

[1]  Carl H. Smith,et al.  On the role of search for learning , 1989, COLT '89.

[2]  H. Gordon Rice,et al.  On completely recursively enumerable classes and their key arrays , 1956, Journal of Symbolic Logic.

[3]  G. F. Rose,et al.  Approximations of functions on the integers. , 1963 .

[4]  Rolf Wiehagen,et al.  Research in the theory of inductive inference by GDR mathematicians - A survey , 1980, Inf. Sci..

[5]  Manuel Blum,et al.  Toward a Mathematical Theory of Inductive Inference , 1975, Inf. Control..

[6]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[7]  R. Soare Recursively enumerable sets and degrees , 1987 .

[8]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[9]  John Case,et al.  Comparison of Identification Criteria for Machine Inductive Inference , 1983, Theor. Comput. Sci..

[10]  Jr. Hartley Rogers Theory of Recursive Functions and Effective Computability , 1969 .

[11]  Stuart C. Shapiro,et al.  Encyclopedia of artificial intelligence, vols. 1 and 2 (2nd ed.) , 1992 .

[12]  Eliana Minicozzi,et al.  Some Natural Properties of Strong-Identification in Inductive Inference , 1976, Theor. Comput. Sci..

[13]  Paul Young,et al.  An introduction to the general theory of algorithms , 1978 .

[14]  Erwin Engeler Introduction to the theory of computation , 1973 .

[15]  Rolf Wiehagen,et al.  Inductive Inference with Additional Information , 1979, J. Inf. Process. Cybern..

[16]  Carl H. Smith,et al.  Inductive Inference: Theory and Methods , 1983, CSUR.