On learning of functions refutably

Learning of recursive functions refutably informally means that for every recursive function, the learning machine has either to learn this function or to refute it, that is to signal that it is not able to learn it. Three modi of making precise the notion of refuting are considered. We show that the corresponding types of learning refutably are of strictly increasing power, where already the most stringent of them turns out to be of remarkable topological and algorithmical richness. Furthermore, all these types are closed under union, though in different strengths. Also, these types are shown to be different with respect to their intrinsic complexity; two of them do not contain function classes that are "most difficult" to learn, while the third one does. Moreover, we present several characterizations for these types of learning refutably. Some of these characterizations make clear where the refuting ability of the corresponding learning machines comes from and how it can be realized, in general.For learning with anomalies refutably, we show that several results from standard learning without refutation stand refutably. From this we derive some hierarchies for refutable learning. Finally, we prove that in general one cannot trade stricter refutability constraints for more liberal learning criteria.

[1]  Eliana Minicozzi,et al.  Some Natural Properties of Strong-Identification in Inductive Inference , 1976, Theor. Comput. Sci..

[2]  Jr. Hartley Rogers Theory of Recursive Functions and Effective Computability , 1969 .

[3]  E. Mark Gold,et al.  Limiting recursion , 1965, Journal of Symbolic Logic.

[4]  Rusins Freivalds,et al.  Inductive Inference of Recursive Functions: Complexity Bounds , 1991, Baltic Computer Science.

[5]  Frank Stephan,et al.  On one-sided versus two-sided classification , 2001, Arch. Math. Log..

[6]  Steffen Lange,et al.  Machine Discovery in the Presence of Incomplete or Ambiguous Data , 1994, AII/ALT.

[7]  Rusins Freivalds,et al.  Inductive Inference of Recursive Functions: Qualitative Theory , 1991, Baltic Computer Science.

[8]  Rolf Wiehagen,et al.  Research in the theory of inductive inference by GDR mathematicians - A survey , 1980, Inf. Sci..

[9]  Shai Ben-David Can Finite Samples Detect Singularities of Real-Valued Functions? , 1998, Algorithmica.

[10]  H. Gordon Rice,et al.  On completely recursively enumerable classes and their key arrays , 1956, Journal of Symbolic Logic.

[11]  Tetsuhiro Miyahara,et al.  Refutable inference of functions computed by loop programs , 1995 .

[12]  John Case,et al.  Comparison of Identification Criteria for Machine Inductive Inference , 1983, Theor. Comput. Sci..

[13]  Paul Young,et al.  An introduction to the general theory of algorithms , 1978 .

[14]  John Case,et al.  Periodicity in generations of automata , 1974, Mathematical systems theory.

[15]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[16]  Carl H. Smith,et al.  Generalization versus classification , 1992, COLT '92.

[17]  Carl H. Smith,et al.  Inductive Inference: Theory and Methods , 1983, CSUR.

[18]  Efim Kinber,et al.  On the Classification of Computable Languages , 1997, STACS.

[19]  Rolf Wiehagen,et al.  Characterization Problems in the Theory of Inductive Inference , 1978, ICALP.

[20]  Manuel Blum,et al.  A Machine-Independent Theory of the Complexity of Recursive Functions , 1967, JACM.

[21]  Daniel N. Osherson,et al.  Systems That Learn: An Introduction to Learning Theory for Cognitive and Computer Scientists , 1990 .

[22]  Gary James Jason,et al.  The Logic of Scientific Discovery , 1988 .

[23]  John Case,et al.  Refinements of inductive inference by Popperian and reliable machines , 1994, Kybernetika.

[24]  Klaus P. Jantke,et al.  Reflecting and Self-Confident Inductive Inference Machines , 1995, ALT.

[25]  Carl H. Smith,et al.  On the Intrinsic Complexity of Learning , 1995, Inf. Comput..

[26]  Setsuo Arikawa,et al.  Towards a Mathematical Theory of Machine Discovery from Facts , 1995, Theor. Comput. Sci..

[27]  Sanjay Jain Learning with Refutation , 1998, J. Comput. Syst. Sci..

[28]  Setsuo Arikawa,et al.  Inductive Inference Machines That Can Refute Hypothesis Spaces , 1993, ALT.

[29]  Thomas Zeugmann,et al.  A-posteriori Characterizations in Inductive Inference of Recursive Functions , 1983, J. Inf. Process. Cybern..

[30]  Thomas Zeugmann,et al.  One-Sided Error Probabilistic Inductive Inference and Reliable Frequency Identification , 1991, Inf. Comput..

[31]  Thomas Zeugmann,et al.  Inductive Inference of Almost Everywhere Correct Programs by Reliably Working Strategies , 1985, J. Inf. Process. Cybern..

[32]  Manuel Blum,et al.  Toward a Mathematical Theory of Inductive Inference , 1975, Inf. Control..

[33]  Gunter Grieser,et al.  Reflecting Inductive Inference Machines and Its Improvement by Therapy , 1996, ALT.

[34]  Carl H. Smith,et al.  Classifying Predicates and Languages , 1997, Int. J. Found. Comput. Sci..