Confident and consistent partial learning of recursive functions

Abstract Partial learning is a criterion where the learner infinitely often outputs one correct conjecture while every other hypothesis is issued only finitely often. This paper addresses two variants of partial learning in the setting of inductive inference of functions: first, confident partial learning requires that the learner also on those functions which it does not learn, singles out exactly one hypothesis which is output infinitely often; second, essentially class-consistent partial learning is partial learning with the additional constraint that on the functions to be learnt, almost all hypotheses issued are consistent with all the data seen so far. The results of the present work are that confident partial learning is more general than explanatory learning, incomparable with behaviourally correct learning and closed under union; essentially class-consistent partial learning is more general than behaviourally correct learning and incomparable with confident partial learning. Furthermore, it is investigated which oracles permit to learn all recursive functions under these criteria: for confident partial learning, some non-high oracles are omniscient; for essentially class-consistent partial learning, all PA-complete and all oracles of hyperimmune Turing degree are omniscient.

[1]  Akihiro Yamamoto,et al.  Learning Families of Closed Sets in Matroids , 2012, Computation, Physics and Beyond.

[2]  Manuel Blum,et al.  Toward a Mathematical Theory of Inductive Inference , 1975, Inf. Control..

[3]  Gunter Grieser Reflective Inductive Inference of Recursive Functions , 2002, ALT.

[4]  Rolf Wiehagen,et al.  Learning and Consistency , 1995, GOSLER Final Report.

[5]  Martin Kummer Numberings of R1 union F , 1988, CSL.

[6]  R. Soare,et al.  Π⁰₁ classes and degrees of theories , 1972 .

[7]  Rusins Freivalds,et al.  Inductive Inference and Computable One-One Numberings , 1982, Math. Log. Q..

[8]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[9]  M. Kendall,et al.  The Logic of Scientific Discovery. , 1959 .

[10]  Imre Lakatos,et al.  The role of crucial experiments in science , 1974 .

[11]  Thomas Zeugmann,et al.  Learning recursive functions: A survey , 2008, Theor. Comput. Sci..

[12]  W. Hanf The Boolean algebra of logic , 1975 .

[13]  John Case,et al.  Comparison of Identification Criteria for Machine Inductive Inference , 1983, Theor. Comput. Sci..

[14]  Sanjay Jain,et al.  Consistent Partial Identification , 2009, COLT.

[15]  Jerome A. Feldman,et al.  Some Decidability Results on Grammatical Inference and Complexity , 1972, Inf. Control..

[16]  Daniel N. Osherson,et al.  Systems That Learn: An Introduction to Learning Theory for Cognitive and Computer Scientists , 1990 .

[17]  Gary James Jason,et al.  The Logic of Scientific Discovery , 1988 .

[18]  Robert H. Sloan,et al.  BOOK REVIEW: "SYSTEMS THAT LEARN: AN INTRODUCTION TO LEARNING THEORY, SECOND EDITION", SANJAY JAIN, DANIEL OSHERSON, JAMES S. ROYER and ARUN SHARMA , 2001 .

[19]  Steffen Lange,et al.  Algorithmic Learning for Knowledge-Based Systems: Gosler Final Report , 1995 .

[20]  Jr. Hartley Rogers Theory of Recursive Functions and Effective Computability , 1969 .