Noisy Inference and Oracles

The present paper deals with several variants of inductive inference from noisy data. The notion of noise is based on the idea that the learner recieves a sequence of data elements such that each correct element appears infinitely often and each incorrect element appears at most finitely often. The main result is that the concept of learning in the limit from noisy informant has the same power as finite learning using a K-oracle from noise-free informant. The analog equality for text fails in general and holds only in one direction in the case of learning uniformly recursive families. Furthermore, learnability from noisy informant or text in presence of using oracles is investigated. It is shown that partial identification of all r.e. sets can also cope with noisy informant and text.

[1]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[2]  Manuel Blum,et al.  Toward a Mathematical Theory of Inductive Inference , 1975, Inf. Control..

[3]  Dana Angluin,et al.  Inductive Inference of Formal Languages from Positive Data , 1980, Inf. Control..

[4]  C. Jockusch Degrees of generic sets , 1980 .

[5]  Gisela Schäfer-Richter Some results in the theory of effective program synthesis: learning by defective information , 1985, Mathematical Methods of Specification and Synthesis of Software Systems.

[6]  R. Soare Recursively enumerable sets and degrees , 1987 .

[7]  Sanjay Jain,et al.  Learning in the presence of inaccurate information , 1989, COLT '89.

[8]  Daniel N. Osherson,et al.  Systems That Learn: An Introduction to Learning Theory for Cognitive and Computer Scientists , 1990 .

[9]  Rolf Wiehagen A Thesis in Inductive Inference , 1990, Nonmonotonic and Inductive Logic.

[10]  Shyam Kapur,et al.  Monotonic Language Learning , 1992, ALT.

[11]  Frank Stephan,et al.  On the structure of degrees of inferability , 1993, COLT '93.

[12]  Arun Sharma,et al.  On Monotonic Strategies for Learning r.e. Languages , 1994, AII/ALT.

[13]  Stuart A. Kurtz,et al.  Extremes in the Degrees of Inferability , 1994, Ann. Pure Appl. Log..

[14]  Sanjay Jain,et al.  Program Synthesis in the Presence of Infinite Number of Inaccuracies , 1994, J. Comput. Syst. Sci..

[15]  Frank Stephan,et al.  Language Learning from Texts: Mind Changes, Limited Memory and Monotonicity (Extended Abstract). , 1995, COLT 1995.

[16]  Thomas Zeugmann,et al.  Characterizations of Monotonic and Dual Monotonic Language Learning , 1995, Inf. Comput..

[17]  Thomas Zeugmann,et al.  Monotonic and Dual Monotonic Language Learning , 1996, Theor. Comput. Sci..

[18]  Arun Sharma,et al.  Learning from Multiple Sources of Inaccurate Data , 1997, SIAM J. Comput..