Learning how to separate

The main question addressed in the present work is how to findeffectiv ely a recursive function separating two sets drawn arbitrarily from a given collection of disjoint sets. In particular, it is investigated in which cases it is possible to satisfy the following additional constraints: confidence where the learner converges on all data-sequences; conservativeness where the learner abandons only definitely wrong hypotheses; consistency where also every intermediate hypothesis is consistent with the data seen so far; set-driven learners whose hypotheses are independent of the order and the number of repetitions of the data-items supplied; learners where either the last or even all hypotheses are programs of total recursive functions.The present work gives an overview of the relations between these notions and succeeds to answer many questions by finding ways to carry over the corresponding results from other scenarios within inductive inference. Nevertheless, the relations between conservativeness and setdriven inference needed a novel approach which enabled to show the following two major results: (1) There is a class for which recursive separators can be foundin a confident and set-driven way, but no conservative learner finds a (not necessarily total) separator for this class. (2) There is a class for which recursive separators can be foundin a confident and conservative way, but no set-driven learner finds a (not necessarily total) separator for this class.

[1]  Frank Stephan,et al.  On the structure of degrees of inferability , 1993, COLT '93.

[2]  C. Jockusch Degrees in Which the Recursive Sets are Uniformly Recursive , 1972, Canadian Journal of Mathematics.

[3]  Manuel Blum,et al.  A Machine-Independent Theory of the Complexity of Recursive Functions , 1967, JACM.

[4]  Robert H. Sloan,et al.  BOOK REVIEW: "SYSTEMS THAT LEARN: AN INTRODUCTION TO LEARNING THEORY, SECOND EDITION", SANJAY JAIN, DANIEL OSHERSON, JAMES S. ROYER and ARUN SHARMA , 2001 .

[5]  Rolf Wiehagen,et al.  Charakteristische Eigenschaften von erkennbaren Klassen rekursiver Funktionen , 1976, J. Inf. Process. Cybern..

[6]  Mark A. Fulk A study of inductive inference machines , 1986 .

[7]  Manuel Blum,et al.  Toward a Mathematical Theory of Inductive Inference , 1975, Inf. Control..

[8]  Daniel N. Osherson,et al.  Systems That Learn: An Introduction to Learning Theory for Cognitive and Computer Scientists , 1990 .

[9]  Frank Stephan,et al.  On the Uniform Learnability of Approximations to Non-Recursive Functions , 1999, ALT.

[10]  John Case,et al.  Refinements of inductive inference by Popperian and reliable machines , 1994, Kybernetika.

[11]  Paul Young,et al.  An introduction to the general theory of algorithms , 1978 .

[12]  Eliana Minicozzi,et al.  Some Natural Properties of Strong-Identification in Inductive Inference , 1976, Theor. Comput. Sci..

[13]  Andris Ambainis,et al.  Ordinal Mind Change Complexity of Language Identification , 1997, Theor. Comput. Sci..

[14]  Kenneth Wexler,et al.  Formal Principles of Language Acquisition , 1980 .

[15]  Carl H. Smith,et al.  Inductive Inference: Theory and Methods , 1983, CSUR.

[16]  Arun Sharma,et al.  Generalized notions of mind change complexity , 1997, COLT '97.

[17]  Jr. Hartley Rogers Theory of Recursive Functions and Effective Computability , 1969 .

[18]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[19]  John Case,et al.  Machine Inductive Inference and Language Identification , 1982, ICALP.

[20]  David Maier Review of "Introduction to automata theory, languages and computation" by John E. Hopcroft and Jeffrey D. Ullman. Addison-Wesley 1979. , 1980, SIGA.

[21]  Rolf Wiehagen,et al.  Research in the theory of inductive inference by GDR mathematicians - A survey , 1980, Inf. Sci..

[22]  Mark A. Fulk Prudence and Other Conditions on Formal Language Learning , 1990, Inf. Comput..

[23]  P. Odifreddi Classical recursion theory , 1989 .

[24]  Thomas Zeugmann On Barzdin's Conjecture , 1986, AII.

[25]  John Case,et al.  Comparison of Identification Criteria for Machine Inductive Inference , 1983, Theor. Comput. Sci..

[26]  Frank Stephan,et al.  Language Learning from Texts: Mindchanges, Limited Memory, and Monotonicity , 1995, Inf. Comput..

[27]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[28]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..