Avoiding Coding Tricks by Hyperrobust Learning

The present work introduces and justifies the notion of hyperrobust learning where one fixed learner has to learn all functions in a given class plus their images under primitive recursive operators. The following is shown: This notion of learnability does not change if the class of primitive recursive operators is replaced by a larger enumerable class of operators. A class is hyperrobustly Ex-learnable iff it is a subclass of a recursively enumerable family of total functions. So, the notion of hyperrobust learning overcomes a problem of the traditional definitions of robustness which either do not preserve learning by enumeration or still permit topological coding tricks for the learning criterion Ex. Hyperrobust BC-learning as well as the hyperrobust version of Ex-learning by teams are more powerful than hyperrobust Ex-learning. The notion of bounded totally reliable BC-learning is properly between hyperrobust Ex-learning and hyperrobust BC-learning. Furthermore, the bounded totally reliably BC-learnable classes are characterized in terms of infinite branches of certain enumerable families of bounded recursive trees. A class of infinite branches of a further family of trees separates hyperrobust BC-learning from totally reliable BC-learning.

[1]  Carl H. Smith,et al.  Probability and Plurality for Aggregations of Learning Machines , 1988, Inf. Comput..

[2]  Frank Stephan,et al.  Trees and learning , 1996, COLT '96.

[3]  Carl H. Smith,et al.  The Power of Pluralism for Automatic Program Synthesis , 1982, JACM.

[4]  John Case,et al.  Learning Recursive Functions from Approximations , 1997, J. Comput. Syst. Sci..

[5]  Jerome A. Feldman,et al.  Some Decidability Results on Grammatical Inference and Complexity , 1972, Inf. Control..

[6]  Manuel Blum,et al.  Toward a Mathematical Theory of Inductive Inference , 1975, Inf. Control..

[7]  John Case,et al.  Robust learning aided by context , 1998, COLT' 98.

[8]  Leonard Pitt,et al.  Probabilistic inductive inference , 1989, JACM.

[9]  Mark A. Fulk Robust separations in inductive inference , 1990, Proceedings [1990] 31st Annual Symposium on Foundations of Computer Science.

[10]  Thomas Zeugmann,et al.  On Barzdin's Conjecture , 1986, AII.

[11]  Carl H. Smith,et al.  On the power of learning robustly , 1998, COLT' 98.

[12]  Karlis Podnieks Comparing various concepts of function prediction. Part 1. , 1974 .

[13]  John Case,et al.  Comparison of Identification Criteria for Machine Inductive Inference , 1983, Theor. Comput. Sci..

[14]  Eliana Minicozzi,et al.  Some Natural Properties of Strong-Identification in Inductive Inference , 1976, Theor. Comput. Sci..

[15]  P. Odifreddi Classical recursion theory , 1989 .

[16]  Daniel N. Osherson,et al.  Systems That Learn: An Introduction to Learning Theory for Cognitive and Computer Scientists , 1990 .