Learning with a Limited Memory

I. Informal Problem Statement and Prior Results The invention of the formal study of inductive inference was a direct consequence of efforts to moclel human learning [Go167a, Sch63a]. Much of the early work in inductive inference [Ang83a, Kle80a, Osh86a] and the more recent work [Hau88a, RivS9a, Ful90a, Nat91a, War91a, Da192a] has been motivated by trying to model or understand some aspect of human learning in the hopes that the knowledge gained may be useful in the effort to program a computer to learn. For example, one of the intuitions behind Valiant’s PAC model [Val84a] was that humans learn quickly. This paper is motivated by the intuition that people forget. By way of a practical consideration, if a learning algorithm

[1]  Manuel Blum,et al.  Toward a Mathematical Theory of Inductive Inference , 1975, Inf. Control..

[2]  Carl H. Smith,et al.  Memory Limited Inductive Inference Machines , 1992, SWAT.

[3]  David Haussler,et al.  Proceedings of the fifth annual workshop on Computational learning theory , 1992, COLT 1992.

[4]  Tetsuhiro Miyahara,et al.  A note on iteratively working strategies in inductive inference , 1990 .

[5]  Rolf Wiehagen,et al.  Research in the theory of inductive inference by GDR mathematicians - A survey , 1980, Inf. Sci..

[6]  Translator-IEEE Expert staff.  Machine Learning: A Theoretical Approach , 1992, IEEE Expert.

[7]  Leslie G. Valiant,et al.  A theory of the learnable , 1984, STOC '84.

[8]  Rolf Wiehagen.  Limes-Erkennung rekursiver Funktionen durch spezielle Strategien , 1975, J. Inf. Process. Cybern..

[9]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[10]  David Haussler,et al.  Proceedings of the 1988 Workshop on Computational Learning Theory : MIT, August 3-5, 1988 , 1989 .

[11]  Kenneth Wexler,et al.  Formal Principles of Language Acquisition , 1980 .

[12]  Carl H. Smith,et al.  Inductive Inference: Theory and Methods , 1983, CSUR.

[13]  T. Miyahara.  INDUCTIVE INFERNCE BY ITERATIVELY WORKING AND CONSISTENT STRATEGIES WITH ANOMALIES , 1987 .

[14]  Simon Kasif,et al.  Learning Nested Concept Classes with Limited Storage , 1991, IJCAI.

[15]  John Case,et al.  Proceedings of the Third Annual Workshop on Computational Learning Theory : University of Rochester, Rochester, New York, August 6-8, 1990 , 1990 .