Non-U-shaped vacillatory and team learning

U-shaped learning behaviour in cognitive development involves learning, unlearning and relearning. It occurs, for example, in learning irregular verbs. The prior cognitive science literature is occupied with how humans do it, for example, general rules versus tables of exceptions. This paper is mostly concerned with whether U-shaped learning behaviour may be necessary in the abstract mathematical setting of inductive inference, that is, in the computational learning theory following the framework of Gold. All notions considered are learning from text, that is, from positive data. Previous work showed that U-shaped learning behaviour is necessary for behaviourally correct learning but not for syntactically convergent, learning in the limit (= explanatory learning). The present paper establishes the necessity for the hierarchy of classes of vacillatory learning where a behaviourally correct learner has to satisfy the additional constraint that it vacillates in the limit between at most b grammars, where [email protected]?{2,3,...,*}. Non-U-shaped vacillatory learning is shown to be restrictive: every non-U-shaped vacillatorily learnable class is already learnable in the limit. Furthermore, if vacillatory learning with the parameter b=2 is possible then non-U-shaped behaviourally correct learning is also possible. But for b=3, surprisingly, there is a class witnessing that this implication fails.

[1]  Werner Stein Consistent Polynominal Identification in the Limit , 1998, ALT.

[2]  S. Pinker Formal models of language learning , 1979, Cognition.

[3]  K. Wexler On extensional learnability , 1982, Cognition.

[4]  Jay Lash,et al.  Concepts of development , 1974 .

[5]  M. Bowerman Starting to talk worse: Clues to language acquisition from children's late speech errors , 1982 .

[6]  Jr. Hartley Rogers Theory of Recursive Functions and Effective Computability , 1969 .

[7]  Carl H. Smith,et al.  The Power of Pluralism for Automatic Program Synthesis , 1982, JACM.

[8]  Susan Carey,et al.  7 – Face Perception: Anomalies of Development1 , 1982 .

[9]  Carl H. Smith,et al.  On the Role of Procrastination in Machine Learning , 1993, Inf. Comput..

[10]  John Case,et al.  When unlearning helps , 2008, Inf. Comput..

[11]  Frank Stephan,et al.  Language Learning from Texts: Mind Changes, Limited Memory and Monotonicity (Extended Abstract). , 1995, COLT 1995.

[12]  Thomas Zeugmann,et al.  Monotonic Versus Nonmonotonic Language Learning , 1991, Nonmonotonic and Inductive Logic.

[13]  V. Marchman,et al.  U-shaped learning and frequency effects in a multi-layered perception: Implications for child language acquisition , 1991, Cognition.

[14]  Manuel Blum,et al.  Toward a Mathematical Theory of Inductive Inference , 1975, Inf. Control..

[15]  Carl H. Smith,et al.  Three Decades of Team Learning , 1994, AII/ALT.

[16]  John R. Anderson,et al.  Why do children learn to say “Broke”? A model of learning the past tense without feedback , 2002, Cognition.

[17]  John Case,et al.  Machine Inductive Inference and Language Identification , 1982, ICALP.

[18]  John Case,et al.  Incremental Concept Learning for Bounded Data Mining , 1997, Inf. Comput..

[19]  Manuel Blum,et al.  A Machine-Independent Theory of the Complexity of Recursive Functions , 1967, JACM.

[20]  S Pinker,et al.  Overregularization in language acquisition. , 1992, Monographs of the Society for Research in Child Development.

[21]  D. Osherson,et al.  A note on formal learning theory , 1982, Cognition.

[22]  Dana Angluin,et al.  Inductive Inference of Formal Languages from Positive Data , 1980, Inf. Control..

[23]  Kenneth C. Hill,et al.  The genesis of language , 1982 .

[24]  Daniel N. Osherson,et al.  Criteria of Language Learning , 1982, Inf. Control..

[25]  Mark A. Fulk Prudence and Other Conditions on Formal Language Learning , 1990, Inf. Comput..

[26]  Arun Sharma,et al.  Generalization and specialization strategies for learning r.e. languages , 2004, Annals of Mathematics and Artificial Intelligence.

[27]  Rusins Freivalds,et al.  On the Power of Inductive Inference from Good Examples , 1993, Theor. Comput. Sci..

[28]  Carl H. Smith,et al.  On the role of procrastination for machine learning , 1992, COLT '92.

[29]  Steven Davis,et al.  Connectionism: theory and practice , 1992 .

[30]  Rolf Wiehagen,et al.  Characterization Problems in the Theory of Inductive Inference , 1978, ICALP.

[31]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[32]  Gisela Schäfer-Richter,et al.  Über Eingabeabhängigkeit und Komplexität von Inferenzstrategien , 1984 .

[33]  John Case,et al.  Comparison of Identification Criteria for Machine Inductive Inference , 1983, Theor. Comput. Sci..

[34]  William I. Gasarch,et al.  Learning via queries , 1992, COLT '88.

[35]  P. Odifreddi Classical recursion theory , 1989 .

[36]  Michael Stob,et al.  An analysis of a learning paradigm , 1986 .

[37]  John Case,et al.  Language Learning with Some Negative Information , 1993, Journal of computer and system sciences (Print).

[38]  Rolf Wiehagen,et al.  Ignoring data may be the only way to learn efficiently , 1994, J. Exp. Theor. Artif. Intell..

[39]  Kenneth Wexler,et al.  Formal Principles of Language Acquisition , 1980 .

[40]  John Case,et al.  Complexity Issues for Vacillatory Function Identification , 1995, Inf. Comput..

[41]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[42]  Frank Stephan,et al.  Language Learning from Texts: Mindchanges, Limited Memory, and Monotonicity , 1995, Inf. Comput..

[43]  Sanjay Jain,et al.  Open Problems in "Systems That Learn" , 1994, J. Comput. Syst. Sci..

[44]  Christophe Costa Florêncio Consistent identification in the limit of some of Penn and Buszkowski's classes is NP-hard , 1999, CLIN.

[45]  David Kirsh,et al.  PDP Learnability and Innate Knowledge of Language , 1992 .

[46]  Sanjay Jain Incremental Concept Learning for Bounded Data Mining Incremental Concept Learning for Bounded Data Mining , 1997 .

[47]  John Case,et al.  The Power of Vacillation in Language Learning , 1999, SIAM J. Comput..

[48]  Daniel N. Osherson,et al.  Systems That Learn: An Introduction to Learning Theory for Cognitive and Computer Scientists , 1990 .

[49]  R. Stavy,et al.  U-shaped behavioral growth , 1982 .