The role of salience in the extraction of algebraic rules.

Recent research suggests that humans and other animals have sophisticated abilities to extract both statistical dependencies and rule-based regularities from sequences. Most of this research stresses the flexibility and generality of such processes. Here the authors take up an equally important project, namely, to explore the limits of such processes. As a case study for rule-based generalizations, the authors demonstrate that only repetition-based structures with repetitions at the edges of sequences (e.g., ABCDEFF but not ABCDDEF) can be reliably generalized, although token repetitions can easily be discriminated at both sequence edges and middles. This finding suggests limits on rule-based sequence learning and new interpretations of earlier work alleging rule learning in infants. Rather than implementing a computerlike, formal process that operates over all patterns equally well, rule-based learning may be a highly constrained and piecemeal process driven by perceptual primitives--specialized type operations that are highly sensitive to perceptual factors.

[1]  Mark S. Seidenberg,et al.  Language Acquisition and Use: Learning and Applying Probabilistic Constraints , 1997, Science.

[2]  G. Altmann Learning and development in neural networks – the importance of prior experience , 2002, Cognition.

[3]  Edward E. Smith,et al.  An Invitation to cognitive science , 1997 .

[4]  H. Ebbinghaus Memory A Contribution Toexperimental Psychology , 1913 .

[5]  R. Schvaneveldt,et al.  The basis of transfer in artificial grammar learning , 2000, Memory & cognition.

[6]  E. Newport,et al.  WORD SEGMENTATION : THE ROLE OF DISTRIBUTIONAL CUES , 1996 .

[7]  Noam Chomsky,et al.  Rules and Representations , 1982 .

[8]  Colin Blakemore,et al.  Vision: Coding and Efficiency , 1991 .

[9]  L. Leonard,et al.  Some differences between English plural noun inflections and third singular verb inflections in the input: the contributions of frequency, sentence position, and duration , 1999, Journal of Child Language.

[10]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[11]  John R. Anderson,et al.  A Theory of the Origins of Human Knowledge , 1989, Artif. Intell..

[12]  Geoffrey E. Hinton,et al.  Parallel Models of Associative Memory , 1989 .

[13]  M. Hauser,et al.  Segmentation of the speech stream in a non-human primate: statistical learning in cotton-top tamarins , 2001, Cognition.

[14]  S. Gillis,et al.  Root infinitives in Dutch early child language: an effect of input? , 2001, Journal of Child Language.

[15]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[16]  James L. Morgan,et al.  Signal to syntax : bootstrapping from speech to grammar in early acquisition , 1996 .

[17]  E Bizzi,et al.  Motor learning through the combination of primitives. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[18]  Alan S. Prince,et al.  Generalized alignment , 1993 .

[19]  V. Ramachandran Vision: Interactions between motion, depth, color and form: the utilitarian theory of perception , 1991 .

[20]  E. Bizzi,et al.  The Cognitive Neurosciences , 1996 .

[21]  Mark S. Seidenberg,et al.  Impairments in verb morphology after brain injury: a connectionist model. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Elizabeth K. Johnson,et al.  Statistical learning of tone sequences by human infants and adults , 1999, Cognition.

[23]  Gary F. Marcus,et al.  Reply to Christiansen and Curtin , 1999, Trends in Cognitive Sciences.

[24]  C. Gallistel,et al.  Time, rate, and conditioning. , 2000, Psychological review.

[25]  Thomas R. Shultz,et al.  Neural Network Simulation of Infant Familiarization to Artificial Sentences: Rule-Like Behavior Without Explicit Rules and Variables. , 2001, Infancy : the official journal of the International Society on Infant Studies.

[26]  John J. McCarthy,et al.  Formal Problems in Semitic Phonology and Morphology , 2018 .

[27]  F. Ramus,et al.  Language discrimination by human newborns and by cotton-top tamarin monkeys. , 2000, Science.

[28]  R. Aslin,et al.  Unsupervised Statistical Learning of Higher-Order Spatial Structures from Visual Scenes , 2001, Psychological science.

[29]  Zenon W. Pylyshyn,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[30]  Alex M. Andrew,et al.  Computation and Cognition: Towards A Foundation for Cognitive Science, by Zenon W. Pylyshyn, MIT Press, Cambridge, Mass., xxiii + 292 pp., £26.15 , 1985, Robotica.

[31]  Thierry Dutoit,et al.  The MBROLA project: towards a set of high quality speech synthesizers free of use for non commercial purposes , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[32]  Marina Nespor,et al.  Signal-Driven Computations in Speech Processing , 2002, Science.

[33]  G. Marcus The Algebraic Mind: Integrating Connectionism and Cognitive Science , 2001 .

[34]  Kenneth Aizawa,et al.  Jeffrey L. Elman, Elizabeth A. Bates, Mark H. Johnson, Annette Karmiloff-Smith, Domenico Parisi, and Kim Plunkett, (eds.), Rethinking Innateness: A Connectionist Perspective on Development, Neural Network Modeling and Connectionism Series and Kim Plunkett and Jeffrey L. Elman, Exercises in Rethinkin , 1999, Minds and Machines.

[35]  G. Marcus Rethinking Eliminative Connectionism , 1998, Cognitive Psychology.

[36]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[37]  D. Plaut,et al.  Does generalization in infant learning implicate abstract algebra-like rules? , 1999, Trends in Cognitive Sciences.

[38]  S. Pinker,et al.  On language and connectionism: Analysis of a parallel distributed processing model of language acquisition , 1988, Cognition.

[39]  H. Gleitman,et al.  Mother, Id rather do it myself: Some effects and non-effects of maternal speech style , 1977 .

[40]  Allen Newell,et al.  Computer science as empirical inquiry: symbols and search , 1976, CACM.

[41]  P R Killeen,et al.  Japanese quail can learn phonetic categories. , 1987, Science.

[42]  John P. Pinto,et al.  Rapid Gains in Speed of Verbal Processing by Infants in the 2nd Year , 1998 .

[43]  Allen Newell,et al.  Physical Symbol Systems , 1980, Cogn. Sci..

[44]  Richard N Aslin,et al.  Statistical learning of new visual feature combinations by infants , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[45]  N. Chater,et al.  Proceedings of the fourteenth annual conference of the cognitive science society , 1992 .

[46]  M. Raijmakers Rethinking innateness: A connectionist perspective on development. , 1997 .

[47]  M. Gasser,et al.  Babies, Variables, and Relational Correlations , 2000 .

[48]  E. Newport,et al.  Computation of Conditional Probability Statistics by 8-Month-Old Infants , 1998 .

[49]  Z. Dienes,et al.  Rule learning by seven-month-old infants and neural networks , 1999 .

[50]  J. Fodor The Modularity of mind. An essay on faculty psychology , 1986 .

[51]  Geert Booij,et al.  Yearbook of Morphology 1993 , 1993 .

[52]  J. Elman,et al.  Learning Rediscovered , 1996, Science.

[53]  E. Bizzi,et al.  Linear combinations of primitives in vertebrate motor control. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[54]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[55]  Morten H. Christiansen,et al.  Transfer of learning: rule acquisition or statistical learning? , 1999, Trends in Cognitive Sciences.

[56]  Gary F. Marcus,et al.  Reply to Seidenberg and Elman , 1999, Trends in Cognitive Sciences.

[57]  James L. McClelland,et al.  Connectionism : with or without rules ? Response to , 2022 .

[58]  N. Hogan,et al.  Quantization of continuous arm movements in humans with brain injury. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[59]  Peter M. Vishton,et al.  Rule learning by seven-month-old infants. , 1999, Science.

[60]  Maja J. Mataric,et al.  Automated Derivation of Primitives for Movement Classification , 2000, Auton. Robots.

[61]  R. Gómez,et al.  Artificial grammar learning by 1-year-olds leads to specific and abstract knowledge , 1999, Cognition.

[62]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[63]  M. Hauser,et al.  Learning at a distance II. Statistical learning of non-adjacent dependencies in a non-human primate , 2004, Cognitive Psychology.

[64]  Janet B. Pierrehumbert,et al.  Similarity Avoidance and the OCP , 2004 .

[65]  C. Gallistel The organization of learning , 1990 .

[66]  K. Nelson,et al.  Mothers' speech to children and syntactic development: some simple relationships , 1979, Journal of Child Language.

[67]  C. Gallistel The Replacement of General-Purpose Learning Models with Adaptively Specialized Learning Modules , 2000 .

[68]  D. Ingram,et al.  Early syntactic acquisition in German: Evidence for the modal hypothesis , 1996 .

[69]  H. Gleitman,et al.  The current status of the motherese hypothesis , 1984, Journal of Child Language.

[70]  J. Elman,et al.  Networks are not ‘hidden rules’ , 1999, Trends in Cognitive Sciences.

[71]  Laurie Hendren,et al.  The abc Group , 2004 .

[72]  Ghislaine Dehaene-Lambertz,et al.  Perceptual constraints and the learnability of simple grammars , 2007, Cognition.

[73]  Charles D. Yang Universal Grammar, statistics or both? , 2004, Trends in Cognitive Sciences.

[74]  E. Newport,et al.  Learning at a distance I. Statistical learning of non-adjacent dependencies , 2004, Cognitive Psychology.

[75]  G. Marcus Can connectionism save constructivism? , 1998, Cognition.

[76]  R. Gómez,et al.  Infant artificial language learning and language acquisition , 2000, Trends in Cognitive Sciences.

[77]  R. Tunney,et al.  Two modes of transfer in artificial grammar learning. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[78]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[79]  R J Gillies,et al.  Angiostatin's partners. , 1999, Science.

[80]  A. Lotto,et al.  Perceptual compensation for coarticulation by Japanese quail (Coturnix coturnix japonica). , 1997, The Journal of the Acoustical Society of America.

[81]  C. Gallistel,et al.  The Symbolic Foundations of Conditioned Behavior , 2002 .

[82]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[83]  CYRIL BURT A Theory of Human Knowledge , 1970, Nature.

[84]  R N Aslin,et al.  Statistical Learning by 8-Month-Old Infants , 1996, Science.

[85]  Padraic Monaghan,et al.  Proceedings of the 23rd annual conference of the cognitive science society , 2001 .

[86]  Jill Fain Lehman,et al.  A Gentle Introduction to Soar, an Architecture for Human Cognition. , 1996 .

[87]  Morten H. Christiansen,et al.  A Connectionist Single-Mechanism Account of Rule-Like Behavior in Infancy , 2000 .

[88]  Gary F. Marcus,et al.  Rule Learning by Seven-Month-Old Infants and Neural Networks , 1999, Science.