Neural Network Simulation of Infant Familiarization to Artificial Sentences: Rule-Like Behavior Without Explicit Rules and Variables.

A fundamental issue in cognitive science is whether human cognitive processing is better explained by symbolic rules or by subsymbolic neural networks. A recent study of infant familiarization to sentences in an artificial language seems to have produced data that can only be explained by symbolic rule learning and not by unstructured neural networks (Marcus, Vijayan, Bandi Rao, & Vishton, 1999). Here we present successful unstructured neural network simulations of the infant data, showing that these data do not uniquely support a rule-based account. In contrast to other simulations of these data, these simulations cover more aspects of the data with fewer assumptions about prior knowledge and training, using a more realistic coding scheme based on sonority of phonemes. The networks show exponential decreases in attention to a repeated sentence pattern, more recovery to novel sentences inconsistent with the familiar pattern than to novel sentences consistent with the familiar pattern, occasional familiarity preferences, more recovery to consistent novel sentences than to familiarized sentences, and extrapolative generalization outside the range of the training patterns. A variety of predictions suggest the utility of the model in guiding future psychological work. The evidence, from these and other simulations, supports the view that unstructured neural networks can account for the existing infant data.

[1]  Geoffrey E. Hinton,et al.  Schemata and Sequential Thought Processes in PDP Models , 1986 .

[2]  A. Newell Unified Theories of Cognition , 1990 .

[3]  R. Gómez,et al.  Artificial grammar learning by 1-year-olds leads to specific and abstract knowledge , 1999, Cognition.

[4]  T. Shultz,et al.  Cognitive dissonance reduction as constraint satisfaction. , 1996, Psychological review.

[5]  Keith J. Holyoak,et al.  A Coherence Model of Cognitive Consistency: Dynamics of Attitude Change During the Persian Gulf War , 1993 .

[6]  J. Brehm Postdecision changes in the desirability of alternatives. , 1956, Journal of abnormal psychology.

[7]  S Pinker,et al.  Out of the Minds of Babes , 1999, Science.

[8]  James W. Harris,et al.  Syllable Structure and Stress in Spanish: A Nonlinear Analysis , 1982 .

[9]  E. N. Sokolov,et al.  Perception and the Conditioned Reflex , 1965 .

[10]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[11]  Thomas R. Shultz,et al.  A Constraint-Satisfaction Model of Machiavellianism Effects in Cognitive Dissonance , 2000 .

[12]  L. Cohen,et al.  Infant perception of a causal event , 1990 .

[13]  Thomas R. Shultz,et al.  Artificial grammer learning by infants: an auto‐associator perspective , 2000 .

[14]  Michael Tomasello,et al.  Social and object support for early symbolic play , 2001 .

[15]  Eric R. Kandel,et al.  Recruitment of New Sites of Synaptic Transmission During the cAMP-Dependent Late Phase of LTP at CA3–CA1 Synapses in the Hippocampus , 1997, Neuron.

[16]  Thomas R. Shultz,et al.  Rule learning by Habituation can be Simulated in Neural Networks , 2020, Proceedings of the Twenty First Annual Conference of the Cognitive Science Society.

[17]  Leslie B. Cohen,et al.  A Two Process Model of Infant Visual Attention. , 1972 .

[18]  D. Plaut,et al.  Does generalization in infant learning implicate abstract algebra-like rules? , 1999, Trends in Cognitive Sciences.

[19]  Thomas R. Shultz,et al.  Free Choice and Cognitive Dissonance Revisited: Choosing “Lesser Evils” Versus “Greater Goods” , 1999 .

[20]  G. Clements Papers in Laboratory Phonology: The role of the sonority cycle in core syllabification , 1990 .

[21]  F. Gage,et al.  More hippocampal neurons in adult mice living in an enriched environment , 1997, Nature.

[22]  J Cooper,et al.  Arousal as a necessary condition for attitude change following induced compliance. , 1978, Journal of personality and social psychology.

[23]  Antal van den Bosch,et al.  A Connectionist Model for Bootstrap Learning of Syllabic Structure. , 1998 .

[24]  T. Shultz,et al.  The learning of first and second person pronouns in English: network models and analysis , 1999, Journal of Child Language.

[25]  Marshall M. Haith,et al.  Progress in the Understanding of Sensory and Perceptual Processes in Early Infancy. , 1990 .

[26]  Thomas R. Shultz,et al.  Computer simulation of cognitive dissonance reduction. , 1999 .

[27]  Elliot Aronson,et al.  Taking a Closer Look: Reasserting the Role of the Self-Concept in Dissonance Theory , 1992 .

[28]  J. Shinskey,et al.  Interpreting infant looking: the event set x event set design. , 1997, Developmental psychology.

[29]  E. W. Ames,et al.  A multifactor model of infant preferences for novel and familiar stimuli. , 1988 .

[30]  P. Thagard,et al.  Explanatory coherence , 1993 .

[31]  Peter M. Vishton,et al.  Rule learning by seven-month-old infants. , 1999, Science.

[32]  Z. Dienes,et al.  Rule learning by seven-month-old infants and neural networks , 1999 .

[33]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[34]  L. Shastri Infants Learning Algebraic Rules , 1999, Science.

[35]  F. Gage,et al.  Neurogenesis in the adult human hippocampus , 1998, Nature Medicine.

[36]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[37]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[38]  Thomas R. Shultz,et al.  Development of Children's Seriation: A Connectionist Approach , 1999, Connect. Sci..

[39]  T. Shultz,et al.  The Developmental Course of Distance, Time, and Velocity Concepts:A Generative Connectionist Model , 2000 .

[40]  Linda Simon,et al.  Trivialization: the forgotten mode of dissonance reduction. , 1995 .

[41]  V. Marchman,et al.  Learning from a connectionist model of the acquisition of the English past tense , 1996, Cognition.

[42]  M. Haith Who put the cog in infant cognition ? Is rich interpretation too costly ? , 1998 .

[43]  Paul Thagard,et al.  Analogical Mapping by Constraint Satisfaction , 1989, Cogn. Sci..

[44]  P. Price,et al.  Sonority and Syllabicity: Acoustic Correlates of Perception , 1980, Phonetica.

[45]  T. Shultz,et al.  Neural network modeling of developmental effects in discrimination shifts. , 1998, Journal of experimental child psychology.

[46]  C. Steele The Psychology of Self-Affirmation: Sustaining the Integrity of the Self , 1988 .

[47]  Leslie B. Cohen Our developing knowledge of infant perception and cognition. , 1979 .

[48]  Dennis Sanger,et al.  Contribution analysis: a technique for assigning responsibilities to hidden units in connectionist networks , 1991 .

[49]  Mark S. Seidenberg Do Infants Learn Grammar with Algebra or Statistics? , 1999, Science.

[50]  Thomas R. Shultz,et al.  A computational analysis of conservation. , 1998 .

[51]  Ralph Penny,et al.  Syllable Structure and Stress in Spanish: A Non-Linear Analysis , 1985 .

[52]  Thomas R. Shultz,et al.  Analysis of Unstandardized Contributions in Cross Connected Networks , 1994, NIPS.

[53]  P. Smolensky On the proper treatment of connectionism , 1988, Behavioral and Brain Sciences.

[54]  Robert M. French,et al.  A Connectionist Account of Interference Effects in Early Infant Memory and Categorization , 1997 .

[55]  Stephen J. Read,et al.  On the dynamic construction of meaning: An interactive activation and competition model of social perception. , 1998 .

[56]  S. Pinker How the Mind Works , 1999, Annals of the New York Academy of Sciences.

[57]  M. Gasser,et al.  Babies, Variables, and Connectionist Networks , 2020, Proceedings of the Twenty First Annual Conference of the Cognitive Science Society.

[58]  V. Marchman,et al.  From rote learning to system building: acquiring verb morphology in children and connectionist nets , 1993, Cognition.

[59]  T. Sejnowski,et al.  Irresistible environment meets immovable neurons , 1997, Behavioral and Brain Sciences.

[60]  W. Freeman Second Commentary: On the proper treatment of connectionism by Paul Smolensky (1988) - Neuromachismo Rekindled , 1989 .

[61]  Lokendra Shastri,et al.  A Spatiotemporal Connectionist Model of Algebraic Rule-learning , 1999 .

[62]  E. Gould,et al.  Neurogenesis in adulthood: a possible role in learning , 1999, Trends in Cognitive Sciences.

[63]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[64]  G. Marcus Rethinking Eliminative Connectionism , 1998, Cognitive Psychology.