Rule learning by Habituation can be Simulated in Neural Networks

Contrary to a recent claim that neural network models are unable to account for data on infant habituation to artificial language sentences, the present simulations show successful coverage with cascade-correlation networks using analog encoding. The results demonstrate that a symbolic rule-based account is not required by the infant data. One of the fundamental issues of cognitive science continues to revolve around which type of theoretical model better accounts for human cognition -- a symbolic rulebased account or a sub-symbolic neural network account. A recent study of infant habituation to expressions in an artificial language claims to have struck a damaging blow to the neural network approach (Marcus, Vijayan, Rao, & Vishton, 1999). The results of their study show that 7month-old infants attend longer to sentences with unfamiliar structures than to sentences with familiar structures. Because of certain features of their experimental design and their own unsuccessful neural network models, Marcus et al. conclude that neural networks cannot simulate these results and that infants possess a rule -learning capability unavailable to neural networks. A companion article suggests that rule learning is an innately provided capacity of the human mind, distinct from associative learning mechanisms like those in neural networks (Pinker, 1999). My paper presents neural network simulations of the key features of the Marcus et al. (1999) experiment, thus showing that their infant data do not uniquely support a rule-based account.

[1]  C. Gallistel,et al.  The Child's Understanding of Number , 1979 .

[2]  L. Cohen,et al.  Infant perception of a causal event , 1990 .

[3]  Leslie B. Cohen,et al.  A Two Process Model of Infant Visual Attention. , 1972 .

[4]  Thomas R. Shultz,et al.  Computational power and realistic cognitive development , 1996 .

[5]  Marshall M. Haith,et al.  Progress in the Understanding of Sensory and Perceptual Processes in Early Infancy. , 1990 .

[6]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[7]  A. Slater,et al.  Visual perception and memory at birth , 1995 .

[8]  Thomas R. Shultz,et al.  Modeling cognitive development on balance scale phenomena , 1994, Machine Learning.

[9]  T. Shultz,et al.  Neural network modeling of developmental effects in discrimination shifts. , 1998, Journal of experimental child psychology.

[10]  Thomas R. Shultz,et al.  A computational analysis of conservation. , 1998 .

[11]  Thomas R. Shultz,et al.  Analysis of Unstandardized Contributions in Cross Connected Networks , 1994, NIPS.

[12]  Peter M. Vishton,et al.  Rule learning by seven-month-old infants. , 1999, Science.

[13]  David H. Sharp,et al.  A connectionist model of development. , 1991, Journal of theoretical biology.

[14]  T. Sejnowski,et al.  Irresistible environment meets immovable neurons , 1997, Behavioral and Brain Sciences.

[15]  David Buckingham,et al.  A connectionist model of the development of velocity, time, and distance concepts , 1994 .

[16]  E. N. Solokov Perception and the conditioned reflex , 1963 .

[17]  John Heil,et al.  Perception and cognition , 1983 .

[18]  Leslie B. Cohen Our developing knowledge of infant perception and cognition. , 1979 .

[19]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[20]  Thomas Jackson,et al.  Data Input and Output Representations , 1996 .

[21]  Antal van den Bosch,et al.  A Connectionist Model for Bootstrap Learning of Syllabic Structure. , 1998 .

[22]  Thomas R. Shultz,et al.  Development of Children's Seriation: A Connectionist Approach , 1999, Connect. Sci..

[23]  P. D. Eimas,et al.  Evidence for Representations of Perceptually Similar Natural Categories by 3-Month-Old and 4-Month-Old Infants , 1993, Perception.

[24]  Robert M. French,et al.  A Connectionist Account of Interference Effects in Early Infant Memory and Categorization , 1997 .

[25]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[26]  S Pinker,et al.  Out of the Minds of Babes , 1999, Science.

[27]  T.R. Shultz,et al.  Network analyses: the case of first and second person pronouns , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[28]  C. Gallistel,et al.  Preverbal and verbal counting and computation , 1992, Cognition.