A Multimodal Model of Child Language Acquisition at the One-Word Stage

We present a multimodal neural network model of child language acquisition at the one-word stage that is inspired by current views on brain processing which suggest that information in the brain is ultimately stored in a common amodal set of conceptual representations. Our model takes into account a child's perceived communicative intention and simulates both ostensive and non-ostensive utterances using the same unsupervised network. This is contrary to some models of child language acquisition, and in line with current psycholinguistic views on child language processing at the one-word stage. When trained on natural child language data, our model learns to categorise the speech utterances and to generalise to new utterances. In addition, our model exhibits a U-shaped learning trajectory as well as a vocabulary spurt, in agreement with observations made in studies of child language acquisition at the one-word stage.

[1]  E. Warrington,et al.  Visual associative agnosia: a clinico-anatomical study of a single case. , 1986, Journal of neurology, neurosurgery, and psychiatry.

[2]  Ping Li,et al.  Early lexical development in a self-organizing neural network , 2004, Neural Networks.

[3]  T. Shallice Specialisation within the semantic system , 1988 .

[4]  Kim Plunkett,et al.  Theories of early language acquisition , 1997, Trends in Cognitive Sciences.

[5]  Alfonso Caramazza,et al.  The multiple semantics hypothesis: Multiple confusions? , 1990 .

[6]  J. Elman Connectionist models of cognitive development: where next? , 2005, Trends in Cognitive Sciences.

[7]  James L. McClelland,et al.  U-Shaped Curves in Development: A PDP Approach , 2004, Journal of Cognition and Development.

[8]  James L. McClelland,et al.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition : Psychological and Biological Models , 1986 .

[9]  P. Ladefoged A course in phonetics , 1975 .

[10]  Ping Li,et al.  PatPho: A phonological pattern generator for neural networks , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[11]  L. Bloom The Transition from Infancy to Language: FROM 9 MONTHS TO 2 YEARS , 1993 .

[12]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[13]  R. Hecht-Nielsen Counterpropagation networks. , 1987, Applied optics.

[14]  L. Tyler,et al.  Unitary vs multiple semantics: PET studies of word and picture processing , 2004, Brain and Language.

[15]  Syed Sibte Raza Abidi,et al.  Conglomerate'Neural Network Architectures: The Way Ahead for Simulating Early Language Development , 1997, J. Inf. Sci. Eng..

[16]  J. Hodges,et al.  Is a Picture Worth a Thousand Words? Evidence from Concept Definitions by Patients with Semantic Dementia , 1999, Brain and Language.

[17]  B. MacWhinney The CHILDES project: tools for analyzing talk , 1992 .

[18]  Richard S. J. Frackowiak,et al.  Functional anatomy of a common semantic system for words and pictures , 1996, Nature.

[19]  E. Warrington Quarterly Journal of Experimental Psychology the Selective Impairment of Semantic Memory the Selective Impairment of Semantic Memory , 2022 .

[20]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[21]  F. Attneave,et al.  The Organization of Behavior: A Neuropsychological Theory , 1949 .

[22]  E. Warrington,et al.  Evidence for modality-specific meaning systems in the brain , 1988, Nature.

[23]  Tim Shallice,et al.  Multiple semantics: whose confusions? , 1993 .

[24]  Lois Bloom,et al.  One Word at a Time: The Use of Single Word Utterances Before Syntax , 1976 .

[25]  Catherine E. Snow,et al.  Language acquisition through language use: The functional sources of children's early utterances. , 1988 .

[26]  Lois Bloom,et al.  Language and Interaction. (Book Reviews: The Transition from Infancy to Language. Acquiring the Power of Expression.) , 1995 .

[27]  Rosaleen A. McCarthy,et al.  Multiple meaning systems in the brain: A case for visual semantics , 1994, Neuropsychologia.

[28]  Sidney S. Simon,et al.  Merging of the Senses , 2008, Front. Neurosci..

[29]  S. Grossberg Some Networks That Can Learn, Remember, and Reproduce any Number of Complicated Space-Time Patterns, I , 1969 .

[30]  Abel Nyamapfene,et al.  Unsupervised multimodal neural networks , 2006 .

[31]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[32]  J. Siskind A computational study of cross-situational techniques for learning word-to-meaning mappings , 1996, Cognition.

[33]  J. Nazuno Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .

[34]  R. Miikkulainen Dyslexic and Category-Specific Aphasic Impairments in a Self-Organizing Feature Map Model of the Lexicon , 1997, Brain and Language.

[35]  Chris Sinha,et al.  Symbol Grounding or the Emergence of Symbols? Vocabulary Growth in Children and a Connectionist Net , 1992 .

[36]  David A. Medler A Brief History of Connectionism , 1998 .

[37]  W. H. Sumby,et al.  Visual contribution to speech intelligibility in noise , 1954 .

[38]  Ping Li Language Acquisition in a Self-Organising Neural Network Model , 2004 .

[39]  Kim Plunkett,et al.  Language Acquisition and Connectionism. , 1998 .

[40]  Brian MacWhinney,et al.  The CHILDES Project: Tools for Analyzing Talk (third edition): Volume I: Transcription format and programs, Volume II: The database , 2000, Computational Linguistics.

[41]  B. MacWhinney Models of the emergence of language. , 1998, Annual review of psychology.