Self-organizing map models of language acquisition

Connectionist models have had a profound impact on theories of language. While most early models were inspired by the classic parallel distributed processing architecture, recent models of language have explored various other types of models, including self-organizing models for language acquisition. In this paper, we aim at providing a review of the latter type of models, and highlight a number of simulation experiments that we have conducted based on these models. We show that self-organizing connectionist models can provide significant insights into long-standing debates in both monolingual and bilingual language development. We suggest future directions in which these models can be extended, to better connect with behavioral and neural data, and to make clear predictions in testing relevant psycholinguistic theories.

[1]  J. Altarriba,et al.  A Self-Organizing Connectionist Model of Bilingual Processing , 2001 .

[2]  Ping Li,et al.  PatPho: A phonological pattern generator for neural networks , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[3]  H. Benedict,et al.  Early lexical development: comprehension and production , 1979, Journal of Child Language.

[4]  J. Altarriba,et al.  Differences in semantic and translation priming across languages: The role of language direction and language dominance , 2007, Memory & cognition.

[5]  Ping Li,et al.  Simulating cross-language priming with a dynamic computational model of the lexicon* , 2012, Bilingualism: Language and Cognition.

[6]  Ping Li Language Acquisition in a Self-Organising Neural Network Model , 2004 .

[7]  Ping Li Computational Modeling of Bilingualism , 2006 .

[8]  J. H. Neely,et al.  Dissociative episodic and semantic priming effects in episodic recognition and lexical decision tasks , 1985 .

[9]  Ping Li,et al.  Dynamic Self-Organization and Early Lexical Development in Children , 2007, Cogn. Sci..

[10]  白井 恭弘,et al.  Primacy of aspect in language acquisition : simplified input and prototype /[by] Shirai, Yasuhiro , 1991 .

[11]  DeLiang Wang,et al.  Unsupervised Learning: Foundations of Neural Computation , 2001, AI Mag..

[12]  Jeffrey S Bowers,et al.  Challenging the widespread assumption that connectionism and distributed representations go hand-in-hand , 2002, Cognitive Psychology.

[13]  F. Guenther,et al.  The perceptual magnet effect as an emergent property of neural map formation. , 1996, The Journal of the Acoustical Society of America.

[14]  Risto Miikkulainen,et al.  SARDNET: A Self-Organizing Feature Map for Sequences , 1994, NIPS.

[15]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[16]  Risto Miikkulainen,et al.  Subsymbolic natural language processing - an integrated model of scripts, lexicon, and memory , 1993, Neural network modeling and connectionism.

[17]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[18]  Michael S. C. Thomas,et al.  Critical periods and catastrophic interference effects in the development of self-organizing feature maps. , 2008, Developmental science.

[19]  Susan H. Foster An introduction to child language development , 1999 .

[20]  Ellen M. Markman,et al.  Constraints on word meaning in early language acquisition , 1994 .

[21]  A. Pavlenko 6. Conceptual Representation in the Bilingual Lexicon and Second Language Vocabulary Learning , 2009 .

[22]  Jeff Siegel,et al.  On the language bioprogram hypothesis , 2006 .

[23]  J. S. Johnson,et al.  Critical period effects in second language learning: The influence of maturational state on the acquisition of English as a second language , 1989, Cognitive Psychology.

[24]  Stephen Grossberg,et al.  Adaptive pattern classification and universal recoding: II. Feedback, expectation, olfaction, illusions , 1976, Biological Cybernetics.

[25]  Brian MacWhinney,et al.  The logic of the unified model , 2011 .

[26]  Ping Li,et al.  Early lexical development in a self-organizing neural network , 2004, Neural Networks.

[27]  Robert M. French,et al.  Computational Modeling in Cognitive Science: A Manifesto for Change , 2012, Top. Cogn. Sci..

[28]  E. Dromi Early Lexical Development , 1987 .

[29]  P. Kuhl Human adults and human infants show a “perceptual magnet effect” for the prototypes of speech categories, monkeys do not , 1991, Perception & psychophysics.

[30]  Matthew. W. Spitzer,et al.  The Mind within the Net: Models of Learning, Thinking, and Acting , 1999 .

[31]  K. Plunkett,et al.  A neurocomputational account of taxonomic responding and fast mapping in early word learning. , 2010, Psychological review.

[32]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: part 1.: an account of basic findings , 1988 .

[33]  James L. McClelland The Place of Modeling in Cognitive Science , 2009, Top. Cogn. Sci..

[34]  J. Elman,et al.  Rethinking Innateness: A Connectionist Perspective on Development , 1996 .

[35]  M. Carreiras,et al.  Two Words, One Meaning: Evidence of Automatic Co-Activation of Translation Equivalents , 2011, Front. Psychology.

[36]  E. Bates,et al.  New Directions in Research on Language Development , 1993 .

[37]  Ping Li,et al.  A Self-Organizing Connectionist Model of Bilingual Lexical Development , 2006 .

[38]  B. MacWhinney The CHILDES project: tools for analyzing talk , 1992 .

[39]  Ping Li,et al.  Contextual self-organizing map: software for constructing semantic representations , 2011, Behavior research methods.

[40]  Risto Miikkulainen,et al.  Semantic Boost on Episodic Associations: An Empirically-Based Computational Model , 2007, Cogn. Sci..

[41]  Eve V. Clark,et al.  Comprehension, Production, and Language Acquisition , 1983 .

[42]  Ping Li,et al.  The Acquisition of Chinese Characters : Corpus Analyses and Connectionist Simulations , 2006 .

[43]  Ping Li,et al.  Acquisition of aspect in self-organizing connectionist models , 2009 .

[44]  Helen Goodluck,et al.  First language acquisition. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[45]  J. Fletcher,et al.  The changing nervous system : neurobehavioral consequences of early brain disorders , 1999 .

[46]  Susan H. Foster-Cohen An Introduction to Child Language Development , 1999 .

[47]  R. Miikkulainen,et al.  A computational account of bilingual aphasia rehabilitation* , 2012, Bilingualism: Language and Cognition.

[48]  Wolfgang Klein,et al.  Computational modeling of the expression of time , 2009 .

[49]  C. Mervis,et al.  Acquisition of the novel name--nameless category (N3C) principle. , 1994, Child development.

[50]  Elizabeth Bates,et al.  Plasticity, localization, and language development. , 2014 .

[51]  L. Petitto,et al.  Biological Foundations of Language , 1967, Neurology.

[52]  Colin J. Davis,et al.  The self-organising lexical acquisition and recognition (SOLAR) model of visual word recognition. , 2001 .

[53]  Brian Macwhinney,et al.  Computational models of child language learning: an introduction. , 2010, Journal of child language.

[54]  Peter Tiño,et al.  Dynamics and Topographic Organization of Recursive Self-Organizing Maps , 2006, Neural Computation.

[55]  R. French Catastrophic forgetting in connectionist networks , 1999, Trends in Cognitive Sciences.

[56]  Ping Li,et al.  SCROLL DOWN FOR ARTICLE , 2022 .

[57]  Yasuhiro Shirai,et al.  The Acquisition of Lexical and Grammatical Aspect , 2000 .

[58]  J. Reznick,et al.  Early lexical acquisition: rate, content, and the vocabulary spurt , 1990, Journal of Child Language.

[59]  L. Fenson,et al.  Lexical development norms for young children , 1996 .

[60]  James L. McClelland,et al.  On learning the past-tenses of English verbs: implicit rules or parallel distributed processing , 1986 .

[61]  T. Dijkstra,et al.  The BIA model and bilingual word recognition. , 1998 .

[62]  Risto Miikkulainen,et al.  Modeling the Bilingual Lexicon of an Individual Subject , 2009, WSOM.

[63]  R. Dekeyser,et al.  A neural network model of the effects of entrenchment and memory development on grammatical gender learning* , 2012, Bilingualism: Language and Cognition.

[64]  Risto Miikkulainen,et al.  Computational Maps in the Visual Cortex , 2005 .

[65]  F. Attneave,et al.  The Organization of Behavior: A Neuropsychological Theory , 1949 .

[66]  L. Bloom,et al.  Semantics of verbs and the development of verb inflection in child language , 1980 .

[67]  David S. Touretzky,et al.  Connectionist Approaches to Language Learning , 1991 .

[68]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[69]  Ping Li,et al.  Age of acquisition: its neural and computational mechanisms. , 2007, Psychological bulletin.

[70]  M. Ursino,et al.  Learning the lexical aspects of a second language at different proficiencies: A neural computational study , 2012, Bilingualism: Language and Cognition.

[71]  O. Sporns Networks of the Brain , 2010 .

[72]  D. Long Networks of the Brain , 2011 .

[73]  Ping Li,et al.  3 A self-organizing connectionist model of bilingual processing , 2002 .

[74]  G. Kane Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[75]  S. Naidu Connectionism , 2012 .

[76]  K. Forster,et al.  Masked translation priming with semantic categorization: Testing the Sense Model ∗ , 2010 .

[77]  R. Miikkulainen Dyslexic and Category-Specific Aphasic Impairments in a Self-Organizing Feature Map Model of the Lexicon , 1997, Brain and Language.

[78]  T. Kohonen,et al.  Self-organizing semantic maps , 1989, Biological Cybernetics.

[79]  Mark H. Johnson,et al.  CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE New Advances in Understanding Sensitive Periods in Brain Development , 2022 .

[80]  Ping Li,et al.  The Acquisition of Word Meaning through Global Lexical Co-occurrences , 2000 .

[81]  Ping Li,et al.  Bilingualism as a Dynamic Process , 2015 .

[82]  George A. Miller,et al.  Introduction to WordNet: An On-line Lexical Database , 1990 .

[83]  J. Steven Reznick,et al.  Rapid change in lexical development in comprehension and production , 1992 .

[84]  Ping Li,et al.  The emergence of competing modules in bilingualism , 2005, Trends in Cognitive Sciences.

[85]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[86]  S. Grossberg,et al.  Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors , 1976, Biological Cybernetics.

[87]  M. Saxton Child Language: Acquisition and Development , 2010 .

[88]  Y. Munakata,et al.  Hebbian learning and development. , 2004, Developmental science.