Phonetic-phonological feature emerges by associating phonetic with semantic information - a GSOM-based modeling study

Born with an innate neural architecture built specially for language learning, young children have the ability to distinguish sounds in a variety of languages. As they are exposed to native language environment, perceptual reorganization occurs, and native language system gradually establishes. Phonology knowledge, which is language-specific, emerges during this process. In this study, based on the further developed Interconnected Growing Self-Organizing Maps (I-GSOM) model, we present a series of computational modeling experiments which simulate the early language acquisition process for young children. A universal model that has the ability to distinguish phonemes in different languages (two in our case) is built based on English and Standard Chinese data. The native language learning is simulated based on Standard Chinese data with both phonetic and semantic inputs for children between 12 and 18 months old. Experiment results show that the conceptual based top-down process contributes to the reorganization of phonetic knowledge, and phonetic–semantic association helps the emergence of phonetic-phonological knowledge. It can be hypothesized from these findings that the phonetic-phonological interface does not appear as a clean cut within the speech processing system but as a broader zone located between sensorimotor and semantic processing.

[1]  Jun Gao,et al.  Mandarin multimedia child speech corpus: Cass_Child , 2012, 2012 International Conference on Speech Database and Assessments.

[2]  J. Werker,et al.  Cross-language speech perception: Evidence for perceptual reorganization during the first year of life , 1984 .

[3]  Dare A. Baldwin,et al.  Infants' contribution to the achievement of joint reference. , 1991, Child development.

[4]  R. Paget The Origin of Speech , 1927, Nature.

[5]  Dare A. Baldwin,et al.  Infants' reliance on a social criterion for establishing word-object relations. , 1996, Child development.

[6]  P K Kuhl,et al.  Theoretical contributions of tests on animals to the special-mechanisms debate in speech. , 1986, Experimental biology.

[7]  Robert J. Dooling,et al.  Plasticity of development , 1991 .

[8]  Bernd J. Kröger,et al.  Interconnected growing self-organizing maps for auditory and semantic acquisition modeling , 2014, Front. Psychol..

[9]  Kate A. Smith,et al.  Applications of the Growing Self Organizing Map on high dimensional data , 2004 .

[10]  Wei-Shen Tai,et al.  A growing mixed Self-Organizing Map , 2010, 2010 Sixth International Conference on Natural Computation.

[11]  P. Kuhl,et al.  Infants show a facilitation effect for native language phonetic perception between 6 and 12 months. , 2006, Developmental science.

[12]  Dare A. Baldwin,et al.  Infants' ability to consult the speaker for clues to word reference , 1993, Journal of Child Language.

[13]  Wei-Shen Tai,et al.  Improving visualization of mixed-type data with a dynamic SOM , 2011, 2011 Seventh International Conference on Natural Computation.

[14]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[15]  P. Kuhl Early language acquisition: cracking the speech code , 2004, Nature Reviews Neuroscience.

[16]  Kanae Nishi,et al.  Discrimination of English /r-l/ and /w-y/ by Japanese infants at 6-12 months: language-specific developmental changes in speech perception abilities , 1994, ICSLP.

[17]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[18]  Luc H. Arnal,et al.  Asymmetric Function of Theta and Gamma Activity in Syllable Processing: An Intra-Cortical Study , 2012, Front. Psychology.

[19]  C. F. Hockett The origin of speech. , 1960, Scientific American.

[20]  P. Ladefoged A course in phonetics , 1975 .

[21]  David Poeppel,et al.  Cortical oscillations and speech processing: emerging computational principles and operations , 2012, Nature Neuroscience.

[22]  Helen J. Neville,et al.  Language Experience and the Organization of Brain Activity to Phonetically Similar Words: ERP Evidence from 14- and 20-Month-Olds , 2004, Journal of Cognitive Neuroscience.