A Single-Stage Approach to Learning Phonological Categories: Insights From Inuktitut

To acquire one's native phonological system, language-specific phonological categories and relationships must be extracted from the input. The acquisition of the categories and relationships has each in its own right been the focus of intense research. However, it is remarkable that research on the acquisition of categories and the relations between them has proceeded, for the most part, independently of one another. We argue that this has led to the implicit view that phonological acquisition is a "two-stage" process: Phonetic categories are first acquired and then subsequently mapped onto abstract phoneme categories. We present simulations that suggest two problems with this view: First, the learner might mistake the phoneme-level categories for phonetic-level categories and thus be unable to learn the relationships between phonetic-level categories; on the other hand, the learner might construct inaccurate phonetic-level representations that prevent it from finding regular relations among them. We suggest an alternative conception of the phonological acquisition problem that sidesteps this apparent inevitability and acquires phonemic categories in a single stage. Using acoustic data from Inuktitut, we show that this model reliably converges on a set of phoneme-level categories and phonetic-level relations among subcategories, without making use of a lexicon.

[1]  Richard N Aslin,et al.  Statistical learning of phonetic categories: insights from a computational approach. , 2009, Developmental science.

[2]  Sharon Peperkamp,et al.  Rapid acquisition of phonological alternations by infants , 2008, Cognition.

[3]  L. Lipsitt,et al.  Neonate cognition: Beyond the blooming buzzing confusion , 1986 .

[4]  M. Baumann The production of syllables in connected speech , 1996 .

[5]  D. Whalen,et al.  Lexical effects in the perception and production of American English /p/ allophones , 1997 .

[6]  David G. Stork,et al.  Pattern Classification , 1973 .

[7]  Virginia Teller Review of Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition by Daniel Jurafsky and James H. Martin. Prentice Hall 2000. , 2000 .

[8]  Roy Szweda,et al.  In an uncertain world , 2006 .

[9]  Bart de Boer,et al.  Investigating the role of infant-directed speech with a computer model , 2003 .

[10]  M. West,et al.  Hyperparameter estimation in Dirichlet process mixture models , 1992 .

[11]  A. Dawid Some matrix-variate distribution theory: Notational considerations and a Bayesian application , 1981 .

[12]  G. McLachlan On Bootstrapping the Likelihood Ratio Test Statistic for the Number of Components in a Normal Mixture , 1987 .

[13]  Z. Harris,et al.  Methods in structural linguistics. , 1952 .

[14]  J. Pierrehumbert Phonetic Diversity, Statistical Learning, and Acquisition of Phonology , 2003, Language and speech.

[15]  Brian Everitt,et al.  Cluster analysis , 1974 .

[16]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[17]  P. Smolensky,et al.  Optimality Theory: Constraint Interaction in Generative Grammar , 2004 .

[18]  Thomas L. Griffiths,et al.  Learning phonetic categories by learning a lexicon , 2009 .

[19]  Joel D. Martin,et al.  Aligning and Using an English-Inuktitut Parallel Corpus , 2003, ParallelTexts@NAACL-HLT.

[20]  Paul J. Hopper,et al.  Introduction to frequency and the emergence of linguistic structure , 2001 .

[21]  M. Tomasello,et al.  Variability in early communicative development. , 1994, Monographs of the Society for Research in Child Development.

[22]  Chandan R. Narayan,et al.  The interaction between acoustic salience and language experience in developmental speech perception: evidence from nasal place discrimination. , 2010, Developmental science.

[23]  Kelli J. Johnson The auditory/perceptual basis for speech segmentation , 1997 .

[24]  John R. Hershey,et al.  Approximating the Kullback Leibler Divergence Between Gaussian Mixture Models , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[25]  Adam N. Sanborn,et al.  Unifying rational models of categorization via the hierarchical Dirichlet process , 2019 .

[26]  P. Boersma,et al.  Empirical Tests of the Gradual Learning Algorithm , 2001, Linguistic Inquiry.

[27]  Paul Smolensky,et al.  Comprar Optimality Theory: Constraint Interaction in Generative Grammar | Alan Prince | 9781405119320 | Wiley , 2008 .

[28]  Michael Pasquale 10. Phonological variation in a Peruvian Quechua speech community , 2009 .

[29]  N. Stanietsky,et al.  The interaction of TIGIT with PVR and PVRL2 inhibits human NK cell cytotoxicity , 2009, Proceedings of the National Academy of Sciences.

[30]  Jennifer Cole,et al.  Unmasking the acoustic effects of vowel-to-vowel coarticulation: A statistical modeling approach , 2010, J. Phonetics.

[31]  R. Port,et al.  Neutralization of syllable-final voicing in German , 1985 .

[32]  R. Port,et al.  Incomplete neutralization and pragmatics in German , 1989 .

[33]  J. Berko The Child's Learning of English Morphology , 1958 .

[34]  Brian MacWhinney,et al.  The CHILDES Project: Tools for Analyzing Talk (third edition): Volume I: Transcription format and programs, Volume II: The database , 2000, Computational Linguistics.

[35]  Eric Wanner,et al.  Language acquisition: the state of the art , 1982 .

[36]  Noam Chomsky,et al.  The Sound Pattern of English , 1968 .

[37]  Julio Gonzalo,et al.  A comparison of extrinsic clustering evaluation metrics based on formal constraints , 2008, Information Retrieval.

[38]  Michael Kenstowicz,et al.  Phonology In Generative Grammar , 1994 .

[39]  Imre Hronszky,et al.  Rationality in an Uncertain World , 2005 .

[40]  P. Ladefoged Vowels and consonants : an introduction to the sounds of languages , 2001 .

[41]  H. B. Barlow,et al.  Unsupervised Learning , 1989, Neural Computation.

[42]  William J. Turkel,et al.  The Logical Problem of Language Acquisition in Optimality Theory , 1998 .

[43]  K. Onishi,et al.  Allophonic and Phonemic Contrasts in Infants' Learning of Sound Patterns , 2009, Language Learning and Development.

[44]  B. MacWhinney The CHILDES project: tools for analyzing talk , 1992 .

[45]  Julio Gonzalo,et al.  A comparison of extrinsic clustering evaluation metrics based on formal constraints , 2009, Information Retrieval.

[46]  James H. Martin,et al.  Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition , 2000 .

[47]  P. Kuhl Human adults and human infants show a “perceptual magnet effect” for the prototypes of speech categories, monkeys do not , 1991, Perception & psychophysics.

[48]  Terrence J. Sejnowski,et al.  Unsupervised Learning , 2018, Encyclopedia of GIS.

[49]  Bruce Hayes Constraints in Phonological Acquisition: Phonological acquisition in Optimality Theory: the early stages , 2004 .

[50]  Michael H. Coen Self-Supervised Acquisition of Vowels in American English , 2006, AAAI.

[51]  B. Everitt,et al.  Cluster Analysis Ed. 5 , 2011 .

[52]  R. Port,et al.  Against Formal Phonology , 2005 .

[53]  R. T. Cox Probability, frequency and reasonable expectation , 1990 .

[54]  Paul Kiparsky,et al.  Lexical Phonology and Morphology , 1982 .

[55]  B. Hayes,et al.  Phonological Acquisition in Optimality Theory: the Early Stages 1 Submitted for a Forthcoming Volume on Phonological Acquisition and Typology, Edited Phonological Acquisition in Optimality Theory: the Early Stages , 1999 .

[56]  Laurel Fais,et al.  Infant-directed speech supports phonetic category learning in English and Japanese , 2007, Cognition.

[57]  Carrie Joan Dyck,et al.  Constraining the phonology-phonetics interfaces: with exemplification from Spanish and Italian dialects (1995) , 1995 .

[58]  N. Chater,et al.  The probabilistic approach to human reasoning , 2001, Trends in Cognitive Sciences.

[59]  J. Nadal,et al.  The acquisition of allophonic rules: Statistical learning with linguistic constraints , 2006, Cognition.

[60]  Louis-Jacques Dorais,et al.  Inuktitut Surface Phonology: A Trans-Dialectal Survey , 1986, International Journal of American Linguistics.

[61]  Gunnar Fant,et al.  Acoustic Theory Of Speech Production , 1960 .

[62]  S. Ohman Coarticulation in VCV utterances: spectrographic measurements. , 1966, The Journal of the Acoustical Society of America.

[63]  Eric Bakovic A revised typology of opaque generalisations* , 2007, Phonology.

[64]  Janet B. Pierrehumbert,et al.  Exemplar dynamics: Word frequency, lenition and contrast , 2000 .

[65]  Jørgen Rischel Topics in West Greenlandic phonology: Regularities underlying the phonetic appearance of wordforms in a polysynthetic language , 1974 .

[66]  James D. Harnsberger,et al.  Language-specific patterns of vowel-to-vowel coarticulation: acoustic structures and their perceptual correlates , 2002, J. Phonetics.

[67]  D. Slobin,et al.  The Crosslinguistic Study of Language Acquisition , 2000 .

[68]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[69]  Jerrold M. Sadock A grammar of Kalaallisut (West Greenlandic Inuttut) , 2003 .

[70]  S. Manuel,et al.  The role of contrast in limiting vowel-to-vowel coarticulation in different languages. , 1990, The Journal of the Acoustical Society of America.

[71]  C. F. Hockett,et al.  A System of Descriptive Phonology , 1942 .

[72]  Colin Phillips,et al.  The influence of meaning on the perception of speech sounds. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[73]  Elizabeth Hume,et al.  Looking through opacity , 2003 .

[74]  D. Silverman A Critical Introduction to Phonology: of Sound, Mind, and Body , 2006 .

[75]  Terrance M. Nearey,et al.  The segment as a unit of speech perception , 1990 .

[76]  Michael Jessen,et al.  Phonetics and Phonology of Tense and Lax Obstruents in German , 1999 .

[77]  Allard Jongman,et al.  Incomplete neutralization and other sub-phonemic durational differences in production and perception: evidence from Dutch , 2004, J. Phonetics.

[78]  Adrian E. Raftery,et al.  MCLUST Version 3 for R: Normal Mixture Modeling and Model-Based Clustering † , 2007 .

[79]  Paul Boersma,et al.  Learning abstract phonological from auditory phonetic catergories: an integrated model for the acquisition of language-specific sound categories , 2003 .

[80]  M. Escobar,et al.  Bayesian Density Estimation and Inference Using Mixtures , 1995 .

[81]  Larry M. Hyman,et al.  How autosegmental is phonology? , 2013 .

[82]  B. Elan Dresher The Contrastive Hierarchy in Phonology , 2009 .

[83]  Catherine T. Best,et al.  Learning to perceive the sound pattern of english , 1995 .

[84]  J. Werker,et al.  Cross-language speech perception: Evidence for perceptual reorganization during the first year of life , 1984 .

[85]  Bart de Boer,et al.  Infant‐directed vowels are easier to learn for a computer model , 2001 .

[86]  Edward Flemming Scalar and categorical phenomena in a unified model of phonetics and phonology , 2001, Phonology.

[87]  Frances Conlin,et al.  Proceedings of the 27th annual Boston University Conference on Language Development , 2003 .

[88]  B. Hayes,et al.  Phonological Acquisition in Optimality Theory: The Early Stages 1 , 1999 .

[89]  T. Ferguson A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[90]  M. Fourakis,et al.  On the ‘Incomplete Neutralization’ of German Final Obstruents , 1984 .

[91]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[92]  Ying Lin,et al.  Discovering place and manner features—What can be learned from acoustic and articulatory data? , 2006 .

[93]  Kristine H. Onishi,et al.  Infants learn phonotactic regularities from brief auditory experience , 2003, Cognition.

[94]  J. Werker,et al.  Developmental changes across childhood in the perception of non-native speech sounds. , 1983, Canadian journal of psychology.

[95]  John Goldsmith,et al.  Learning Phonological Categories , 2009 .

[96]  James H. Sledd Breaking, Umlaut, and the Southern Drawl , 1966 .

[97]  R N Aslin,et al.  Statistical Learning by 8-Month-Old Infants , 1996, Science.

[98]  Adrian E. Raftery,et al.  Model-Based Clustering, Discriminant Analysis, and Density Estimation , 2002 .

[99]  Sharon Peperkamp,et al.  Allophonic variation and the acquisition of phoneme categories , 2003 .

[100]  Zellig S. Harris,et al.  Methods in structural linguistics. , 1952 .

[101]  Alana Johns Additional facts about noun incorporation (in Inuktitut) , 2009 .

[102]  A. Cohn Phonetic and phonological rules of nasalization , 1990 .

[103]  Radford M. Neal Markov Chain Sampling Methods for Dirichlet Process Mixture Models , 2000 .

[104]  David B. Pisoni,et al.  Speech and auditory processing during infancy: Constraints on and precursors to language. , 1998 .

[105]  M A Mines,et al.  Frequency of Occurrence of Phonemes in Conversational English , 1978, Language and speech.

[106]  Charles Reiss,et al.  The Phonological Enterprise , 2008 .

[107]  R. Jakobson Child Language, Aphasia and Phonological Universals , 1980 .

[108]  Jessica Maye,et al.  Infant sensitivity to distributional information can affect phonetic discrimination , 2002, Cognition.

[109]  Sylvia Frühwirth-Schnatter,et al.  Finite Mixture and Markov Switching Models , 2006 .

[110]  S. MacEachern,et al.  Bayesian Density Estimation and Inference Using Mixtures , 2007 .

[111]  Dirk van Rijn,et al.  Proceedings of the 31st annual conference of the Cognitive Science Society , 2003 .

[112]  J. Werker,et al.  Native language governs interpretation of salient speech sound differences at 18 months , 2007, Proceedings of the National Academy of Sciences.

[113]  Louisa M. Slowiaczek,et al.  On the neutralizing status of Polish word-final devoicing , 1985 .

[114]  James L. McClelland,et al.  Unsupervised learning of vowel categories from infant-directed speech , 2007, Proceedings of the National Academy of Sciences.

[115]  Pilar Barbosa,et al.  Is the best good enough? : optimality and competition in syntax , 1998 .

[116]  P. Kuhl,et al.  Influences of phonetic identification and category goodness on American listeners' perception of /r/ and /l/. , 1996, The Journal of the Acoustical Society of America.

[117]  K. Stevens,et al.  Linguistic experience alters phonetic perception in infants by 6 months of age. , 1992, Science.

[118]  S. Miyata The TAI corpus: Longitudinal speech data of a Japanese boy aged 1 , 2000 .

[119]  E. Jaynes Probability theory : the logic of science , 2003 .