Incremental Phonological Encoding during Unscripted Sentence Production

We investigate phonological encoding during unscripted sentence production, focusing on the effect of phonological overlap on phonological encoding. Previous work on this question has almost exclusively employed isolated word production or highly scripted multi-word production. These studies have led to conflicting results: some studies found that phonological overlap between two words facilitates phonological encoding, while others found inhibitory effects. One worry with many of these paradigms is that they involve processes that are not typical to everyday language use, which calls into question to what extent their findings speak to the architectures and mechanisms underlying language production. We present a paradigm to investigate the consequences of phonological overlap between words in a sentence while leaving speakers much of the lexical and structural choices typical in everyday language use. Adult native speakers of English described events in short video clips. We annotated the presence of disfluencies and the speech rate at various points throughout the sentence, as well as the constituent order. We find that phonological overlap has an inhibitory effect on phonological encoding. Specifically, if adjacent content words share their phonological onset (e.g., hand the hammer), they are preceded by production difficulty, as reflected in fluency and speech rate. We also find that this production difficulty affects speakers’ constituent order preferences during grammatical encoding. We discuss our results and previous works to isolate the properties of other paradigms that resulted in facilitatory or inhibitory results. The data from our paradigm also speak to questions about the scope of phonological planning in unscripted speech and as to whether phonological and grammatical encoding interact.

[1]  M. Pickering,et al.  The Representation of Verbs: Evidence from Syntactic Priming in Language Production , 1998 .

[2]  Gary S Dell,et al.  Saying the right word at the right time: Syntagmatic and paradigmatic interference in sentence production , 2008, Language and cognitive processes.

[3]  H. H. Clark,et al.  Repeating Words in Spontaneous Speech , 1998, Cognitive Psychology.

[4]  Brigham Young The Corpus of Contemporary American English as the first reliable monitor corpus of English , 2010 .

[5]  J. Jescheniak,et al.  Phonological Advance Planning in Sentence Production. , 2010 .

[6]  A. Meyer The time course of phonological encoding in language production: Phonological encoding inside a syllable , 1991 .

[7]  Jean E. Fox Tree,et al.  Pronouncing “the” as “thee” to signal problems in speaking , 1997, Cognition.

[8]  Linda Wheeldon,et al.  Inhibitory form priming of spoken word production , 2003 .

[9]  N. Martin,et al.  Variables influencing the occurrence of naming errors: Implications for models of lexical retrieval☆ , 1989 .

[10]  J. K. Bock Syntactic persistence in language production , 1986, Cognitive Psychology.

[11]  P. O'Seaghdha,et al.  Phonological competition and cooperation in form-related priming: sequential and nonsequential processes in word production. , 2000, Journal of experimental psychology. Human perception and performance.

[12]  Mark C. Smith,et al.  Horizontal information flow in spoken sentence production. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[13]  Julio Santiago,et al.  Perceptual Bias in Speech Error Data Collection: Insights from Spanish Speech Errors , 2007, Journal of psycholinguistic research.

[14]  Michael P. Sullivan,et al.  The Nature of Phonological Encoding During Spoken Word Retrieval , 1999 .

[15]  Alfonso Caramazza,et al.  Grammatical and Phonological Influences on Word Order , 2009, Psychological science.

[16]  Willem J. M. Levelt,et al.  Lexical search and order of mention in sentence production , 1981 .

[17]  J. Stemberger Wordshape errors in language production , 1990, Cognition.

[18]  Randi C. Martin,et al.  Semantic and phonological codes interact in single word production. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[19]  James R. Lindsley Producing simple utterances: How far ahead do we plan? , 1975, Cognitive Psychology.

[20]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[21]  A. Lahiri,et al.  Prosodic Units in Speech Production , 1997 .

[22]  G. Dell,et al.  The sequential cuing effect in speech production , 1994, Cognition.

[23]  Zenzi M. Griffin,et al.  A reversed word length effect in coordinating the preparation and articulation of words in speaking , 2004 .

[24]  Antje S. Meyer,et al.  Exploring the time course of lexical access in language production : Picture word interference studies , 1990 .

[25]  Matthew A Goldrick,et al.  Limited interaction in speech production: Chronometric, speech error, and neuropsychological evidence , 2006 .

[26]  Holly P. Branigan,et al.  Contributions of animacy to grammatical function assignment and word order during production , 2008 .

[27]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[28]  T. Florian Jaeger,et al.  Phonological Encoding of Sentence Production , 2011, CogSci.

[29]  Hadley Wickham,et al.  ggplot2 - Elegant Graphics for Data Analysis (2nd Edition) , 2017 .

[30]  Dan Jurafsky,et al.  Effects of disfluencies, predictability, and utterance position on word form variation in English conversation. , 2003, The Journal of the Acoustical Society of America.

[31]  James R. Lindsley Producing simple utterances: Details of the planning process , 1976 .

[32]  T. Jaeger,et al.  Categorical Data Analysis: Away from ANOVAs (transformation or not) and towards Logit Mixed Models. , 2008, Journal of memory and language.

[33]  K. Bock An Effect of the Accessibility of Word Forms on Sentence Structures , 1987 .

[34]  Gary S. Dell,et al.  Models of form-related priming in com-prehension and production , 1992 .

[35]  Elizabeth Shriberg DISFLUENCIES IN SWITCHBOARD , 1996 .

[36]  Arthur G Samuel,et al.  A reason to rhyme: phonological and semantic influences on lexical access. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[37]  G S Dell,et al.  A spreading-activation theory of retrieval in sentence production. , 1986, Psychological review.

[38]  H. Schriefers,et al.  Phonological facilitation in picture-word interference experiments: Effects of stimulus onset asynchrony and types of interfering stimuli. , 1991 .

[39]  Austin F. Frank,et al.  Analyzing linguistic data: a practical introduction to statistics using R , 2010 .

[40]  H. Schriefers Phonological Facilitation in the Production of Two-word Utterances , 1999 .

[41]  Kathleen M. Carbary,et al.  Conceptual Pacts , Syntactic Priming , and Referential Form , 2011 .

[42]  Andreas Stolcke,et al.  Word predictability after hesitations: a corpus-based study , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[43]  T Florian Jaeger,et al.  Phonological overlap affects lexical selection during sentence production. , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[44]  Victor S Ferreira,et al.  Given-New Ordering Effects on the Production of Scrambled Sentences in Japanese , 2003, Journal of psycholinguistic research.

[45]  V. Ferreira Is It Better to Give Than to Donate? Syntactic Flexibility in Language Production , 1996 .

[46]  H Schriefers,et al.  Priming Effects from Phonologically Related Distractors in Picture—Word Interference , 2001, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[47]  N. Breslow,et al.  Approximate inference in generalized linear mixed models , 1993 .

[48]  Lise Abrams,et al.  Syntactic class influences phonological priming of tip-of-the-tongue resolution , 2005, Psychonomic bulletin & review.

[49]  Sunil J Rao,et al.  Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis , 2003 .

[50]  Gary S. Dell,et al.  Stages in sentence production: An analysis of speech error data , 1981 .

[51]  Willem J. M. Levelt,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[52]  Thomas Wasow,et al.  Processing as a Source of Accessibility Effects on Variation , 2005 .

[53]  M. Damian Articulatory duration in single-word speech production. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[54]  H. H. Clark,et al.  Using uh and um in spontaneous speaking , 2002, Cognition.

[55]  W. Bruce Croft,et al.  Mixed effect models for genetic and areal dependencies in linguistic typology , 2011 .

[56]  G. Kempen,et al.  A corpus study into word order variation in German subordinate clauses: Animacy affects linearization independently of grammatical function assignment , 2003 .

[57]  Alfonso Caramazza,et al.  A Word-Order Constraint on Phonological Activation , 2008, Psychological science.

[58]  Albert Costa,et al.  Planning at the Phonological Level during Sentence Production , 2006, Journal of psycholinguistic research.

[59]  Victor Kuperman,et al.  of construction probability on word durations during spontaneous incremental sentence production , 2012 .

[60]  Peter A. Starreveld,et al.  On the Interpretation of Onsets of Auditory Context Effects in Word Production , 2000 .

[61]  Mercè Prat-Sala,et al.  Discourse constraints on syntactic processing in language production , 2000 .

[62]  Kathryn Bock,et al.  Language production : Grammatical encoding , 1994 .

[63]  W. Levelt,et al.  Speaking: From Intention to Articulation , 1990 .

[64]  Jin-Chen Yang,et al.  Horizontal Flow of Semantic and Phonological Information in Chinese Spoken Sentence Production , 2008, Language and speech.

[65]  M. Garrett Levels of processing in sentence production , 1980 .

[66]  R. Harald Baayen,et al.  Predicting the dative alternation , 2007 .

[67]  G. Dell,et al.  Effect of Ambiguity and Lexical Availability on Syntactic and Lexical Production , 2000, Cognitive Psychology.

[68]  R. R. Peterson,et al.  Lexical selection and phonological encoding during language production: Evidence for cascaded processing. , 1998 .