Sound, structure and meaning: The bases of prominence ratings in English, French and Spanish

Abstract This study tests the influence of acoustic cues and non-acoustic contextual factors on listeners’ perception of prominence in three languages whose prominence systems differ in the phonological patterning of prominence and in the association of prominence with information structure—English, French and Spanish. Native speakers of each language performed an auditory rating task to mark prominent words in samples of conversational speech under two instructions: with prominence defined in terms of acoustic or meaning-related criteria. Logistic regression models tested the role of task instruction, acoustic cues and non-acoustic contextual factors in predicting binary prominence ratings of individual listeners. In all three languages we find similar effects of prosodic phrase structure and acoustic cues (F0, intensity, phone-rate) on prominence ratings, and differences in the effect of word frequency and instruction. In English, where phrasal prominence is used to convey meaning related to information structure, acoustic and meaning criteria converge on very similar prominence ratings. In French and Spanish, where prominence plays a lesser role in signaling information structure, phrasal prominence is perceived more narrowly on structural and acoustic grounds. Prominence ratings from untrained listeners correspond with ToBI pitch accent labels for each language. Distinctions in ToBI pitch accent status (nuclear, prenuclear, unaccented) are reflected in empirical and model-predicted prominence ratings. In addition, words with a ToBI pitch accent type that is typically associated with contrastive focus are more likely to be rated as prominent in Spanish and English, but no such effect is found for French. These findings are discussed in relation to probabilistic models of prominence production and perception.

[1]  José Ignacio Hualde,et al.  The Basque dialect of Lekeitio , 1997 .

[2]  W. Chafe Cognitive constraints on information flow , 1984 .

[3]  Stefan Baumann,et al.  The probabilistic relationship between pitch accents and information status in public speech , 2018, Speech Prosody 2018.

[4]  P. Perrier,et al.  Individual Differences in Speech Production and Perception , 2015 .

[5]  Serge Fleury DISCOURS SUR LA VILLE. CORPUS DE FRANÇAIS PARLE PARISIEN DES ANNEES 2000 (CFPP2000) - Paris3-Sorbonne nouvelle , 2009 .

[6]  Hans van de Koot,et al.  Word Order and Information Structure , 2016 .

[7]  J. Pierrehumbert The phonology and phonetics of English intonation , 1987 .

[8]  Mark Liberman,et al.  The intonational system of English , 1979 .

[9]  Martine Grice,et al.  The intonation of accessibility , 2006 .

[10]  Alice Turk,et al.  The Smooth Signal Redundancy Hypothesis: A Functional Explanation for Relationships between Redundancy, Prosodic Prominence, and Duration in Spontaneous Speech , 2004, Language and speech.

[11]  Eleanor Chodroff,et al.  Information Structure, Affect and Prenuclear Prominence in American English , 2018, INTERSPEECH.

[12]  Barbara Samlowski,et al.  Exploiting the speech-gesture link to capture fine-grained prosodic prominence impressions and listening strategies , 2019, J. Phonetics.

[13]  Sun-Ah Jun,et al.  A Phonological Model of French Intonation , 2000 .

[14]  J. Hualde The sounds of Spanish , 2005 .

[15]  E. Gibson,et al.  Please Scroll down for Article Language and Cognitive Processes Acoustic Correlates of Information Structure Acoustic Correlates of Information Structure , 2022 .

[16]  Stefan Baumann,et al.  Coreference, lexical givenness and prosody in German , 2013 .

[17]  D. Barr,et al.  Random effects structure for confirmatory hypothesis testing: Keep it maximal. , 2013, Journal of memory and language.

[18]  Pilar Prieto,et al.  Acoustic Correlates of Stress in Central Catalan and Castilian Spanish , 2011, Language and speech.

[19]  Antje Schweitzer,et al.  Exemplar-theoretic integration of phonetics and phonology: Detecting prominence categories in phonetic space , 2019, J. Phonetics.

[20]  S. Calhoun The centrality of metrical structure in signaling information structure: A probabilistic perspective , 2010 .

[21]  Duane G. Watson,et al.  Effects of Participant Engagement on Prosodic Prominence , 2016, Discourse processes.

[22]  Duane G. Watson Chapter 4 - The Many Roads to Prominence: Understanding Emphasis in Conversation , 2010 .

[23]  Yurena María,et al.  NUEVOS DATOS EMPIRICOS SOBRE LA ENTONACIÓN DEL ESPAÑOL A PARTIR DEL CORPUS DE NOTICIAS GLISSANDO NEW EMPIRICAL DATA REGARDING THE INTONATION OF SPANISH FROM THE GLISSANDO NEWS CORPUS , 2015 .

[24]  A. D. Dominicis,et al.  Intonation Systems: A Survey of Twenty Languages , 1999 .

[25]  Manfred Krifka,et al.  Basic notions of information structure , 2008 .

[26]  Mariapaola D'Imperio,et al.  Investigating phrasing levels in French : Is there a difference between nuclear and prenuclear accents? , 2007 .

[27]  Mark Hasegawa-Johnson,et al.  Signal-based and expectation-based factors in the perception of prosodic prominence , 2010 .

[28]  Mats Rooth A theory of focus interpretation , 1992, Natural Language Semantics.

[29]  Caroline L. Smith,et al.  Native English listeners' perceptions of prosody in L1 and L2 reading , 2013, INTERSPEECH.

[30]  Michael McAuliffe,et al.  The effect of focus prominence on phrasing , 2019, J. Phonetics.

[31]  Jason M. Brenier,et al.  Predictability Effects on Durations of Content and Function Words in Conversational English , 2009 .

[32]  Hong Gu,et al.  English speakers' perception of Spanish lexical stress: Context-driven L2 stress perception , 2013, J. Phonetics.

[33]  Mariapaola D'Imperio,et al.  The Status of the Initial Rise as a Marker of Focus in French , 2016, Language and speech.

[34]  Pauline Welby,et al.  French intonational structure: Evidence from tonal alignment , 2006, J. Phonetics.

[35]  Brechtje Post,et al.  Tonal and phrasal structures in French intonation , 2000 .

[36]  Jennifer E. Arnold,et al.  Tic Tac TOE: Effects of predictability and importance on acoustic prominence in language production , 2008, Cognition.

[37]  Michael K. Tanenhaus,et al.  Interpreting Pitch Accents in Online Comprehension: H* vs. L+H , 2008, Cogn. Sci..

[38]  Jennifer Cole,et al.  THE PHONOLOGICAL AND PHONETIC ENCODING OF INFORMATION STRUCTURE IN AMERICAN ENGLISH NUCLEAR ACCENTS , 2019 .

[39]  Jennifer S. Cole,et al.  Structural and Referent-Based Effects on Prosodic Expression in Russian , 2017, Phonetica.

[40]  John Kingston,et al.  Salient pitch cues in the perception of contrastive focus , 1994 .

[41]  J. Cole,et al.  Prosody in context: a review , 2015 .

[42]  William D. Raymond,et al.  The Buckeye corpus of conversational speech: labeling conventions and a test of transcriber reliability , 2005, Speech Commun..

[43]  J. Fox Effect Displays in R for Generalised Linear Models , 2003 .

[44]  J. Cole,et al.  Please Scroll down for Article Language and Cognitive Processes the Role of Syntactic Structure in Guiding Prosody Perception with Ordinary Listeners and Everyday Speech the Role of Syntactic Structure in Guiding Prosody Perception with Ordinary Listeners and Everyday Speech , 2022 .

[45]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[46]  Elisabeth Delais-Roussarie,et al.  Metrical structure, tonal association and focus in French , 2007 .

[47]  Anne-Catherine Simon,et al.  Prominence perception and accent detection in French. A corpus-based account , 2010 .

[48]  D. Bolinger Intonation and its parts : melody in spoken English , 1987 .

[49]  Jean-Marie Marandin,et al.  Prosodic Marking of Information Focus in French , 2009 .

[50]  Jason B. Bishop WPP, No. 108: Information Structural Expectations in the Perception of Prosodic Prominence , 2010 .

[51]  Stefanie Shattuck-Hufnagel,et al.  The original ToBI system and the evolution of the ToBI framework , 2003 .

[52]  Boris New,et al.  Une base de données lexicales du français contemporain sur internet: LEXIQUE , 2001 .

[53]  M. Tanenhaus,et al.  Gradient effects of within-category phonetic variation on lexical access , 2002, Cognition.

[54]  Bodo Winter,et al.  What makes a word prominent? Predicting untrained German listeners' perceptual judgments , 2018, J. Phonetics.

[55]  J. Cole,et al.  Individual differences and patterns of convergence in prosody perception , 2017 .

[56]  Carlos Gussenhoven,et al.  Testing the Reality of Focus Domains , 1983 .

[57]  M. Grice,et al.  The Importance of a Distributional Approach to Categoriality in Autosegmental-Metrical Accounts of Intonation , 2016 .

[58]  Gábor Pintér,et al.  Perception of prosodic prominence and boundaries by L1 and L2 speakers of English , 2014, INTERSPEECH.

[59]  Brechtje Post The multi-facetted relation between phrasing and intonation contours in French , 2011 .

[60]  Pascal Perrier,et al.  Listener-Specific Perception of Speaker-Specific Productions in Intonation , 2015 .

[61]  Russell V. Lenth,et al.  Least-Squares Means: The R Package lsmeans , 2016 .

[62]  Helmut Schmidt,et al.  Probabilistic part-of-speech tagging using decision trees , 1994 .

[63]  E. Vilaplana,et al.  La notación prosódica del español: una revisión del Sp-ToBI , 2008 .

[64]  T. L. Face Intonation in Spanish declaratives : differences between lab speech and spontaneous speech , 2003 .

[65]  Sasha Calhoun,et al.  Information structure and the prosodic structure of English : a probabilistic relationship , 2007 .

[66]  J. Masefield,et al.  ‘ ‘ Sagging transitions ’ ’ between high pitch accents in English : experimental evidence , 2003 .

[67]  G. Ayers,et al.  Guidelines for ToBI labelling , 1994 .

[68]  Sun-Ah Jun,et al.  Prosodic typology: by prominence type, word prosody, and macro-rhythm * , 2014 .

[69]  C. Fougeron,et al.  Realizations of accentual phrase in French intonation , 2002 .

[70]  Caroline Féry,et al.  Focus as prosodic alignment , 2013 .

[71]  Bettina Braun,et al.  Alignment of f0 peak in different pitch accent types affects perception of metrical stress , 2019, J. Phonetics.

[72]  Tamara Rathcke,et al.  Dialectal phonology constrains the phonetics of prominence , 2020, J. Phonetics.

[73]  A. Cristo,et al.  PROSODIC ORGANISATION AND PHRASING AFTER FOCUS IN FRENCH Albert Di Cristo , 1999 .

[74]  Jean-Philippe Goldman,et al.  EasyAlign: An Automatic Phonetic Alignment Tool Under Praat , 2011, INTERSPEECH.

[75]  Roxane Bertrand,et al.  Perception des frontières et des proéminences en français (Perception of boundaries and prominences in French) [in French] , 2012, JEP/TALN/RECITAL.

[76]  M. Aylett,et al.  Language redundancy predicts syllabic duration and the spectral characteristics of vocalic syllable nuclei. , 2006, The Journal of the Acoustical Society of America.

[77]  Corine Astésano Rythme et accentuation en français : invariance et variabilité stylistique , 2001 .

[78]  Hartmut R. Pfitzinger,et al.  Local speech rate as a combination of syllable and phone rate , 1998, ICSLP.

[79]  Caroline Féry,et al.  Compression in post-verbal sequences in French , 2015, ICPhS.

[80]  Jason Bishop,et al.  Individual differences in top-down and bottom-up prominence perception , 2016 .

[81]  Corine Astésano,et al.  Quelques cas particuliers de détachement à gauche - ou la prosodie à l'aide de la syntaxe , 2008 .

[82]  Stefanie Shattuck-Hufnagel Phonology and Phonetic Evidence: The importance of phonological transcription in empirical approaches to “stress shift” versus “early accent”: comments on Grabe and Warren, and Vogel, Bunnell, and Hoskins , 1995 .

[83]  Daniel Büring Intonation and Meaning , 2016 .

[84]  J. Pierrehumbert,et al.  Intonational structure in Japanese and English , 1986, Phonology.

[85]  Donna Erickson,et al.  Articulatory and acoustic correlates of prominence in French: Comparing L1 and L2 speakers , 2019, J. Phonetics.

[86]  Joseph Roy,et al.  Crowd-sourcing prosodic annotation , 2017, Comput. Speech Lang..

[87]  Elisabeth Selkirk,et al.  Sentence Prosody: Intonation, Stress and Phrasing , 1996 .

[88]  Duane G. Watson,et al.  Experimental and theoretical advances in prosody: A review , 2010, Language and cognitive processes.

[89]  David Escudero Mancebo,et al.  Glissando: a corpus for multidisciplinary prosodic studies in Spanish and Catalan , 2013, Lang. Resour. Evaluation.

[90]  H. Timothy Bunnell,et al.  Phonology and Phonetic Evidence: The phonology and phonetics of the Rhythm Rule , 1995 .

[91]  Brechtje Post,et al.  Restructured phonological phrases in French: evidence from clash resolution , 1999 .

[92]  Rajiv Rao,et al.  Deaccenting in Spontaneous Speech in Barcelona Spanish , 2009 .

[93]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[94]  B. Rosner,et al.  Loudness predicts prominence: fundamental frequency lends little. , 2005, The Journal of the Acoustical Society of America.

[95]  Dani Byrd,et al.  Syllable-internal corrective focus in Korean , 2019, J. Phonetics.

[96]  A. Prince,et al.  On stress and linguistic rhythm , 1977 .

[97]  María Victoria Escandell Vidal,et al.  Prosody, information structure and evaluation , 2014 .

[98]  Dwight L. Bolinger English Prosodic Stress and Spanish Sentence Order , 1954 .

[99]  Henrik Singmann,et al.  afex – Analysis of Factorial EXperiments , 2015 .

[100]  Caroline Smith,et al.  Emphasis does not always coincide with phrasal boundaries in spontaneous spoken French , 2012, JEP/TALN/RECITAL.

[101]  Stefanie Shattuck-Hufnagel,et al.  Stress shift and early pitch accent placement in lexical items in American English , 1994 .

[102]  D. Bolinger A Theory of Pitch Accent in English , 1958 .

[103]  Marianna Nadeu,et al.  Stress- and speech rate-induced vowel quality variation in Catalan and Spanish , 2014, J. Phonetics.

[104]  Albert Di Cristo,et al.  Vers une modélisation de l'accentuation du français: première partie , 1999, Journal of French Language Studies.

[105]  Paul Maruff,et al.  Standardization of pitch-range settings in voice acoustic analysis , 2009, Behavior research methods.

[106]  M. Avanzi,et al.  Intonational phonology of French: Developing a ToBI system for French , 2015 .

[107]  Jason Bishop,et al.  Phonology, phonetics, and signal-extrinsic factors in the perception of prosodic prominence: Evidence from Rapid Prosody Transcription , 2020, J. Phonetics.

[108]  B. Wells,et al.  Prosodic Variation in Southern British English , 2000, Language and speech.