Acoustic and respiratory evidence for utterance planning in German

Abstract This study investigates prosodic planning in a reading task in German. We analyse how the utterance length and syntactic complexity of an upcoming sentence affect two acoustic parameters (pause duration and the initial fundamental frequency peak) and two respiratory parameters (inhalation depth and inhalation duration). Two experiments were carried out. In the first experiment, data for twelve native speakers of German were recorded. They read sentences varying in length (short, long) and syntactic complexity (simple, complex). Data were analysed on the basis of the four phonetic parameters. Pause duration, inhalation depth and inhalation duration showed significant differences with respect to sentence length, but not to syntactic complexity. The initial f0 peak was not influenced by variations in length or syntactic complexity. In the second experiment it was hypothesized that the initial f0 peak is only sensitive to length manipulations of the first constituent. Twenty speakers were recorded reading utterances varying in the length of the first (short, medium, long) and last syntactic constituent (short, long). Results for the initial f0 peak confirmed our hypothesis. It is concluded that the breathing parameters and pause duration are global parameters for planning of the upcoming sentence whereas the height of the fundamental frequency peak is a more local measure sensitive to the length of the first constituent.

[1]  J. Pierrehumbert.  The phonology and phonetics of English intonation , 1987 .

[2]  A. Butcher.  Aspects of the Speech Pause: Phonetic Correlates and Communication Functions , 1981 .

[3]  H. Strik.  Physiological control and behaviour of the voice source in the production of prosody , 1994 .

[4]  J. Pierrehumbert,et al.  Japanese Tone Structure , 1988 .

[5]  Janet Slifka,et al.  Respiratory constraints on speech production: starting an utterance. , 2003, The Journal of the Acoustical Society of America.

[6]  F. Ferreira.  Prosody and performance in language production , 2007 .

[7]  Frieda Goldman Eisler.  Psycholinguistics : experiments in spontaneous speech , 1968 .

[8]  Kim Kirsner,et al.  The Relationship between Prosody and Breathing in Spontaneous Discourse , 2002, Brain and Language.

[9]  D R Ladd,et al.  ‘Metrical’ Factors in the Scaling of Sentence-Initial Accent Peaks , 1987, Phonetica.

[10]  Eva Strangert,et al.  Relating prosody to syntax: boundary signalling in Swedish , 1997, EUROSPEECH.

[11]  A. Winkworth,et al.  Breathing patterns during spontaneous speech. , 1995, Journal of speech and hearing research.

[12]  Angela H. Ciccia,et al.  The relation of lung volume initiation to selected acoustic properties of speech. , 2003, The Journal of the Acoustical Society of America.

[13]  Mariapaola D'Imperio,et al.  Evidence for soft preplanning in tonal production: initial scaling in Romance , 2006, Speech Prosody 2006.

[14]  Phil Hoole,et al.  The control of speech breathing in relation to the upcoming sentence , 2008 .

[15]  J. Hoit,et al.  Cognitive-linguistic demands and speech breathing. , 1996, Journal of speech and hearing research.

[16]  Carlos Gussenhoven,et al.  Gesture, Segment, Prosody: Downstep in Dutch: implications for a model , 1992 .

[17]  T J Hixon,et al.  Effect of lung volume on voice onset time (VOT). , 1993, Journal of speech and hearing research.

[18]  Franklin P. Tamborello,et al.  Planning in sentence production: Evidence for the phrase as a default planning scope , 2010, Cognition.

[19]  Jelena Krivokapic.  The planning, production, and perception of prosodic structure , 2007 .

[20]  Duane G. Watson,et al.  The relationship between intonational phrasing and syntactic structure in language production , 2004 .

[21]  Caroline Féry,et al.  Pitch accent scaling on given, new and focused constituents in German , 2008, J. Phonetics.

[22]  Pascal Perrier,et al.  Prosodic planning in speech production , 2012 .

[23]  J. Jescheniak,et al.  On the flexibility of grammatical advance planning during sentence production: Effects of cognitive load on multiple lexical access. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[24]  A. Winkworth,et al.  Variability and consistency in speech breathing during reading: lung volumes, speech intensity, and linguistic factors. , 1994, Journal of speech and hearing research.

[25]  Harlan Lane,et al.  The patterns of silence: Performance structures in sentence production , 1979, Cognitive Psychology.

[26]  Bettina Braun,et al.  Effects of dialect and context on the realisation of German prenuclear accents , 2007 .

[27]  Maria del Mar,et al.  EFFECT OF UTTERANCE LENGTH ON F0 SCALING , 2007 .

[28]  Gerrit Kentner,et al.  Length, ordering preference and intonational phrasing: evidence from pauses , 2007, INTERSPEECH.

[29]  Vincent J. van Heuven,et al.  Planning in speech melody: production and perception of downstep in Dutch , 2004 .

[30]  F. Ferreira,et al.  How incremental is language production? Evidence from the production of utterances requiring the computation of arithmetic sums , 2002 .

[31]  W. Levelt,et al.  Speaking: From Intention to Articulation , 1990 .

[32]  A. Meyer.  The use of eye tracking in studies of sentence generation , 2004 .

[33]  John J. Ohala,et al.  Production of Tone , 1978 .

[34]  Jelena Krivokapi.  Prosodic Planning: Effects of Phrasal Length and Complexity on Pause Duration. , 2007, Journal of phonetics.

[35]  G. Stelmach.  Information processing in motor control and learning , 1978 .

[36]  Elisabeth Dévière,et al.  Analyzing linguistic data: a practical introduction to statistics using R , 2009 .

[37]  J. Hart,et al.  On the anatomy of intonation , 1968 .

[38]  F. Ferreira.  Effects of length and syntactic complexity on initiation times for prepared utterances , 1991 .

[39]  K. Lashley.  The problem of serial order in behavior , 1951 .

[40]  D. McFarland.  Respiratory markers of conversational interaction. , 2001, Journal of speech, language, and hearing research : JSLHR.

[41]  D. Robert Ladd,et al.  On the phonetics and phonology of "segmental anchoring" of F0: evidence from German , 2004, J. Phonetics.

[42]  V. Ferreira.  Is It Better to Give Than to Donate? Syntactic Flexibility in Language Production , 1996 .

[43]  C. Féry,et al.  Sisterhood and tonal scaling , 2005 .

[44]  Christine Meunier,et al.  Vowel reduction in conversational speech in French: The role of lexical factors , 2011, J. Phonetics.

[45]  Siripong Potisuk,et al.  Tonal Coarticulation in Thai , 1994 .

[46]  Annie Rialland.  Anticipatory raising in downstep realization : evidence for preplanning in tone production , 2001 .

[47]  D H Whalen,et al.  Exploring the Relationship of Inspiration Duration to Utterance Duration , 1997, Phonetica.

[48]  William E. Cooper,et al.  Fundamental Frequency in Sentence Production , 1981 .

[49]  Hubert Truckenbrodt,et al.  Upstep and embedded register levels , 2002, Phonology.

[50]  P. Hoole,et al.  Articulatory analysis of the German vowel system , 2002 .

[51]  F. Grosjean,et al.  Breathing, Pausing and Reading , 1979, Phonetica.

[52]  N. Thorsen,et al.  Sentence intonation in textual context--supplementary data. , 1986, The Journal of the Acoustical Society of America.

[53]  Pascal van Lieshout,et al.  Speech production : motor control, brain research and fluency disorders , 1997 .

[54]  Hugo Quené,et al.  On multi-level modeling of data from repeated measures designs: a tutorial , 2004, Speech Commun..

[55]  H. H. Clark,et al.  Using uh and um in spontaneous speaking , 2002, Cognition.

[56]  James Paul Gee,et al.  Performance structures: A psycholinguistic and linguistic appraisal , 1983, Cognitive Psychology.

[57]  Jelena Krivokapic.  Speech Planning and Prosodic Phrase Length , 2009 .

[58]  A comparison of normals' and aphasics' ability to plan respiratory activity in overt and covert speech , 1997 .

[59]  Chilin Shih,et al.  Pitch downtrend in Spanish , 1996 .

[60]  F. Nolan,et al.  The effect of pitch span on intonational plateaux , 2002, Journal of the International Phonetic Association.

[61]  Janet Slifka,et al.  Some physiological correlates to regular and irregular phonation at the end of an utterance. , 2006, Journal of voice : official journal of the Voice Foundation.

[62]  Ardi Roelofs,et al.  Rightward incrementality in encoding simple phrasal forms in speech production : Verb-particle combinations , 1998 .

[63]  Rpg Rene Collier,et al.  Prosodic phrasing at the sentence level , 1995 .

[64]  F. Goldman-Eisler,et al.  Temporal Patterns of Cognitive Activity and Breath Control in Speech , 1965, Language and speech.

[65]  Caroline Féry,et al.  The prosody of embedded coordinations in German and Hindi , 2010, Speech Prosody 2010.

[66]  P. Matthews.  Information processing in motor control and learning George E. Stelmach (ed.). Academic Press, New York (1978) 315 pp. $21.00 , 1979, Neuroscience.

[67]  J. Mead,et al.  Measurement of the separate volume changes of rib cage and abdomen during breathing. , 1967, Journal of applied physiology.

[68]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[69]  Elena,et al.  Prosodic planning in speech production , 2012 .

[70]  G. Dell,et al.  Language production and serial order: a functional analysis and a model. , 1997, Psychological review.

[71]  William E. Cooper,et al.  Syntax and Speech , 1980 .

[72]  George N. Clements,et al.  Downstep and high raising: interacting factors in Yoruba tone production , 2003, J. Phonetics.

[73]  F. Ferreira,et al.  The role of working memory in syntactic ambiguity resolution: a psychometric approach. , 2007, Journal of experimental psychology. General.

[74]  T. Hixon,et al.  Kinematics of the chest wall during speech production: volume displacements of the rib cage, abdomen, and lung. , 1973, Journal of speech and hearing research.

[75]  B Conrad,et al.  Speech respiration as an indicator of integrative contextual processing. , 1983, Folia phoniatrica.

[76]  Frédérique Gayraud,et al.  Does Structural Complexity Necessarily Imply Processing Difficulty? , 2008, Journal of psycholinguistic research.

[77]  J. Laver.  The phonetic description of voice quality , 1980 .

[78]  Sasha Calhoun,et al.  The theme/rheme distinction: Accent type or relative prominence? , 2012, J. Phonetics.

[79]  E. Stathopoulos,et al.  Lung volume changes in children and adults during speech production. , 1988, Journal of speech and hearing research.

[80]  M. Garman.  Psycholinguistics , 1992 .

[81]  Esther Grabe,et al.  Comparative intonational phonology: English and German , 1998 .

[82]  Rpg Rene Collier,et al.  Syntactic influences on prosody , 1992 .

[83]  Irina L. Mikaelian,et al.  A logarithmic speed-difficulty trade-off in speech production. , 2011, Motor control.

[84]  F. Goldman-Eisler.  Psycholinguistics: Experiments in spontaneous speech , 1968 .

[85]  A. Lahiri,et al.  Prosodic Units in Speech Production , 1997 .

[86]  Antje S. Meyer,et al.  Use of word length information in utterance planning , 2007 .

[87]  P. Keating,et al.  A Prosodic View of Word Form Encoding for Speech Production , 2002 .

[88]  A T Augousti,et al.  A theoretical study of the robustness of the isovolume calibration method for a two-compartment model of breathing, based on an analysis of the connected cylinders model. , 1997, Physics in medicine and biology.

[89]  F. Ferreira.  Creation of prosody during sentence production. , 1993, Psychological review.

[90]  Fred Cummins,et al.  The effect of surrounding phrase lengths on pause duration , 2003, INTERSPEECH.

[91]  J. 't Hart.  Explorations in automatic stylization of Fo curves , 1979 .

[92]  A Smith,et al.  Effects of vocal task and respiratory phase on prephonatory chest wall movements. , 1992, Journal of speech and hearing research.

[93]  Shinji Maeda,et al.  A characterization of American English intonation , 1976 .

[94]  Jessica E Huber,et al.  Age-related changes to speech breathing with increased vocal loudness. , 2008, Journal of speech, language, and hearing research : JSLHR.

[95]  M. Corley,et al.  Why Um Helps Auditory Word Recognition: The Temporal Delay Hypothesis , 2011, PloS one.

[96]  Zenzi M. Griffin,et al.  Why Look? Reasons for Eye Movements Related to Language Production. , 2004 .

[97]  Bruce Connell,et al.  Tone , Utterance Length and F 0 Scaling , 2004 .

[98]  V. Carey,et al.  Mixed-Effects Models in S and S-Plus , 2001 .