Timing and coordination in tone and intonation―An articulatory-functional perspective

Abstract Timing is of critical importance for speech in general and for tone and intonation in particular. Yet our understanding of timing is still limited. In this paper I explore timing-related issues from an articulatory-functional perspective, which views speech as communicative functions encoded through an articulation process. Based on this view, timing in speech can be seen as of two kinds, obligatory timing—timing as obligated by articulation, and informational timing—timing that encodes communicative meanings. I will show that the articulatory constraints of minimal movement duration and syllable-bound temporal alignment severely limit the freedom of using timing for information coding, leaving duration as the only controllable aspect of timing. I will further show that duration, as other aspects of speech, is used to encode multiple layers of communicative meanings in parallel, allowing concurrent encoding of lexical contrast, focus, and inter-constituent affinity. Such information coding seems to account for previously reported duration patterns such as polysyllabic shortening and constituent-edge lengthening. Furthermore, to the extent the reported weak isochrony tendency can be explained by information coding and articulatory mechanisms that have little to do with isochrony, speech rhythm seems to be an epiphenomenon rather than a basic mechanism.

[1]  D Goodman,et al.  On the nature of human interlimb coordination. , 1979, Science.

[2]  Emily Q. Wang,et al.  Pitch targets and their realization: Evidence from Mandarin Chinese , 2001, Speech Commun..

[3]  Yukari Hirata,et al.  Effects of speaking rate on the vowel length distinction in Japanese , 2004, J. Phonetics.

[4]  Björn Lindblom,et al.  Explaining Phonetic Variation: A Sketch of the H&H Theory , 1990 .

[5]  Mariapaola D'Imperio,et al.  Are tones aligned with articulatory events? Evidence from Italian and French , 2007 .

[6]  Michiko Hashi,et al.  Lip-pellet positions during vowels and labial consonants , 1997 .

[7]  K. Pike,et al.  The intonation of American English , 1946 .

[8]  D. R. Ladd,et al.  Segmental anchoring of pitch movements: autosegmental phonology or speech production? , 2004 .

[9]  Kenneth de Jong,et al.  Stress, lexical focus, and segmental focus in English: patterns of variation in vowel duration , 2004, J. Phonetics.

[10]  Maolin Wang,et al.  Tonal and durational variations as phonetic coding for syllable grouping , 2005 .

[11]  Carlos Gussenhoven,et al.  Intonation and interpretation: phonetics and phonology , 2002, Speech Prosody 2002.

[12]  Yi Xu,et al.  Fundamental Frequency Peak Delay in Mandarin , 2000, Phonetica.

[13]  H. Ackermann,et al.  Articulatory control of phonological vowel length contrasts: kinematic analysis of labial gestures. , 1997, The Journal of the Acoustical Society of America.

[14]  M. Gordon Syllable Weight: Phonetics, Phonology, Typology , 2006 .

[15]  H. Haken,et al.  A theoretical model of phase transitions in human hand movements , 2004, Biological Cybernetics.

[16]  Dwight L. Bolinger,et al.  Intonation and Its Uses: Melody in Grammar and Discourse , 1989 .

[17]  Yi Xu,et al.  Effects of tone and focus on the formation and alignment of f0contours , 1999 .

[18]  Santitham Prom-on,et al.  Quantitative Target Approximation Model: Simulating Underlying Mechanisms of Tones and Intonations , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[19]  Ying Wai Wong Contextual Tonal Variations and Pitch Targets in Cantonese , 2006 .

[20]  Takayuki Arai,et al.  Japanese Mora-Timing: A Review , 2000, Phonetica.

[21]  Colin W. Wightman,et al.  Segmental durations in the vicinity of prosodic phrase boundaries. , 1992, The Journal of the Acoustical Society of America.

[22]  Stefanie Shattuck-Hufnagel,et al.  Word-boundary-related duration patterns in English , 2000, J. Phonetics.

[23]  David R. Hill,et al.  Unrestricted text-to-speech revisited: rhythm and intonation , 1992, ICSLP.

[24]  Robert F. Port,et al.  Rhythmic constraints on stress timing in English , 1998 .

[25]  Yi Xu,et al.  The phonetics and phonology of apparent cases of iterative tonal change in Standard Chinese , 2007 .

[26]  Yi Xu,et al.  Production of Weak Elements in Speech – Evidence from F₀ Patterns of Neutral Tone in Standard Chinese , 2006, Phonetica.

[27]  Yi Xu,et al.  Speech melody as articulatorily implemented communicative functions , 2005, Speech Commun..

[28]  Yi Xu,et al.  Asking questions with focus , 2004 .

[29]  D. Ladd,et al.  Constant "segmental anchoring" of F0 movements under changes in speech rate. , 1999, The Journal of the Acoustical Society of America.

[30]  Yi Xu,et al.  Phonetic realization of focus in English declarative intonation , 2005, J. Phonetics.

[31]  D. Klatt Linguistic uses of segmental duration in English: acoustic and perceptual evidence. , 1976, The Journal of the Acoustical Society of America.

[32]  Hartmut Traunmüller,et al.  The Effect of Local Speaking Rate on the Perception of Quantity in Estonian , 2003, Phonetica.

[33]  W. Prinz,et al.  Perceptual basis of bimanual coordination , 2001, Nature.

[34]  Ching X. Xu,et al.  Effects of consonant aspiration on Mandarin tones , 2003 .

[35]  A Löfqvist,et al.  Interarticulator programming in VCV sequences: lip and tongue movements. , 1999, The Journal of the Acoustical Society of America.

[36]  M. Gordon A typology of contour tone restrictions , 2001 .

[37]  E. Large,et al.  The dynamics of attending: How people track time-varying events. , 1999 .

[38]  Agaath M. C. Sluijter,et al.  Spectral balance as an acoustic correlate of linguistic stress. , 1996, The Journal of the Acoustical Society of America.

[39]  J. Pierrehumbert The phonology and phonetics of English intonation , 1987 .

[40]  Janet B. Pierrehumbert,et al.  Phonological and phonetic representation , 1990 .

[41]  Ning Qian,et al.  An optimization principle for determining movement duration. , 2006, Journal of neurophysiology.

[42]  Jan Edwards,et al.  Papers in Laboratory Phonology: Lengthenings and shortenings and the nature of prosodic constituency , 1990 .

[43]  Yi Xu,et al.  Maximum speed of pitch change and how it may relate to speech. , 2002, The Journal of the Acoustical Society of America.

[44]  Kenneth de Jong,et al.  Comparing stress, lexical focus, and segmental focus: patterns of variation in Arabic vowel duration , 2002, J. Phonetics.

[45]  Kari Suomi Temporal conspiracies for a tonal end: Segmental durations and accentual f0 movement in a quantity language , 2005, J. Phonetics.

[46]  San Duanmu,et al.  Syllabic weight and syllabic duration: a correlation between phonology and phonetics , 1994, Phonology.

[47]  Stefanie Shattuck-Hufnagel,et al.  A prosody tutorial for investigators of auditory sentence processing , 1996, Journal of psycholinguistic research.

[48]  Yi Xu How often is maximum speed of articulation approached in speech , 2007 .

[49]  Yi Xu,et al.  Multiple effects of consonant manner of articulation and intonation type on F0 in English , 2004 .

[50]  Lloyd H. Nakatani,et al.  Prosodic Aspects of American English Speech Rhythm , 1981 .

[51]  W. L. Nelson Physical principles for economies of skilled movements , 1983, Biological Cybernetics.

[52]  Arthur S. Abramson,et al.  Distinctive vowel length: duration vs. spectrum in Thai , 1990 .

[53]  Fang Liu,et al.  Tonal alignment, syllable structure and coarticulation: Toward an integrated model , 2006 .

[54]  Daniel Hirst,et al.  The effect of stress and boundaries on segmental duration in a corpus of authentic speech (british English) , 2005, INTERSPEECH.

[55]  Rpg Rene Collier,et al.  Focus Conditions and the Prominence of Pitch-Accented Syllables , 1996 .

[56]  D. Ostry,et al.  Control of rate and duration of speech movements. , 1985, The Journal of the Acoustical Society of America.

[57]  J Pind Speech segment durations and quantity in Icelandic. , 1999, The Journal of the Acoustical Society of America.

[58]  Siripong Potisuk,et al.  Tonal Coarticulation in Thai , 1994 .

[59]  Swift,et al.  The Huygens entrainment phenomenon and thermoacoustic engines , 2000, The Journal of the Acoustical Society of America.

[60]  Wayne A. Lea,et al.  Trends in Speech Recognition , 1980 .

[61]  Noam Chomsky,et al.  The Sound Pattern of English , 1968 .

[62]  Yi Xu,et al.  Understanding tone from the perspective of production and perception. Language and Linguistics , 2004 .

[63]  R. Port Linguistic timing factors in combination. , 1981, The Journal of the Acoustical Society of America.

[64]  T. Crystal,et al.  Segmental durations in connected-speech signals: Syllabic stress , 1988 .

[65]  M. R. Jones,et al.  Dynamic attending and responses to time. , 1989, Psychological review.

[66]  Fang Liu,et al.  Determining the temporal interval of segments with the help of F0 contours , 2007, J. Phonetics.

[67]  Amalia Arvaniti,et al.  Dialectal variation in the rising accents of American English , 2007 .

[68]  F. Ramus,et al.  Correlates of linguistic rhythm in the speech signal , 1999, Cognition.

[69]  M. O'Malley,et al.  Recovering parentheses from spoken algebraic expressions , 1973 .

[70]  Sumio Ohno,et al.  Analysis and synthesis of fundamental frequency contours of Standard Chinese using the command-response model , 2005, Speech Commun..

[71]  J. Kelso Phase transitions and critical behavior in human bimanual coordination. , 1984, The American journal of physiology.

[72]  Ying Wai Wong,et al.  CONSONANTAL PERTURBATION OF F 0 CONTOURS OF CANTONESE TONES , 2007 .

[73]  Elliot Saltzman,et al.  The dynamical perspectives on speech production: Data and theory , 1986 .

[74]  D. Abercrombie,et al.  Elements of General Phonetics , 1967 .

[75]  Guy Deutscher The rise and fall of a rogue relative construction , 2001 .

[76]  D. Robert Ladd,et al.  On the phonetics and phonology of "segmental anchoring" of F0: evidence from German , 2004, J. Phonetics.

[77]  Brigitte Jacobsen The Question of 'Stress' in West Greenlandic: An Acoustic Investigation of Rhythmicization, Intonation, and Syllable Weight , 2000, Phonetica.

[78]  Yi Xu Contextual tonal variations in Mandarin , 1997 .

[79]  I. Lehiste,et al.  Role of duration in disambiguating syntactically ambiguous sentences , 1975 .

[80]  Mary E. Beckman,et al.  The Parsing of Prosody , 1996 .

[81]  I. Lehiste The Timing of Utterances and Linguistic Boundaries , 1972 .

[82]  Y Xu,et al.  Consistency of Tone-Syllable Alignment across Different Syllable Structures and Speaking Rates , 1998, Phonetica.

[83]  Robert F. Port,et al.  Meter and speech , 2003, J. Phonetics.

[84]  M. Turvey,et al.  Phase transitions and critical fluctuations in the visual coordination of rhythmic movements between people. , 1990 .

[85]  Esther Janse,et al.  Word perception in fast speech: artificially time-compressed vs. naturally produced fast speech , 2004, Speech Commun..

[86]  Peter Bell,et al.  Proceedings of Speech Prosody 2006 , 2006 .

[87]  Klaus J. Kohler,et al.  Timing and Communicative Functions of Pitch Contours , 2005, Phonetica.

[88]  Bernard Bloch Studies in Colloquial Japanese IV Phonemics , 1950 .

[89]  L Saltzman Elliot,et al.  A Dynamical Approach to Gestural Patterning in Speech Production , 1989 .