The distribution of pitch patterns and communicative types in speech-chunks preceding pauses and gaps

As part of a broader study of voice prosody in speech communication, this paper looks at intonation in turn-taking. It examines the distribution of pitch patterns and communicative types in the interpausal units (IPUs) preceding pause or gap silences extracted from a corpus of spontaneous speech of Irish English. IPUs preceding speaker change (‘Gaps’) and IPUs preceding silence where the same speaker continues talking (‘Pauses’) were selected in the course of automatic extraction of pause/gap silences in dyadic dialogue interactions. A listening test was conducted to establish ‘human predictable’ pause/gap data sets which were subsequently manually annotated in terms of pitch patterns and communicative types. Overall, the Gaps and Pauses subsets show differentiation in terms of both their communicative types and pitch tunes. Declaratives and Questions are mainly found in Gaps, whereas in Pauses we mainly find Hesitations and Incomplete Declaratives. Gaps are generally characterised by falling or rising pitch patterns, whereas in Pauses a large proportion of speech samples are realised with level pitch. Classification experiments reveal discrimination of pauses and gaps for both prosodic and functional annotation labels. Follow-up work aims to relate intonational characteristics of turn taking with voice quality and temporal dynamics, to provide a holistic view of the processes involved.

[1]  Jan-Peter de Holger N. J. Ruiter,et al.  Projecting the End of a Speaker's Turn: A Cognitive Cornerstone of Conversation , 2006 .

[2]  Institutionen för Tal Pitch and Lengthening as Cues to Turn Transition in Swedish , 2013 .

[3]  Julia Hirschberg,et al.  Turn-taking cues in task-oriented dialogue , 2011, Comput. Speech Lang..

[4]  Maxine Eskénazi,et al.  Optimizing Endpointing Thresholds using Dialogue Features in a Spoken Dialogue System , 2008, SIGDIAL Workshop.

[5]  K. J. Kohler Prosodic Boundary Signals in German , 1983 .

[6]  Vito Pirrelli,et al.  A recognition-based meta-scheme for dialogue acts annotation , 1999 .

[7]  Johanneke Caspers,et al.  Local speech melody as a limiting factor in the turn-taking system in Dutch , 2003, J. Phonetics.

[8]  Wonyong Sung,et al.  A statistical model-based voice activity detection , 1999, IEEE Signal Processing Letters.

[9]  Ailbhe Ní Chasaide,et al.  Analysing the prosodic characteristics of speech-chunks preceding silences in task-based interactions , 2014, INTERSPEECH.

[10]  Harry Bunt,et al.  Dimensions in Dialogue Act Annotation , 2006, LREC.

[11]  Irena Yanushevskaya,et al.  Pitch range declination and reset in turn-taking organisation , 2014 .

[12]  Klaus Krippendorff,et al.  Answering the Call for a Standard Reliability Measure for Coding Data , 2007 .

[13]  Mattias Heldner,et al.  Pauses, gaps and overlaps in conversations , 2010, J. Phonetics.

[14]  David Schlangen,et al.  From reaction to prediction: experiments with computational models of turn-taking , 2006, INTERSPEECH.

[15]  Richard Ogden Turn transition, creak and glottal stop in Finnish talk-in-interaction , 2001, Journal of the International Phonetic Association.

[16]  A. Kendon Some functions of gaze-direction in social interaction. , 1967, Acta psychologica.

[17]  B. Vaughan,et al.  Naturalistic Emotional Speech Corpora with Large Scale Emotional Dimension Ratings , 2011 .

[18]  Mattias Heldner,et al.  Exploring Prosody in Interaction Control , 2005, Phonetica.

[19]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 2015 .

[20]  S. Duncan,et al.  Some Signals and Rules for Taking Speaking Turns in Conversations , 1972 .

[21]  Amélie Rochet-Capellan,et al.  The interplay of linguistic structure and breathing in German spontaneous speech , 2013, INTERSPEECH.

[22]  Kôiti Hasida,et al.  ISO 24617-2: A semantically-based standard for dialogue annotation , 2012, LREC.

[23]  J. Local,et al.  Towards a phonology of conversation: turn-taking in Tyneside English , 1986, Journal of Linguistics.

[24]  Julia Hirschberg,et al.  Turn-Yielding Cues in Task-Oriented Dialogue , 2009, SIGDIAL Conference.

[25]  John Local,et al.  Projection and ‘silences’: Notes on phonetic and conversational structure , 1986 .

[26]  Andreas Stolcke,et al.  A prosody-based approach to end-of-utterance detection that does not require speech recognition , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[27]  Mattias Heldner,et al.  Prosodic features in the vicinity of pauses, gaps and overlaps , 2009 .

[28]  A. Ichikawa,et al.  An Analysis of Turn-Taking and Backchannels Based on Prosodic and Syntactic Features in Japanese Map Task Dialogs , 1998, Language and speech.

[29]  Heather Friedberg Turn-Taking Cues in a Human Tutoring Corpus , 2011, ACL.

[30]  Bengt Oreström Turn-taking in English conversation , 1983 .

[31]  Mattias Heldner,et al.  Utterance segmentation and turn-taking in spoken dialogue systems , 2005 .

[32]  Keith Johnson,et al.  Durational Patterning at Syntactic and Discourse Boundaries in Mandarin Spontaneous Speech , 2011, Language and speech.