Assessing objective characterizations of phonetic convergence

This paper focuses on the study of the convergence between characteristics of speech segments- i.e. spectral characteristics of speech sounds - during live interactions between speaking dyads. The interaction data has been collected using an original verbal game called 'verbal dominoes' that provides a dense sampling of the acoustic spaces of the interlocutors. Two methods for characterizing phonetic convergence are here compared. The first one is based on a fine-grained analysis of the spectra of central frames of vowels (LDA) while the second one uses a more global speaker recognition technique (LLR). We show that convergence rates calculated by the two techniques correlate as the number of dominoes increases and that the LDA method well resists to the decrease of training and test material. We finally comment the impact of several factors on the computed convergence rates, i.e. interlocutors' familiarity and sex pairs.

[1]  Jeffery A. Jones,et al.  The sensitivity of auditory-motor representations to subtle changes in auditory feedback while singing. , 2009, The Journal of the Acoustical Society of America.

[2]  Douglas A. Reynolds,et al.  Speaker identification and verification using Gaussian mixture speaker models , 1995, Speech Commun..

[3]  Masaaki Honda,et al.  Compensatory responses of articulators to unexpected perturbation of the palate shape , 2002, J. Phonetics.

[4]  Gérard Bailly,et al.  Speech dominoes and phonetic convergence , 2010, INTERSPEECH.

[5]  S. W. Gregory,et al.  Voice pitch and amplitude convergence as a metric of quality in dyadic interviews , 1993 .

[6]  Molly Babel.  Phonetic and social selectivity in speech accommodation , 2009 .

[7]  Charlie Cullen,et al.  Towards measuring continuous acoustic feature convergence in unconstrained spoken dialogues , 2008, INTERSPEECH.

[8]  Noël Nguyen,et al.  Automatic recognition of regional phonological variation in conversational interaction , 2010, Speech Commun..

[9]  Jean-François Bonastre,et al.  Mistral: open source biometric platform , 2010, SAC '10.

[10]  Michael I. Jordan,et al.  Sensorimotor adaptation in speech production. , 1998, Science.

[11]  Julia Hirschberg,et al.  Pause and gap length in face , 2009 .

[12]  H. Giles,et al.  Contexts of Accommodation: Developments in Applied Sociolinguistics , 2010 .

[13]  Nick Campbell,et al.  Listening between the lines : a study of paralinguistic information carried by tone-of-voice , 2004 .

[14]  C. Fowler,et al.  Gestural drift in a bilingual speaker of Brazilian Portuguese and English , 1997 .

[15]  Véronique Delvaux,et al.  The Influence of Ambient Speech on Adult Speech Productions through Unintentional Imitation , 2007, Phonetica.

[16]  Jennifer S. Pardo.  Expressing oneself in conversational interaction , 2009 .

[17]  Kristin J. Van Engen,et al.  The Wildcat Corpus of native- and foreign-accented English: communicative efficiency across conversational dyads with varying language alignment profiles. , 2007, Language and speech.

[18]  S. Furui,et al.  Cepstral analysis technique for automatic speaker verification , 1981 .

[19]  H. Giles,et al.  Speech Accommodation Theory: The First Decade and Beyond , 1987 .

[20]  Jeffery A. Jones,et al.  Perceptual calibration of F0 production: evidence from feedback perturbation. , 2000, The Journal of the Acoustical Society of America.

[21]  Ann R Bradlow,et al.  Phonetic convergence in spontaneous conversations as a function of interlocutor language distance. , 2011, Laboratory phonology.

[22]  V. Gracco,et al.  Perceptual recalibration of speech sounds following speech motor learning. , 2009, The Journal of the Acoustical Society of America.

[24]  Jennifer S. Pardo,et al.  Phonetic convergence in college roommates , 2012, J. Phonetics.

[25]  Gérard Bailly,et al.  Study of the Phenomenon of Phonetic Convergence Thanks to Speech Dominoes , 2010, COST 2102 Conference.

[26]  Stefan Benus.  Are we 'in sync': turn-taking in collaborative dialogues , 2009, INTERSPEECH.

[27]  L Jäncke,et al.  Mechanical Perturbation of Jaw Movements during Speech: Effects on Articulation and Phonation , 1995, Perceptual and motor skills.

[28]  David J. Ostry,et al.  Cross language phonetic influences on the speech of French-English bilinguals , 2008, J. Phonetics.

[29]  Alex Pentland,et al.  Honest Signals - How They Shape Our World , 2008 .

[30]  Jennifer S. Pardo,et al.  On phonetic convergence during conversational interaction. , 2006, The Journal of the Acoustical Society of America.