Listeners use temporal information to identify French- and English-accented speech

Duration transplantation isolates temporal features of foreign-accented German.Listeners use them to identify French- and English-accented German.An additive trend is observed when temporal and spectral cues are combined.Listeners are biased towards 'French' when stimuli feature uvular /r/. Which acoustic cues can be used by listeners to identify speakers' linguistic origins in foreign-accented speech? We investigated accent identification performance in signal-manipulated speech, where (a) Swiss German listeners heard native German speech to which we transplanted segment durations of French-accented German and English-accented German, and (b) Swiss German listeners heard 6-band noise-vocoded French-accented and English-accented German speech to which we transplanted native German segment durations. Therefore, the foreign accent cues in the stimuli consisted of only temporal information (in a) and only strongly degraded spectral information (in b). Findings suggest that listeners were able to identify the linguistic origin of French and English speakers in their foreign-accented German speech based on temporal features alone, as well as based on strongly degraded spectral features alone. When comparing these results to previous research, we found an additive trend of temporal and spectral cues: identification performance tended to be higher when both cues were present in the signal. Acoustic measures of temporal variability could not easily explain the perceptual results. However, listeners were drawn towards some of the native German segmental cues in condition (a), which biased responses towards 'French' when stimuli featured uvular /r/s and towards 'English' when they contained vocalized /r/s or lacked /r/.

[1]  D. Povel,et al.  The effect of segmental and suprasegmental corrections on the intelligibility of deaf speech. , 1985, The Journal of the Acoustical Society of America.

[2]  Tracey M. Derwing,et al.  Detection of nonnative speaker status from content-masked speech , 2010, Speech Commun..

[3]  Laurence White,et al.  Utterance-Final Lengthening Is Predictive of Infants' Discrimination of English Accents. , 2014 .

[4]  O. Köster,et al.  The tell-tale accent: Identification of regionally marked speech in German telephone conversations by forensic phoneticians , 2012 .

[5]  F. Ramus,et al.  Correlates of linguistic rhythm in the speech signal , 1999, Cognition.

[6]  Jong Kyoung Kim,et al.  Speech recognition , 1983, 1983 IEEE International Solid-State Circuits Conference. Digest of Technical Papers.

[7]  V. Dellwo.  Rhythm and Speech Rate: A Variation Coefficient for deltaC , 2006 .

[8]  D. Bates,et al.  Linear Mixed-Effects Models using 'Eigen' and S4 , 2015 .

[9]  Martine Adda-Decker,et al.  Characterisation and identi cation of non-native French accents , 2012 .

[10]  Ingrid Hove,et al.  Die Aussprache der Standardsprache in der deutschen Schweiz , 2002 .

[11]  Stanley Ellis.  The Yorkshire Ripper enquiry: Part I , 2013 .

[12]  Cédric Gendrot,et al.  Role of segmental and suprasegmental cues in the perception of maghrebian-acented French , 2004, INTERSPEECH.

[13]  Reinhold Kliegl,et al.  Experimental Effects and Individual Differences in Linear Mixed Models: Estimating the Relationship between Spatial, Object, and Attraction Effects in Visual Attention , 2010, Front. Psychology.

[14]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[15]  W. Donaldson.  Measuring recognition memory. , 1992, Journal of experimental psychology. General.

[16]  R. Port,et al.  Cross-Language Phonetic Interference: Arabic to English , 1981 .

[17]  François Pellegrino,et al.  Rhythm in read british English: interdialect variability , 2004, INTERSPEECH.

[18]  A. James.  Gerald Knowles, Patterns of Spoken English. London & New York: Longman, 1987. Pp. xi + 262. ISBN 0-582-29132-1. £9.95. , 1990, Journal of the International Phonetic Association.

[19]  Martine Adda-Decker,et al.  Foreign and regional accents in French. Characterisation and identification , 2008, Trait. Autom. des Langues.

[20]  J. Mehler,et al.  Language discrimination by newborns: toward an understanding of the role of rhythm. , 1998, Journal of experimental psychology. Human perception and performance.

[21]  Evelyn Abberton,et al.  Rhythmical classification of languages based on voice parameters , 2007 .

[22]  F. Ramus,et al.  Language identification with suprasegmental cues: a study based on speech resynthesis. , 1999, The Journal of the Acoustical Society of America.

[23]  Barbara Schuppler,et al.  How stable are acoustic metrics of contrastive speech rhythm? , 2010, The Journal of the Acoustical Society of America.

[24]  P. Delattre.  A COMPARISON OF SYLLABLE LENGTH CONDITIONING AMONG LANGUAGES , 1966 .

[25]  Rosina Lippi.  English with an Accent: Language, Ideology and Discrimination in the United States , 1997 .

[26]  吉島 茂,et al.  文化と言語の多様性の中のCommon European Framework of Reference for Languages: Learning, teaching, assessment (CEFR)--それは基準か? (第10回明海大学大学院応用言語学研究科セミナー 講演) , 2008 .

[27]  Adrian Leemann,et al.  Foreign accent recognition based on temporal information contained in lowpass-filtered speech , 2014, INTERSPEECH.

[28]  J. van Santen,et al.  Suprasegmental and segmental timing models in Mandarin Chinese and American English. , 2000, The Journal of the Acoustical Society of America.

[29]  J. Hansen,et al.  A STUDY OF TEMPORAL FEATURES AND FREQUENCY CHARACTERISTICS IN AMERICAN ENGLISH FOREIGN ACCENT , 1997 .

[30]  T. Sanders,et al.  The Perception of Fluency in Native and Nonnative Speech , 2014 .

[31]  Marie-José Kolly,et al.  Cues to linguistic origin: The contribution of speech temporal information to foreign accent recognition , 2014, J. Phonetics.

[32]  J. Flege.  The detection of French accent by American listeners. , 1984, The Journal of the Acoustical Society of America.

[33]  Helen Fraser,et al.  The role of ‘educated native speakers’ in providing language analysis for the determination of the origin of asylum seekers , 2009 .

[34]  Laurence White,et al.  Rhythmic typology and variation in first and second languages , 2007 .

[35]  Snefrid Holm,et al.  Intonational and durational contributions to the perception of foreign-accented Norwegian: An experimental phonetic investigation , 2008 .

[36]  Jan H. Hulstijn,et al.  Second language fluency: speaking style or proficiency? Correcting measures of second language fluency for first language behavior , 2015 .

[37]  Helmer Strik,et al.  Quantitative assessment of second language learners' fluency , 2000 .

[38]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[39]  W. Baker,et al.  LEARNING SECOND LANGUAGE SUPRASEGMENTALS: Effect of L2 Experience on Prosody and Fluency Characteristics of L2 Speech , 2006, Studies in Second Language Acquisition.

[40]  V. Hazan,et al.  Perception and Production of a Voicing Contrast by French-English Bilinguals , 1993 .

[41]  Hermann J. Künzel,et al.  Beware of the ‘telephone effect’: the influence of telephone transmission on the measurement of formant frequencies , 2001 .

[42]  Adrian Leemann,et al.  Speaker idiosyncratic rhythmic features in the speech signal , 2012, INTERSPEECH.

[43]  R. M. Dauer.  Stress-timing and syllable-timing reanalyzed. , 1983 .

[44]  Robert F. Port,et al.  Effects of temporal correction on intelligibility of foreign-accented English , 1997 .

[45]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[46]  Carlos Gussenhoven,et al.  Durational variability in speech and the Rhythm Class Hypothesis , 2002 .

[47]  Rheinischen Friedrich-Wilhelms-Universität.  Influences of speech rate on the acoustic correlates of speech rhythm: An experimental phonetic study based on acoustic and perceptual evidence , 2010 .

[48]  B. Rossion,et al.  Fixation Patterns During Recognition of Personally Familiar and Unfamiliar Faces , 2010, Front. Psychology.

[49]  Adrian Leemann,et al.  Speaker-individuality in suprasegmental temporal features: Implications for forensic voice comparison. , 2014, Forensic science international.

[50]  Lennart Nord,et al.  Durational correlates of stress in Swedish, French and English* , 1991 .

[51]  Giovanna Marotta,et al.  Contribution of Prosody to the Perception of Spanish/Italian Accents , 2004 .

[52]  V. Dellwo,et al.  Rhythmic variability in Swiss German dialects , 2012 .

[53]  WintersStephen,et al.  Perceived accentedness and intelligibility , 2013 .

[54]  Christiane Laeufer,et al.  Patterns of voicing-conditioned vowel duration in French and English , 1992 .

[55]  Sara Neuhauser,et al.  Foreign Accent Imitation and Variation of VOT and Voicing in Plosives , 2011, ICPhS.

[56]  Susan Robinson,et al.  German , 2006 .

[57]  M. Ordin,et al.  Acquisition of speech rhythm in a second language by learners with rhythmically different native languages. , 2015, The Journal of the Acoustical Society of America.

[58]  James Emil Flege,et al.  The influence of L1 on the acquisition of Swedish quantity by native speakers of Spanish, English and Estonian , 2002, J. Phonetics.

[59]  Matthew H. Davis,et al.  Lexical information drives perceptual learning of distorted speech: evidence from the comprehension of noise-vocoded sentences. , 2005, Journal of experimental psychology. General.

[60]  Paul Foulkes,et al.  The ?Mobile Phone Effect? on Vowel Formants , 2004 .

[61]  Nelson Morgan,et al.  Long-Term Temporal Features for Conversational Speech Recognition , 2004, MLMI.

[62]  Sam Tilsena,et al.  Speech rhythm analysis with decomposition of the amplitude envelope: Characterizing rhythmic patterns within and across languages , 2013 .

[63]  Karen Earline Schairer.  Native Speaker Reaction to Non-Native Speech. , 1992 .

[64]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[65]  Adrian Leemann,et al.  Speaker-idiosyncrasy in pausing behavior: Evidence from a cross-linguistic study , 2015, ICPhS.

[66]  M. J. Osberger,et al.  The effect of timing errors on the intelligibility of deaf children's speech. , 1978, The Journal of the Acoustical Society of America.

[67]  Susanne Uhmann,et al.  Silben- und akzentzählende Sprachen: Literaturüberblick und Diskussion , 1988 .

[68]  L. Rognoni,et al.  Testing the Effects of Segmental and Suprasegmental Phonetic Cues in Foreign Accent Rating: An Experiment Using Prosody Transplantation , 2014 .

[69]  Adrian Leemann,et al.  Rhythmic variability between speakers: articulatory, prosodic, and linguistic factors. , 2015, The Journal of the Acoustical Society of America.

[70]  K. Pike,et al.  The intonation of American English , 1946 .

[71]  Rosina L. Lippi-Green.  English with an Accent: Language, Ideology and Discrimination in the United States , 1997 .

[72]  O. Engstrand,et al.  Perceived Strength and Identity of Foreign Accent in Swedish , 1989, Phonetica.

[73]  Stephen Winters,et al.  Perceived accentedness and intelligibility: The relative contributions of F0 and duration , 2013, Speech Commun..

[74]  D. Abercrombie,et al.  Elements of General Phonetics , 1967 .

[75]  Hermann J. Künzel.  Some general phonetic and forensic aspects of speaking tempo , 2013 .

[76]  Royston Goodacre,et al.  Characterisation and identification of bacteria using SERS. , 2008, Chemical Society reviews.

[77]  A. L. James.  Historical introduction to French phonetics , 1968 .

[78]  Gottfried Kolde,et al.  Sprachkontakte in gemischtsprachigen Städten : vergleichende Untersuchungen über Voraussetzungen und Formen sprachlicher Interaktion verschiedensprachiger Jugendlicher in den Schweizer Städten Biel/Bienne und Fribourg/Freiburg i. Ue. , 1983 .

[79]  Volker Dellwo,et al.  The role of speech rate in perceiving speech rhythm , 2008, Speech Prosody 2008.

[80]  T. Cambier-Langeveld.  The role of linguists and native speakers in language analysis for the determination of speaker origin , 2010 .

[81]  Stephan Schmid.  The pronunciation of voiced obstruents in L2 French: A preliminary study of Swiss German learners , 2012 .

[82]  Hugo Quené,et al.  Non-native durational patterns decrease speech intelligibility , 2010, Speech Commun..

[83]  Philippe Boula de Mareüil,et al.  The Contribution of Prosody to the Perception of Foreign Accent , 2006, Phonetica.

[84]  R V Shannon,et al.  Speech Recognition with Primarily Temporal Cues , 1995, Science.

[85]  P. Iverson,et al.  Talker-listener accent interactions in speech-in-noise recognition: effects of prosodic manipulation as a function of language experience. , 2010, The Journal of the Acoustical Society of America.

[86]  A. D. Meo,et al.  An acoustic-perceptual approach to the prosody of Chinese and native speakers of Italian based on yes/no questions , 2014 .

[87]  F. Ramus,et al.  The psychological reality of rhythm classes: Perceptual studies , 2003 .

[88]  W R TIFFANY,et al.  Nonrandom sources of variation in vowel quality. , 1959, Journal of speech and hearing research.

[89]  Laurence White,et al.  Calibrating rhythm: First language and second language studies , 2007, J. Phonetics.

[90]  In memoriam: Sheldon Rosenberg, Founding Editor , 2013, Applied Psycholinguistics.

[91]  Amalia Arvaniti,et al.  The usefulness of metrics in the quantification of speech rhythm , 2012, J. Phonetics.

[92]  Anna Hjalmarsson,et al.  The additive effect of turn-taking cues in human and synthetic voice , 2011, Speech Commun..

[93]  Laurence White,et al.  Acquiring rhythm: A comparison of L1 and L2 speakers of Canadian English and Japanese , 2008 .

[94]  Liang Li,et al.  Human auditory cortex activity shows additive effects of spectral and spatial cues during speech segregation. , 2011, Cerebral cortex.

[95]  P. Mermelstein.  Automatic segmentation of speech into syllabic units. , 1975, The Journal of the Acoustical Society of America.

[96]  Laurence White,et al.  Language categorization by adults is based on sensitivity to durational cues, not rhythm class , 2012 .

[97]  R. Zatorre,et al.  Where is 'where' in the human auditory cortex? , 2002, Nature Neuroscience.

[98]  L. Boves,et al.  Quantitative assessment of second language learners' fluency: comparisons between read and spontaneous speech. , 2002, The Journal of the Acoustical Society of America.