Towards an Automatic Oral Proficiency Test for Dutch as a Second Language: Automatic Pronunciation Assessment in Read and Spontaneous Speech

This paper describes two experiments aimed at exploring the relationship between objective properties of speech and perceived pronunciation quality in read and spontaneous speech, with a view to determining whether such quantitative measures can be used to develop objective pronunciation tests. Read and spontaneous speech of two groups of 60 learners of Dutch as a second language was scored for pronunciation quality by human raters and was analyzed by means of a continuous speech recognizer to calculate six quantitative measures of speech quality related to speech timing. The results show that quantitative, temporal measures of speech are strongly related to pronunciation quality, in both read and spontaneous speech, although not all variables suitable for measuring pronunciation quality in read speech are as effective in spontaneous speech. In particular, measures that express the rate at which sounds are produced without taking the frequency and distribution of pauses into account appear to be unsuitable for measuring pronunciation quality in spontaneous speech.

[1]  H. Riggenbach.  Toward an understanding of fluency: A microanalysis of nonnative speaker conversations , 1991 .

[2]  Mitch Weintraub,et al.  Automatic text-independent pronunciation scoring of foreign language student speech , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[3]  Lou Boves,et al.  Different aspects of expert pronunciation quality ratings and their relation to scores produced by speech recognition algorithms , 2000, Speech Commun..

[4]  Barbara F. Freed.  What makes us think that students who study abroad become fluent , 1995 .

[5]  Francine Chambers,et al.  What do we mean by fluency , 1997 .

[6]  Helmer Strik,et al.  Using speech recognition technology to assess foreign speakers' pronunciation of Dutch , 1997 .

[7]  F. Goldman-Eisler.  Psycholinguistics: Experiments in spontaneous speech , 1968 .

[8]  Barbara F. Freed.  Second language acquisition in a study abroad context , 1995 .

[9]  L. Boves,et al.  Quantitative assessment of second language learners' fluency by means of automatic speech recognition technology. , 2000, The Journal of the Acoustical Society of America.

[10]  Hans W. Dechert,et al.  Towards a cross-linguistic assessment of speech production , 1980 .

[11]  Yoon Kim,et al.  Automatic pronunciation scoring for language instruction , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  Mitch Weintraub,et al.  Automatic evaluation and training in English pronunciation , 1990, ICSLP.