Automatic assessment of oral reading fluency for Spanish speaking ELs

This article presents an approach to the automatic assessment of the oral reading fluency (ORF) of children in Spain who are learning to read English. We compared different acoustic modeling configurations and adaptation methods to determine the most accurate means of estimating reliable children’s oral reading fluency scores using the standard metric of words correct per minute (WCPM). We addressed the problem of identifying word errors by extracting a series of features in order to learn how the human experts are actually annotating individual words. Experimental results show that the difference between WCPM scores produced by the proposed system and two human judges on the same text is smaller than the average difference between the scores produced by the two judges. In addition, the system scored individual words in texts as correctly or incorrectly read with an accuracy similar to that of human annotators.

[1]  Jian Cheng,et al.  Towards accurate recognition for children's oral reading fluency , 2010, 2010 IEEE Spoken Language Technology Workshop.

[2]  Linda Adkins Ford,et al.  The Relationship of Dynamic Indicators of Basic Early Literacy Skills (DIBELS) Oral Reading Fluency and the Terra Nova, 2nd Ed. Performance on Ohio Grade 3 Reading Achievement Assessment , 2008 .

[3]  David Allbritton,et al.  Tutoring Bilingual Students with an Automated Reading Tutor that Listens , 2007 .

[4]  D. Langenberg Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction , 2000 .

[5]  Abeer Alwan,et al.  Pronunciation variations of Spanish-accented English spoken by young children , 2005, INTERSPEECH.

[6]  Hermann Ney,et al.  Confidence measures for large vocabulary continuous speech recognition , 2001, IEEE Trans. Speech Audio Process..

[7]  Tanja Schultz,et al.  Comparison of acoustic model adaptation techniques on non-native speech , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[8]  Jack Mostow,et al.  Why and How Our Automated Reading Tutor Listens , 2012 .

[9]  R. Cole,et al.  THE OGI KIDS’ SPEECH CORPUS AND RECOGNIZERS , 2000 .

[10]  Kalika Bali,et al.  Enhancing ESL education in India with a reading tutor that listens , 2010, ACM DEV '10.

[11]  Albert T. Corbett,et al.  Evaluation of an Automated Reading Tutor That Listens: Comparison to Human Tutoring and Classroom Instruction , 2003 .

[12]  Michelle K. Hosp,et al.  Oral Reading Fluency as an Indicator of Reading Competence: A Theoretical, Empirical, and Historical Analysis , 2001 .

[13]  JAN HASBROUCK,et al.  636 スライディングモード補償機能を用いた振動抑制のための高速・高精度位置制御 , 2009 .

[14]  Daniel Jurafsky,et al.  Limitations of MLLR adaptation with Spanish-accented English: an error analysis , 2006, INTERSPEECH.

[15]  Mark R. Shinn,et al.  Advanced applications of curriculum-based measurement , 1998 .

[16]  Alicia Sandman,et al.  Dynamic indicators of basic early literacy skills , 2010 .

[17]  Ronald A. Cole,et al.  FLORA: Fluent oral reading assessment of children's speech , 2011, TSLP.

[18]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[19]  Ronald A. Cole,et al.  Automatic assessment of expressive oral reading , 2013, Speech Commun..