An ASR-based Reading Tutor for Practicing Reading Skills in the First Grade: Improving Performance through Threshold Adjustment

Automatic Speech Recognition (ASR) technology can potentially be employed to provide intensive practice and feedback to young children learning to read. So far there has been limited research on the use of ASR in the early stages of learning to read when children are still developing decoding skills. For this purpose, we developed an ASR-based system equipped with logging capabilities that can evaluate decoding skills in Dutch first graders reading aloud and provide them with instantaneous feedback. In a previous study we found that ASR-based feedback led to improved reading accuracy and speed, and that useful information could be obtained from the log-files. For the present paper we conducted thorough analyses of the data obtained with this ASR-based system by comparing it to human annotations of the same read aloud 11849 words from 38 pupils. We present the results of our analyses, and discuss how they can contribute to better and more personalized ASR-based reading instruction.

[1]  D. Powers.  Evaluation: From Precision, Recall and F-Factor to ROC, Informedness, Markedness & Correlation , 2008 .

[2]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[3]  Helmer Strik,et al.  The goodness of pronunciation algorithm: a detailed performance study , 2009, SLaTE.

[4]  Jon Shapiro,et al.  Speech Recognition Software Contributes to Reading Development for Young Learners of English , 2015, Int. J. Comput. Assist. Lang. Learn. Teach..

[5]  M P Black,et al.  Automatic Prediction of Children's Reading Ability for High-Level Literacy Assessment , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[6]  Hugo Van hamme,et al.  Automatic assessment of children's reading level , 2007, INTERSPEECH.

[7]  Thomas Hain,et al.  Improved Acoustic Modelling for Automatic Literacy Assessment of Children , 2018, INTERSPEECH.

[8]  Sarel van Vuuren,et al.  Learning to Read with a Virtual Tutor : Foundations to Literacy , 2004 .

[9]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[10]  Jack Mostow,et al.  Computer-Guided Oral Reading versus Independent Practice: Comparison of Sustained Silent Reading to an Automated Reading Tutor That Listens , 2013 .

[11]  Leen Cleuren.  Elements of Speech Technology Based Reading Assessment and Intervention , 2009 .

[12]  Abeer Alwan,et al.  Assessment of emerging reading skills in young native speakers and language learners , 2009, Speech Commun..

[13]  K. Rastle,et al.  Ending the Reading Wars: Reading Acquisition From Novice to Expert , 2018, Psychological science in the public interest : a journal of the American Psychological Society.

[14]  Joris Pelemans,et al.  Automatic assessment of children's reading with the FLaVoR decoding using a phone confusion model , 2014, INTERSPEECH.

[15]  Helmer Strik,et al.  ASR-Based Evaluation and Feedback for Individualized Reading Practice , 2020, INTERSPEECH.

[16]  Abeer Alwan,et al.  A System for Technology Based Assessment of Language and Literacy in Young Children: the Role of Multiple Information Sources , 2007, 2007 IEEE 9th Workshop on Multimedia Signal Processing.

[17]  Hugo Van hamme,et al.  Developing a reading tutor: Design and evaluation of dedicated speech recognition and synthesis modules , 2009, Speech Commun..

[18]  David J. Chard,et al.  Fluency: Bridge Between Decoding and Reading Comprehension , 2005 .