Is ASR accurate enough for automated reading tutors, and how can we tell?

We discuss pros and cons of several ways to evaluate ASR accuracy in automated tutors that listen to students read aloud. Whether ASR is accurate enough for a particular reading tutor function depends on what ASR-based judgment it requires, the visibility of that judgment to students and teachers, and the amount of input speech on which it is based. How to tell depends on the purpose, criterion, and space of the evaluation.

[1]  Jack Mostow,et al.  Automatically Assessing Oral Reading Fluency in a Computer Tutor that Listens , 2004 .

[2]  Satanjeev Banerjee,et al.  Evaluating the effect of predicting oral reading miscues , 2003, INTERSPEECH.

[3]  Martin J. Russell,et al.  Applications of automatic speech recognition to speech and language development in young children , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[4]  Bryan L. Pellom,et al.  Children's speech recognition with application to interactive books and tutors , 2003, 2003 IEEE Workshop on Automatic Speech Recognition and Understanding (IEEE Cat. No.03EX721).

[5]  Sean Martin,et al.  Analysis and Detection of Reading Miscues for Interactive Literacy Tutors , 2004, COLING.

[6]  Mitch Weintraub,et al.  Automatic scoring of pronunciation quality , 2000, Speech Commun..

[7]  Ronald A. Cole,et al.  Advances in Children's Speech Recognition within an Interactive Literacy Tutor , 2004, HLT-NAACL.

[8]  Jack Mostow,et al.  Improving the Help Selection Policy in a Reading Tutor that Listens , 2004 .

[9]  David Allbritton,et al.  Tutoring Bilingual Students with an Automated Reading Tutor that Listens , 2007 .

[10]  Jack Mostow,et al.  The Sounds of Silence: Towards Automated Evaluation of Student Learning in a Reading Tutor that Listens , 1997, AAAI/IAAI.

[11]  Jack Mostow,et al.  A Prototype Reading Coach that Listens , 1994, AAAI.

[12]  Todd Cunningham.  The effect of reading remediation software on the language and literacy skill development of ESL students , 2006 .

[13]  Jack Mostow,et al.  4-month evaluation of a learner-controlled reading tutor that listens , 2008 .

[14]  Jack Mostow,et al.  Using a student model to improve a computer tutor ’ s speech recognition , 2005 .

[15]  Catherine M. Hombo,et al.  NAEP 1999 Trends in Academic Progress: Three Decades of Student Performance. , 2000 .

[16]  Jack Mostow,et al.  Giving Help and Praise in a Reading Tutor with Imperfect Listening--Because Automated Speech Recognition Means Never Being Able to Say You're Certain , 2013, CALICO Journal.

[17]  Emmett Albert Betts,et al.  Foundations of reading instruction : with emphasis on differentiated guidance , 1946 .

[18]  Albert T. Corbett,et al.  Evaluation of an Automated Reading Tutor That Listens: Comparison to Human Tutoring and Classroom Instruction , 2003 .

[19]  M. Adams.  The Promise of Automatic Speech Recognition for Fostering Literacy Growth in Children and Adults , 2006 .