Automatically Assessing Oral Reading Fluency in a Computer Tutor that Listens

Much of the power of a computer tutor comes from its ability to assess students. In some domains, including oral reading, assessing the proficiency of a student is a challenging task for a computer. Our approach for assessing student reading proficiency is to use data that a computer tutor collects through its interactions with a student to estimate his performance on a human-administered test of oral reading fluency. A model with data collected from the tutor’s speech recognizer output correlated, within-grade, at 0.78 on average with student performance on the fluency test. For assessing students, data from the speech recognizer were more useful than student help-seeking behavior. However, adding help-seeking behavior increased the average within-grade correlation to 0.83. These results show that speech recognition is a powerful source of data about student performance, particularly for reading.

[1]  H. Kersey,et al.  A Comparison of Seminole Reading Vocabulary and the Dolch Word Lists. Project Report III. , 1971 .

[2]  Jack Mostow,et al.  Predicting Student Help-Request Behavior in an Intelligent Tutor for Reading , 2003, User Modeling.

[3]  Satanjeev Banerjee,et al.  Evaluating the effect of predicting oral reading miscues , 2003, INTERSPEECH.

[4]  Mei-Yuh Hwang,et al.  The SPHINX-II speech recognition system: an overview , 1993, Comput. Speech Lang..

[5]  Jack Mostow,et al.  Assessing Student Proficiency in a Reading Tutor That Listens , 2003, User Modeling.

[6]  E. W. Dolch,et al.  A Basic Sight Vocabulary , 1936, The Elementary School Journal.

[7]  Jack Mostow,et al.  A La Recherche du Temps Perdu, or As Time Goes By: Where Does the Time Go in a Reading Tutor That Listens? , 2002, Intelligent Tutoring Systems.

[8]  R. Glaser,et al.  Knowing What Students Know: The Science and Design of Educational Assessment , 2001 .

[9]  L. Crocker,et al.  Introduction to Classical and Modern Test Theory , 1986 .

[10]  Geoffrey I. Webb,et al.  Evaluation of Data Aging: A Technique for Discounting Old Data During Student Modeling , 1998, Intelligent Tutoring Systems.

[11]  Jack Mostow,et al.  Improving Story Choice in a Reading Tutor that Listens , 2000, Intelligent Tutoring Systems.

[12]  Frank B. May Reading As Communication: To Help Children Write and Read , 1997 .

[13]  John R. Anderson,et al.  Cognitive Modeling and Intelligent Tutoring , 1990, Artif. Intell..

[14]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[15]  Jack Mostow,et al.  Viewing and analyzing multimodal human-computer tutorial dialogue: a database approach , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[16]  J. L. De Soto,et al.  Relationship of reading achievement to verbal processing abilities. , 1983, Journal of educational psychology.

[17]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[18]  Jack Mostow,et al.  A Prototype Reading Coach that Listens , 1994, AAAI.

[19]  Jack Mostow,et al.  Evaluating tutors that listen: an overview of project LISTEN , 2001 .

[20]  James W. Pellegrino,et al.  Knowing What Students Know. , 2003 .

[21]  Jack Mostow,et al.  The Sounds of Silence: Towards Automated Evaluation of Student Learning in a Reading Tutor that Listens , 1997, AAAI/IAAI.