Computer-Guided Oral Reading versus Independent Practice: Comparison of Sustained Silent Reading to an Automated Reading Tutor That Listens

A 7-month study of 178 students in grades 1-4 at two Blue Ribbon schools compared two daily 20-minute treatments. Eighty-eight students used the 2000–2001 version of Project LISTEN's Reading Tutor (www.cs.cmu.edu/∼listen) in 10-computer labs, averaging 19 hours over the course of the year. The Reading Tutor served as a computerized implementation of the National Reading Panel's recommended guided oral reading instruction (NRP, 2000). The Reading Tutor listened to students read aloud, giving spoken and graphical help when it noticed them click for help, make a mistake, or get stuck. Students using the Reading Tutor averaged significantly higher gains across measures of reading ability, especially those involving word level skills (word identification, blending words, and spelling) than their matched classmates who spent that time doing Sustained Silent Reading (SSR) in their classrooms. Additionally, these students trended toward higher gains in fluency and reading comprehension. Overall, use of the Reading Tutor resulted in the types of improvement that would be expected from guided oral reading, but with the benefit of scalability, a problem for human-guided oral reading practice.

[1]  Robin Campbell,et al.  Hearing Children Read , 1988 .

[2]  Gregory Aist,et al.  Helping Children Learn Vocabulary during Computer-Assisted Oral Reading , 2000, J. Educ. Technol. Soc..

[3]  Jack Mostow,et al.  How Who Should Practice: Using Learning Decomposition to Evaluate the Efficacy of Different Types of Practice for Different Types of Students , 2008, Intelligent Tutoring Systems.

[4]  M. Adams.  Technology for Developing Children's Language and Literacy: , 2011 .

[5]  Jack Mostow,et al.  Authoring New Material in a Reading Tutor that Listens , 1999, AAAI/IAAI.

[6]  Jack Mostow,et al.  The Sounds of Silence: Towards Automated Evaluation of Student Learning in a Reading Tutor that Listens , 1997, AAAI/IAAI.

[7]  Jack Mostow,et al.  Improving child literacy in Africa: Experiments with an automated reading tutor , 2009, 2009 International Conference on Information and Communication Technologies and Development (ICTD).

[8]  Todd Cunningham.  The effect of reading remediation software on the language and literacy skill development of ESL students , 2006 .

[9]  Steve Gardiner,et al.  Ten Minutes a Day for Silent Reading. , 2001 .

[10]  Siddhartha Bhattacharyya,et al.  Information Sharing Strategies in Business-to-Business E-Hubs: An Agent-Based Study , 2010, Int. J. Intell. Inf. Technol..

[11]  L.T.W. Verhoeven,et al.  Interactive literacy education: facilitating literacy environments through technology , 2008 .

[12]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[13]  Jack Mostow.  Some Useful Design Tactics for Mining ITS Data , 2004 .

[14]  Jack Mostow,et al.  Automatically Assessing Oral Reading Fluency in a Computer Tutor that Listens , 2004 .

[15]  Jack Mostow,et al.  When do Students Interrupt Help? Effects of Time, Help Type, and Individual Differences , 2005, AIED.

[16]  J. Mitchell.  Comprehensive Test of Phonological Processing , 2001 .

[17]  Jack Mostow,et al.  Giving Help and Praise in a Reading Tutor with Imperfect Listening--Because Automated Speech Recognition Means Never Being Able to Say You're Certain , 2013, CALICO Journal.

[18]  David Allbritton,et al.  Tutoring Bilingual Students with an Automated Reading Tutor that Listens , 2007 .

[19]  Mark W. Lipsey,et al.  Empirical Benchmarks for Interpreting Effect Sizes in Research , 2008 .

[20]  Joseph E. Beck,et al.  Using learning decomposition to analyze student fluency development , 2005 .

[21]  Xiaonan ZHANG,et al.  All in the ( word ) family : Using learning decomposition to estimate transfer between skills in a Reading Tutor that listens , 2007 .

[22]  Albert T. Corbett,et al.  Does Help Help? Introducing the Bayesian Evaluation and Assessment Methodology , 2008, Intelligent Tutoring Systems.

[23]  James M. Leszczenski,et al.  What’s in a Word? Extending Learning Factors Analysis to Model Reading Transfer , 2007 .

[24]  M. Adams.  The Promise of Automatic Speech Recognition for Fostering Literacy Growth in Children and Adults , 2006 .

[25]  Cathy Collins.  Sustained Silent Reading Periods: Effect on Teachers' Behaviors and Students' Achievement , 1980, The Elementary School Journal.

[26]  Jack Mostow,et al.  A hands-on demonstration of Project LISTEN’s Reading Tutor and its embedded experiments , 2001 .

[27]  Jack Mostow,et al.  Viewing and analyzing multimodal human-computer tutorial dialogue: a database approach , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[28]  Joseph E. Beck,et al.  Does Learner Control Affect Learning? , 2007, AIED.

[29]  M. Lepper,et al.  Motivational techniques of expert human tutors: Lessons for the design of computer-based tutors. , 1993 .

[30]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[31]  Kalika Bali,et al.  Enhancing ESL education in India with a reading tutor that listens , 2010, ACM DEV '10.

[32]  Joseph K. Torgesen,et al.  Comprehensive Test of Phonological Processing , 1997 .

[33]  Jack Mostow,et al.  A La Recherche du Temps Perdu, or As Time Goes By: Where Does the Time Go in a Reading Tutor That Listens? , 2002, Intelligent Tutoring Systems.

[34]  Jack Mostow,et al.  4-month evaluation of a learner-controlled reading tutor that listens , 2008 .

[35]  Joseph E. Beck,et al.  Engagement tracing: using response times to model student disengagement , 2005, AIED.

[36]  Milos Cernak,et al.  Reading companion: the technical and social design of an automated reading tutor , 2012, WOCCI.

[37]  Jack Mostow,et al.  Evaluating tutors that listen: an overview of project LISTEN , 2001 .

[38]  D. Kear,et al.  Children's Attitudes toward Reading: A National Survey. , 1995 .

[39]  L. Jaffe.  Development, Interpretation, and Application of the W Score and the Relative Proficiency Index , 2010 .

[40]  Meliss Holland,et al.  The Path of Speech Technologies in Computer-Assisted Language Learning , 2007 .

[41]  Roberto Agodini,et al.  Effectiveness of Reading and Mathematics Software Products: Findings from Two Student Cohorts. Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education , 2009 .

[42]  Albert T. Corbett,et al.  Evaluation of an Automated Reading Tutor That Listens: Comparison to Human Tutoring and Classroom Instruction , 2003 .

[43]  Ronald A. Cole,et al.  Highly accurate children's speech recognition for interactive reading tutors using subword units , 2007, Speech Commun..

[44]  John Willinsky,et al.  Visibility and Quality in Spanish-Language Latin American Scholarly Publishing , 2010 .

[45]  Jack Mostow,et al.  A Prototype Reading Coach that Listens , 1994, AAAI.

[46]  Sarel van Vuuren,et al.  Learning to Read with a Virtual Tutor : Foundations to Literacy , 2004 .

[47]  Steven A. Stahl,et al.  Fluency: A review of developmental and remedial practices. , 2003 .

[48]  Jack Mostow,et al.  Predicting Student Help-Request Behavior in an Intelligent Tutor for Reading , 2003, User Modeling.

[49]  Darielle Greenberg.  Woodcock Reading Mastery Tests–Revised , 2014 .

[50]  Cynthia A. Jenik,et al.  Test of Written Spelling , 2005 .

[51]  Jack Mostow,et al.  Improving the Help Selection Policy in a Reading Tutor that Listens , 2004 .

[52]  Bethany J Figg,et al.  National Institute of Child Health and Human Development , 2013 .

[53]  J. Beck,et al.  When the Rubber Meets the Road : Lessons from the In-School Adventures of an Automated Reading Tutor That Listens 1 , 2003 .