FLORA: Fluent oral reading assessment of children's speech

We present initial results of FLORA, an accessible computer program that uses speech recognition to provide an accurate measure of children's oral reading ability. FLORA presents grade-level text passages to children, who read the passages out loud, and computes the number of words correct per minute (WCPM), a standard measure of oral reading fluency. We describe the main components of the FLORA program, including the system architecture and the speech recognition subsystems. We compare results of FLORA to human scoring on 783 recordings of grade level text passages read aloud by first through fourth grade students in classroom settings. On average, FLORA WCPM scores were within 3 to 4 words of human scorers across students in different grade levels and schools.

[1]  S. Jay Samuels,et al.  Reading Fluency: Its Development and Assessment , 2002 .

[2]  J. B. Wyman,et al.  What is reading ability , 1921 .

[3]  M W Lovett,et al.  A developmental approach to reading disability: accuracy and speed criteria of normal and deficient reading skill. , 1987, Child development.

[4]  Dc Washington.  National Reading Panel. , 2000 .

[5]  P. Accardo,et al.  Specific Reading Disability: A View of the Spectrum. , 1998 .

[6]  S. Vaughn,et al.  A Synthesis of Research on Effective Interventions for Building Reading Fluency with Elementary Students with Learning Disabilities , 2002, Journal of learning disabilities.

[7]  R. Cole,et al.  THE OGI KIDS’ SPEECH CORPUS AND RECOGNIZERS , 2000 .

[8]  David Allbritton,et al.  Tutoring Bilingual Students with an Automated Reading Tutor that Listens , 2007 .

[9]  Jack Mostow,et al.  Automated Assessment of Oral Reading Prosody , 2009, AIED.

[10]  Peter A. Schreiber,et al.  On the Acquisition of Reading Fluency , 1980 .

[11]  Bryan L. Pellom,et al.  Advances in children's speech recognition with application to interactive literacy tutors , 2006 .

[12]  Jack Mostow,et al.  Automatically Assessing Oral Reading Fluency in a Computer Tutor that Listens , 2004 .

[13]  Deborah C. Simmons,et al.  The Importance and Decision-Making Utility of a Continuum of Fluency-Based Indicators of Foundational Reading Skills for Third-Grade High-Stakes Outcomes , 2001 .

[14]  D. Langenberg.  Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction , 2000 .

[15]  Linda Adkins Ford,et al.  The Relationship of Dynamic Indicators of Basic Early Literacy Skills (DIBELS) Oral Reading Fluency and the Terra Nova, 2nd Ed. Performance on Ohio Grade 3 Reading Achievement Assessment , 2008 .

[16]  Peter Graf,et al.  Implicit Memory: It Is Prime Time@@@Implicit Memory: New Directions in Cognition, Development, and Neuropsychology , 1995 .

[17]  R. Emde,et al.  Early Identification of Children at Risk , 1985, Topics in Developmental Psychobiology.

[18]  Ronald A. Cole,et al.  Highly accurate children's speech recognition for interactive reading tutors using subword units , 2007, Speech Commun..

[19]  Timothy V. Rasinski,et al.  Speed Does Matter in Reading. , 2000 .

[20]  Shrikanth S. Narayanan,et al.  Automatic detection and classification of disfluent reading miscues in young children's speech for the purpose of assessment , 2007, INTERSPEECH.

[21]  Mark R. Shinn,et al.  Advanced applications of curriculum-based measurement , 1998 .

[22]  Alicia Sandman,et al.  Dynamic indicators of basic early literacy skills , 2010 .

[23]  Shrikanth S. Narayanan,et al.  Estimation of children's reading ability by fusion of automatic pronunciation verification and fluency detection , 2008, INTERSPEECH.

[24]  L. Fuchs,et al.  Sources of Individual Differences in Reading Comprehension and Reading Fluency. , 2003 .

[25]  Ronald A. Cole,et al.  Advances in Children's Speech Recognition within an Interactive Literacy Tutor , 2004, HLT-NAACL.

[26]  Peter A. Schreiber,et al.  Understanding Prosody's Role in Reading Acquisition , 1991 .

[27]  Albert T. Corbett,et al.  Evaluation of an Automated Reading Tutor That Listens: Comparison to Human Tutoring and Classroom Instruction , 2003 .

[28]  Jack Mostow,et al.  The Sounds of Silence: Towards Automated Evaluation of Student Learning in a Reading Tutor that Listens , 1997, AAAI/IAAI.

[29]  Li Deng,et al.  Efficient and Robust Language Modeling in an Automatic Children's Reading Tutor System , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[30]  John Sabatini,et al.  Automatic Scoring of Children's Read-Aloud Text Passages and Word Lists , 2009, BEA@NAACL.

[31]  G. Tindal,et al.  Oral Reading Fluency Norms: A Valuable Assessment Tool for Reading Teachers , 2006 .

[32]  S. Jay Samuels,et al.  Toward a theory of automatic information processing in reading , 1974 .

[33]  William H. Rupley,et al.  Exploration of the Developmental Components Contributing to Elementary School Children's Reading Comprehension , 1998 .

[34]  Roxanne F. Hudson,et al.  Reading Fluency : Critical Issues for Struggling Readers , 2007 .

[35]  Timothy V. Rasinski,et al.  Research and Practice: Making a Place for Fluency Instruction in the Regular Reading Curriculum. , 1989 .

[36]  B. Levy,et al.  Fluent rereading: Repetition, automaticity, and discrepancy. , 1992 .

[37]  Donald L. Compton,et al.  Speed of word recognition as a distinguishing characteristic of reading disabilities , 1994 .

[38]  Timothy V. Rasinski,et al.  Fluency for Everyone: Incorporating Fluency Instruction in the Classroom. , 1989 .

[39]  Maryanne Wolf,et al.  What time may tell: Towards a new conceptualization of developmental dyslexia , 1999 .

[40]  Michelle K. Hosp,et al.  Oral Reading Fluency as an Indicator of Reading Competence: A Theoretical, Empirical, and Historical Analysis , 2001 .

[41]  Steven A. Stahl,et al.  Fluency: A review of developmental and remedial practices. , 2003 .