An Exploration of Alternative Scoring Methods Using Curriculum-Based Measurement in Early Writing

This manuscript describes two empirical studies of alternative scoring procedures used with curriculum-based measurement in writing (CBM-W). Study 1 explored the technical adequacy of a trait-based rubric in first grade. Study 2 explored the technical adequacy of a trait-based rubric, production-dependent, and production-independent scores in third grade. Results of Study 1 suggest that the rubric holds promise as a valid measure of sentence writing ability in first grade and has utility as a supplemental scoring procedure when using CBM-W as a screening tool. Results of Study 2 show that correct word sequences maintained the highest correlation coefficients across time with the trait-based rubric, but the other scoring procedures might offer promise as reliable alternative scoring methods. However, high internal correlations among the text features of the rubric along with highly variable interrater reliability suggest that caution must be taken in interpreting results.

[1]  L. Gregg,et al.  Identifying the Organization of Writing Processes , 2016 .

[2]  E. Lembke,et al.  Examining the Technical Adequacy of Progress Monitoring Using Early Writing Curriculum-Based Measures , 2016 .

[3]  Deborah J. Crusan.  Dance, Ten; Looks, Three: Why Rubrics Matter , 2015 .

[4]  Kristen D. Ritchey,et al.  Universal Screening for Writing Risk in Kindergarten , 2014 .

[5]  Kristen D. Ritchey,et al.  Identifying Writing Difficulties in First Grade: An Investigation of Writing and Reading Measures , 2014 .

[6]  Kristen D. Ritchey,et al.  An Investigation of the Validity and Utility of Two Curriculum-Based Measurement Writing Tasks , 2013 .

[7]  Cynthia S. Puranik,et al.  Componential skills of beginning writing: An exploratory study. , 2011, Learning and individual differences.

[8]  Cynthia S. Puranik,et al.  Modeling the development of written language , 2011, Reading and writing.

[9]  Troy R. Ellis,et al.  Curriculum-Based Measures of Beginning Writing: Technical Features of the Slope , 2011 .

[10]  Kristen D. Ritchey,et al.  Curriculum-Based Measurement of Writing in Kindergarten and First Grade: An Investigation of Production and Qualitative Scores , 2010 .

[11]  Kristen L. McMaster,et al.  Technical Features of Curriculum-Based Measures for Beginning Writers , 2009, Journal of learning disabilities.

[12]  Kristen L. McMaster,et al.  New and Existing Curriculum-Based Writing Measures: Technical Features Within and Across Grades , 2008 .

[13]  Amanda M. VanDerHeyden,et al.  The Technical Adequacy of Curriculum-Based and Rating-Based Measures of Written Expression for Elementary School Students , 2006 .

[14]  Christine K. Malecki,et al.  The Utility of CBM Written Language Indices: An Investigation of Production-Dependent, Production-Independent, and Accurate-Production Scores , 2005 .

[15]  Steve Graham,et al.  Writing Better: Effective Strategies for Teaching Students with Learning Difficulties , 2005 .

[16]  Stanley L. Deno,et al.  Developments in Curriculum-Based Measurement , 2003 .

[17]  M. Daane,et al.  The Nation's Report Card: Writing, 2002. , 2003 .

[18]  Erica S. Lembke,et al.  Identifying an Indicator of Growth in Early Writing Proficiency for Elementary School Students , 2003 .

[19]  Amanda M. VanDerHeyden,et al.  Moving Beyond Total Words Written: The Reliability, Criterion Validity, and Time Cost of Alternate Measures for Curriculum-Based Measurement in Writing , 2002 .

[20]  B. M. Fulk,et al.  SPELLING INTERVENTIONS FOR STUDENTS WITH DISABILITIES: A REVIEW , 1995 .

[21]  Priscilla L. Griffith,et al.  Acquisition of literacy: A longitudinal study of children in first and second grade. , 1986 .

[22]  Stanley Deno,et al.  The Use of Standard Tasks to Measure Achievement in Reading, Spelling, and Written Expression: A Normative and Developmental Study. , 1982 .

[23]  Joan Videen,et al.  Correct Word Sequences: A Valid Indicator of Proficiency in Written Expression. , 1982 .

[24]  Virginia W. Berninger,et al.  Preventing written expression disabilities through early and continuing assessment and intervention for handwriting and/or spelling problems: Research into practice. , 2003 .

[25]  J. Hayes.  A new framework for understanding cognition and affect in writing. , 1996 .

[26]  Gerald Tindal,et al.  Identifying Measures for Evaluating Written Expression. , 1991 .

[27]  Gerald Tindal,et al.  Countable Indices of Writing Quality: Their Suitability for Screening-Eligibility Decisions. , 1991 .

[28]  Stanley L. Deno,et al.  Relationships Among Simple Measures of Written Expression and Performance on Standardized Achievement Tests. , 1980 .