Use of hierarchical linear modeling and curriculum-based measurement for assessing academic growth and instructional factors for students with learning difficulties

The main purpose of this paper is to demonstrate how to apply the Hierarchical Linear Modeling (HLM) technique to multi-wave Curriculum-Based Measurement (CBM) measures in modeling academic growth and assessing its relations to student- and instruction-related variables. HLM has advantages over other statistical methods (e.g., repeated measures ANOVA, Structural Equation Modeling) in modeling academic growth. The advantages include allowing more flexible research designs in collecting multiple data points and estimating growth rates and their relations to correlates in more reliable, accurate ways. CBM, as a multi-wave progressmonitoring system, also has distinctive psychometric features that facilitate longitudinal research on academic skill development. These features include provision of multiple data points within short time periods, good validity and reliability, and sensitivity for detecting small degrees of change. Finally, research questions related to assessing the academic growth of students with learning difficulties and using assessment results to improve educational practices for them are discussed

[1]  S. R. Searle.  Linear Models , 1971 .

[2]  Jongho Shin,et al.  Predicting Classroom Achievement From Active Responding on a Computer-Based Groupware System , 2000 .

[3]  Lynn S. Fuchs,et al.  Developing Curriculum-Based Measurement Systems For Data-Based Special Education Problem Solving , 1987 .

[4]  C. Hertzog,et al.  Repeated-measures analysis of variance in developmental research: selected issues. , 1985, Child development.

[5]  Lynn S. Fuchs,et al.  Formative Evaluation of Academic Progress: How Much Growth Can We Expect?. , 1993 .

[6]  D. W. Zimmerman,et al.  GAIN SCORES IN RESEARCH CAN BE HIGHLY RELIABLE , 1982 .

[7]  K. Stanovich,et al.  The Developmental Lag Hypothesis in Reading: Longitudinal and Matched Reading-Level Comparisons. , 1988 .

[8]  D. Marston,et al.  A Comparison of Standardized Achievement Tests and Direct Measurement Techniques in Measuring Pupil Progress. , 1983 .

[9]  Mark R. Shinn,et al.  Advanced applications of curriculum-based measurement , 1998 .

[10]  Anthony S. Bryk,et al.  Methodological Advances in Analyzing the Effects of Schools and Classrooms on Student Learning , 1988 .

[11]  Mark Appelbaum,et al.  Bias in the Analysis of Repeated-Measures Designs: Some Alternative Approaches. , 1973 .

[12]  John B. Willett,et al.  Questions and Answers in the Measurement of Change , 1988 .

[13]  S. Raudenbush,et al.  Chapter 10: Methodological Advances in Analyzing the Effects of Schools and Classrooms on Student Learning , 1988 .

[14]  Mark R. Shinn,et al.  Curriculum-Based Measurement: Assessing Special Children , 1989 .

[15]  John B. Willett,et al.  Using covariance structure analysis to detect correlates and predictors of individual change over time , 1994 .

[16]  D. Marston,et al.  Implementing Curriculum-Based Measurement in Special and Regular Education Settings , 1985, Exceptional children.

[17]  Roland H. Good,et al.  Contemporary perspectives on Curriculum-Based Measurement validity. , 1998 .

[18]  J. Willett.  Chapter 9: Questions and Answers in the Measurement of Change , 1988 .

[19]  D. Marston,et al.  A curriculum-based measurement approach to assessing academic performance: What it is and why do it. , 1989 .

[20]  H. Francis.  PATTERNS OF READING DEVELOPMENT IN THE FIRST SCHOOL , 1992 .

[21]  C. Espin,et al.  Technical Adequacy of the Maze Task for Curriculum-Based Measurement of Reading Growth , 2000 .

[22]  Geoffrey M. Maruyama,et al.  Basics of structural equation modeling , 1997 .

[23]  Lynn S. Fuchs,et al.  Using Curriculum-based Measurement to Establish Growth Standards for Students with Learning Disabilities , 2001 .

[24]  S. Raudenbush,et al.  Application of Hierarchical Linear Models to Assessing Change , 1987 .

[25]  J. Gill.  Hierarchical Linear Models , 2005 .

[26]  E. Labouvie,et al.  The concept of change and regression toward the mean. , 1982 .

[27]  J. Willett,et al.  DEMONSTRATING THE RELIABILITY THE DIFFERENCE SCORE IN THE MEASUREMENT OF CHANGE , 1983 .

[28]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[29]  P. Reitsma,et al.  Analyzing the development of individual differences in terms of Matthew effects in reading: results from a Dutch Longitudinal study. , 1998, Developmental psychology.

[30]  S. Deno,et al.  Curriculum-Based Measurement: The Emerging Alternative , 1985, Exceptional children.

[31]  Jack M. Fletcher,et al.  Developmental Lag versus Deficit Models of Reading Disability: A Longitudinal, Individual Growth Curves Analysis. , 1996 .

[32]  C Loehlin John,et al.  Latent variable models: an introduction to factor, path, and structural analysis , 1986 .

[33]  John B. Willett,et al.  Some Results on Reliability for the Longitudinal Measurement of Change: Implications for the Design of Studies of Individual Growth , 1989 .