Using Item Response Theory to Assess Effects of Mathematics Instruction in Special Populations

Research on mathematics education often includes some experimental manipulation of instruction in order to compare the effects of one type of instruction with that of one or more others. Tracking students' progress during treatments may be difficult in studies with special populations where numbers of participants are sometimes very small. In this study, we illustrate a method for scaling and reporting test results that helps to overcome this problem, particularly when number-correct scoring is used on measures to assess treatment effectiveness. Results are compared for an instructional experiment with remedial and nonremedial students using a number-correct scoring and a standardized score scale developed using item response theory (IRT).

[1]  Richard E. Mayer,et al.  Understanding Individual Differences in Mathematical Problem Solving: Towards a Research Agenda , 1993 .

[2]  Linda L. Cook,et al.  Using item response theory in test score equating , 1989 .

[3]  John Hattie,et al.  Methodology Review: Assessing Unidimensionality of Tests and ltenls , 1985 .

[4]  M. J. Kolen.  Traditional Equating Methodology , 1988 .

[5]  M. Reckase.  Unifactor Latent Trait Models Applied to Multifactor Tests: Results and Implications , 1979 .

[6]  Linda L. Cook,et al.  Problems Related to the Use of Conventional and Item Response Theory Equating Methods in Less Than Optimal Circumstances , 1987 .

[7]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[8]  H. Gulliksen.  Theory of mental tests , 1952 .

[9]  C. Greenwood,et al.  Classwide Peer Tutoring: Teaching Students with Mild Mental Retardation in Inclusive Classrooms , 1999 .

[10]  T. S. Hasselbring,et al.  Achieving Meaningful Mathematics Literacy for Students with Learning Disabilities , 1997, Journal of learning disabilities.

[11]  Asha K. Jitendra,et al.  The Effects of Instruction in Solving Mathematical Word Problems for Students with Learning Problems , 1999 .

[12]  Evelyn S. Johnson,et al.  A Statewide Review of the Use of Accommodations in Large-Scale, High-Stakes Assessments , 2001 .

[13]  F. Samejima.  Graded Response Model , 1997 .

[14]  F. Lord.  Applications of Item Response Theory To Practical Testing Problems , 1980 .

[15]  R. Hambleton,et al.  Item Response Theory , 1984, The History of Educational Measurement.

[16]  Hua-Hua Chang,et al.  The unique correspondence of the item response function and item category response functions in polytomously scored item response models , 1994 .

[17]  C. D. Mercer,et al.  Using Data to Learn about Concrete-Semiconcrete-Abstract Instruction for Students with Math Disabilities. , 1993 .

[18]  Allan S. Cohen,et al.  Detection of Differential Item Functioning Under the Graded Response Model With the Likelihood Ratio Test , 1998 .

[19]  Seock-Ho Kim,et al.  A Comparison of Linking and Concurrent Calibration Under Item Response Theory , 1996 .