The Role of Extended Time and Item Content on a High–Stakes Mathematics Test

The premise of a great deal of current research guiding policy development has been that accommodations are the catalyst for student performance differences. Rather than accepting this premise, two studies were conducted to investigate the influence of extended time and content knowledge on the performance of ninth-grade students who took a statewide mathematics test with and without accommodations. Each study involved 1,250 accommodated students (extended time only) with learning disabilities and 1,250 nonaccommodated students demonstrating no disabilities. In Study One, a standard differential item functioning (DIF) analysis illustrated that the usual approach to studying the effects of accommodations contributes little to our understanding of the reason for performance differences across students. Next, a mixture item response theory DIF model was used to explore the most likely cause(s) for performance differences across the population. The results from both studies suggest that students for whom items were functioning differently were not accurately characterized by their accommodation status but rather by their content knowledge. That is, knowing students' accommodation status (i.e., accommodated or nonaccommodated) contributed little to understanding why accommodated and nonaccommodated students differed in their test performance. Rather, the data would suggest that a more likely explanation is that mathematics competency differentiated the groups of student learners regardless of their accommodation and/or reading levels.

[1]  Jürgen Rost,et al.  Rasch Models in Latent Classes: An Integration of Two Approaches to Item Analysis , 1990 .

[2]  Terry A. Ackerman A Didactic Explanation of Item Bias, Item Impact, and Item Validity from a Multidimensional Perspective , 1992 .

[3]  O Manor,et al.  DEVELOPMENTAL DYSCALCULIA: PREVALENCE AND DEMOGRAPHIC FEATURES , 1996 .

[4]  Allan S. Cohen,et al.  An Investigation of the Likelihood Ratio Test For Detection of Differential Item Functioning , 1996 .

[5]  Frank B. Baker,et al.  An Investigation of the Item Parameter Recovery Characteristics of a Gibbs Sampling Procedure , 1998 .

[6]  Richard J. Patz,et al.  A Straightforward Approach to Markov Chain Monte Carlo Methods for Item Response Models , 1999 .

[7]  Brian W. Junker,et al.  Applications and Extensions of MCMC in IRT: Multiple Item Types, Missing Data, and Rated Responses , 1999 .

[8]  G. Zuriff,et al.  Extra Examination Time for Students With Learning Disabilities: An Examination of the Maximum Potential Thesis , 2000 .

[9]  Lynn S. Fuchs,et al.  Supplementing Teacher Judgments of Mathematics Test Accommodations with Objective Data Sources , 2000 .

[10]  Laura S. Hamilton,et al.  Assessment of Students With Disabilities in Kentucky: Inclusion, Student Performance, and Validity , 2000 .

[11]  Allan S. Cohen,et al.  A Mixture Item Response Model for Multiple-Choice Data , 2001 .

[12]  P. Skudlarski,et al.  Disruption of posterior brain systems for reading in children with developmental dyslexia , 2002, Biological Psychiatry.

[13]  Robert B. Stennett,et al.  Discourse Complexity of College Writers With and Without Disabilities , 2002, Journal of learning disabilities.

[14]  James A. Wollack,et al.  Recovery of Item Parameters in the Nominal Response Model: A Comparison of Marginal Maximum Likelihood Estimation and Markov Chain Monte Carlo Estimation , 2002 .

[15]  Allan S. Cohen,et al.  Item Parameter Estimation Under Conditions of Test Speededness: Application of a Mixture Rasch Model With Ordinal Constraints , 2002 .

[16]  Nicole S. Ofiesh,et al.  Using Speeded Cognitive, Reading, and Academic Measures to Determine the Need for Extended Test Time among University Students with Learning Disabilities , 2005 .

[17]  Stephen G. Sireci,et al.  Unlabeling the Disabled: A Perspective on Flagging Scores From Accommodated Test Administrations , 2005 .

[18]  Allan S. Cohen,et al.  A Mixture Model Analysis of Differential Item Functioning , 2005 .