论文信息 - An Examination of Two Procedures for Identifying Consequential Item Parameter Drift

An Examination of Two Procedures for Identifying Consequential Item Parameter Drift

The purpose of the present study was to develop and evaluate two procedures flagging consequential item parameter drift (IPD) in an operational testing program. The first procedure was based on flagging items that exhibit a meaningful magnitude of IPD using a critical value that was defined to represent barely tolerable IPD. The second procedure was based on flagging items in which the D2 statistic was more than two standard deviations from the mean. Both procedures were implemented using an iterative purification approach to detect IPD. A simulation study was implemented to evaluate the effectiveness of both detection procedures in flagging non-negligible IPD. Both procedures were able to identify IPD and the iterative purification method provided useful information regarding the consequences of excluding or including a flagged item. The advantages and disadvantages of both procedures as well as possible modifications intended to improve the procedures’ effectiveness are discussed in the article.

Ronald K. Hambleton | Craig S. Wells | Yu Meng | Robert L. Kirkpatrick

[1] Martha L. Stocking,et al. Developing a Common Metric in Item Response Theory , 1982 .

[2] An Investigation of Item Bias in a Test of Reading Comprehension. Technical Report No. 163. , 1980 .

[3] Thomas R. Boucher,et al. Test Equating, Scaling, and Linking: Methods and Practices , 2007 .

[4] R. Darrell Bock,et al. Item Pool Maintenance in the Presence of Item Parameter Drift. , 1988 .

[5] Gerald Melican,et al. An Investigation of Scale Drift for Arithmetic Assessment of ACCUPLACER®. Research Report No. 2010-2. , 2010 .

[6] James L. Wardrop,et al. Item Bias in a Test of Reading Comprehension , 1981 .

[7] R. Hambleton,et al. Detecting potentially biased test items : Comparison of IRT area and Mantel-Haenszel methods , 1989 .

[8] R. Brennan,et al. Test Equating, Scaling, and Linking , 2004 .

[9] R. Brennan,et al. Test Equating, Scaling, and Linking: Methods and Practices , 2004 .

[10] Harvey Goldstein,et al. Measuring Changes in Educational Attainment over Time: Problems and Possibilities. , 1983 .

[11] Nambury S. Raju,et al. The area between two item characteristic curves , 1988 .

[12] Seock-Ho Kim,et al. Effects of Linking Methods on Detection of DIF , 1992 .

[13] David M. Williams,et al. Accounting for Statistical Artifacts in Item Bias Research , 1984 .

[14] Nambury S. Raju,et al. Determining the Significance of Estimated Signed and Unsigned Areas Between Two Item Response Functions , 1990 .