Simultaneous DIF Amplification and Cancellation: Shealy-Stout's Test for DIF

Abstract : The present study investigates the phenomena of simultaneous DIF amplification and cancellation and SIBTEST's role in detecting such. A variety of simulated test data were generated for this purpose. In addition, real test data from various sources were used. The results from both simulated as well as real test data, as Shealy and Stout's theory suggests, show that the SIBTEST is effective in assessing the DIF amplification and cancellation (partially or fully) at the test score level. Finally, methodological and substantive implications of DIF amplification and cancellation are discussed. SIBTEST, DIF, Item bias, Test bias, Bias amplification, Bias cancellation.

[1]  W. Stout,et al.  An Item Response Theory Model for Test Bias. , 1991 .

[2]  R. Berk.  Handbook of methods for detecting test bias , 1982 .

[3]  Dorothy T. Thayer,et al.  Differential Item Performance and the Mantel-Haenszel Procedure. , 1986 .

[4]  Eugene G. Johnson.  National Assessment of Educational Progress: 1985-86 Public-Use Data Tapes, Version 1.0. Users' Guide. , 1987 .

[5]  Terry A. Ackerman.  A Didactic Explanation of Item Bias, Item Impact, and Item Validity from a Multidimensional Perspective , 1992 .

[6]  R. Hambleton,et al.  Detecting potentially biased test items : Comparison of IRT area and Mantel-Haenszel methods , 1989 .

[7]  J. Scheuneman.  A METHOD OF ASSESSING BIAS IN TEST ITEMS , 1979 .

[8]  M. Roznowski.  Use of tests manifesting sex differences as measures of intelligence: Implications for measurement bias. , 1987 .

[9]  H. Swaminathan,et al.  Detecting Differential Item Functioning Using Logistic Regression Procedures , 1990 .

[10]  N. Dorans.  Two New Approaches to Assessing Differential Item Functioning: Standardization and the Mantel--Haenszel Method , 1989 .

[11]  Comparison of Procedures for Detecting test-Item Bias with both Internal and External Ability Criteria , 1981 .

[12]  William Stout,et al.  A model-based standardization approach that separates true bias/DIF from group ability differences and detects test bias/DTF as well as item bias/DIF , 1993 .

[13]  T. Cleary,et al.  An Investigation of Item Bias , 1968 .

[14]  F. Lord.  Applications of Item Response Theory To Practical Testing Problems , 1980 .

[15]  Neil J. Dorans,et al.  ASSESSING UNEXPECTED DIFFERENTIAL ITEM PERFORMANCE OF FEMALE CANDIDATES ON SAT AND TSWE FORMS ADMINISTERED IN DECEMBER 1977: AN APPLICATION OF THE STANDARDIZATION APPROACH1 , 1983 .

[16]  H. Wainer,et al.  Differential Testlet Functioning: Definitions and Detection , 1991 .

[17]  H. Wainer,et al.  Differential Item Functioning. , 1994 .

[18]  F. Kok,et al.  Item Bias and Test Multidimensionality , 1988 .

[19]  Nambury S. Raju,et al.  The area between two item characteristic curves , 1988 .

[20]  The Definition of Difficulty and Discrimination for Multidimensional Item Response Theory Models. , 1983 .

[21]  M. R. Novick,et al.  AN EVALUATION OF SOME MODELS FOR CULTURE-FAIR SELECTION , 1976 .

[22]  Neil J. Dorans,et al.  Demonstrating the utility of the standardization approach to assessing unexpected differential item performance on the Scholastic Aptitude Test. , 1986 .

[23]  M. Reckase,et al.  Some Latent Trait Theory in a Multidimensional Latent Space. , 1982 .

[24]  L. Humphreys.  An analysis and evaluation of test and item bias in the prediction context. , 1986 .

[25]  William Stout,et al.  A New Item Response Theory Modeling Approach with Applications to Unidimensionality Assessment and Ability Estimation , 1990 .

[26]  Fritz Drasgow,et al.  Study of the measurement bias of two standardized psychological tests. , 1987 .