A Conceptual Analysis of Differential Item Functioning in Terms of a Multidimensional Item Response Model

Differential item functioning (DIF) has been informally conceptualized as multidimensionality. Recently, more formal descriptions of DIF as multidimensionality have become available in the item response theory literature. This approach assumes that DIF is not a difference in the item parameters of two groups; rather, it is a shift in the distribution of ability along a secondary trait that influences the probability of a correct item response. That is, one group is relatively more able on an ability such as test-wiseness. The parameters of the secondary distribution are confounded with item parameters by unidimensional DIF detection models, and this manifests as differences between estimated item parameters. However, DIF is con founded with impact in multidimensional tests, which may be a serious limitation of unidimen sional detection methods in some situations. In the multidimensional approach, DIF is considered to be a function of the educational histories of the examinees. Thus, a better tool for understanding DIF may be provided through structural modeling with external variables that describe background and schooling experience.

[1]  W. Stout,et al.  An Item Response Theory Model for Test Bias. , 1991 .

[2]  David M. Williams,et al.  Accounting for Statistical Artifacts in Item Bias Research , 1984 .

[3]  L. Crocker,et al.  Introduction to Classical and Modern Test Theory , 1986 .

[4]  L. Thurstone.  A law of comparative judgment. , 1994 .

[5]  Joseph L. Zinnes,et al.  Theory and Methods of Scaling. , 1958 .

[6]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .

[7]  Bengt Muthen,et al.  Some uses of structural equation modeling in validity studies: Extending IRT to external variables , 1986 .

[8]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[9]  M. Reckase.  Unifactor Latent Trait Models Applied to Multifactor Tests: Results and Implications , 1979 .

[10]  James L. Wardrop,et al.  Item Bias in a Test of Reading Comprehension , 1981 .

[11]  Karl G. Jöreskog,et al.  Lisrel 8: User's Reference Guide , 1997 .

[12]  H. Swaminathan,et al.  Detecting Differential Item Functioning Using Logistic Regression Procedures , 1990 .

[13]  Bengt Muthén,et al.  Multiple Group IRT Modeling: Applications to Item Bias Analysis , 1985 .

[14]  R. D. Bock,et al.  Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm , 1981 .

[15]  Dorothy T. Thayer,et al.  Differential Item Performance and the Mantel-Haenszel Procedure. , 1986 .

[16]  Language and Cultural Characteristics That Explain Differential Item Functioning for Hispanic Examinees on the Scholastic Aptitude Test , 1988 .

[17]  John B. Carroll,et al.  The effect of difficulty and chance success on correlations between items or between tests , 1945 .

[18]  Mark D. Reckase,et al.  Building a Unidimensional Test Using Multidimensional Items , 1988 .

[19]  Terry A. Ackerman.  An Explanation of Differential Item Functioning from a Multidimensional Perspective. , 1988 .

[20]  F. Kok,et al.  Item Bias and Test Multidimensionality , 1988 .

[21]  Fumiko Samejima,et al.  Normal ogive model on the continuous response level in the multidimensional latent space , 1974 .

[22]  Neil J. Dorans,et al.  THE EFFECTS OF VIOLATIONS OF UNIDIMENSIONALITY ON THE ESTIMATION OF ITEM AND ABILITY PARAMETERS AND ON ITEM RESPONSE THEORY EQUATING OF THE GRE VERBAL SCALE , 1985 .

[23]  Howard Wainer,et al.  Detection of differential item functioning using the parameters of item response models. , 1993 .

[24]  Terry A. Ackerman.  Unidimensional IRT Calibration of Compensatory and Noncompensatory Multidimensional Items , 1989 .

[25]  Implications of the Golden Rule Settlement for Test Construction , 1987 .

[26]  Martha L. Stocking,et al.  Developing a Common Metric in Item Response Theory , 1982 .

[27]  E. Muraki,et al.  Full-Information Item Factor Analysis , 1988 .

[28]  Gregory R. Anrig.  ETS Replies to Golden Rule on “Golden Rule” , 1988 .

[29]  Bengt Muthén,et al.  Simultaneous factor analysis of dichotomous variables in several groups , 1981 .

[30]  F. Lord.  Applications of Item Response Theory To Practical Testing Problems , 1980 .

[31]  Howard Wainer,et al.  Use of item response theory in the study of group differences in trace lines. , 1988 .

[32]  David Rogosa,et al.  Comparing nonparallel regression lines. , 1980 .