An Integrated Bayesian Model for DIF Analysis

In this article, an integrated bayesian model for differential item functioning (DIF) analysis is proposed. The model is integrated in the sense of modeling the responses along with the DIF analysis. This approach allows DIF detection and explanation in a simultaneous setup. Previous empirical studies and/or subjective beliefs about the item parameters, including differential functioning behavior, may be conveniently expressed in terms of prior distributions. Values of indicator variables are estimated in the model, indicating which items have DIF and which do not; as a result, the data analyst may not be required to specify an “anchor set” of items that do not exhibit DIF a priori to identify the model. It reduces the iterative procedures that are commonly used for proficiency purification and DIF detection and explanation. Examples demonstrate the efficiency of this method in simulated and real situations.

[1]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .

[2]  F. Lord.  Applications of Item Response Theory To Practical Testing Problems , 1980 .

[3]  Dorothy T. Thayer,et al.  Differential Item Performance and the Mantel-Haenszel Procedure. , 1986 .

[4]  Factors Affecting Differential Item Functioning for Black Examinees on Scholastic Aptitude Test Analogy Items. Research Report No. 87-23. , 1987 .

[5]  Carole A. Bleistein,et al.  FACTORS AFFECTING DIFFERENTIAL ITEM FUNCTIONING FOR BLACK EXAMINEES ON SCHOLASTIC APTITUDE TEST ANALOGY ITEMS1 , 1987 .

[6]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[7]  H. Swaminathan,et al.  Detecting Differential Item Functioning Using Logistic Regression Procedures , 1990 .

[8]  W. Stout,et al.  An Item Response Theory Model for Test Bias. , 1991 .

[9]  P. Holland,et al.  DIF DETECTION AND DESCRIPTION: MANTEL‐HAENSZEL AND STANDARDIZATION1,2 , 1992 .

[10]  J. Albert.  Bayesian Estimation of Normal Ogive Item Response Curves Using Gibbs Sampling , 1992 .

[11]  P. Holland,et al.  EVALUATING HYPOTHESES ABOUT DIFFERENTIAL ITEM FUNCTIONING1,2 , 1992 .

[12]  Howard Wainer,et al.  Detection of differential item functioning using the parameters of item response models. , 1993 .

[13]  Kathleen A. O'Neill,et al.  Item and test characteristics that are associated with differential item functioning. , 1993 .

[14]  E. George,et al.  Journal of the American Statistical Association is currently published by American Statistical Association. , 2007 .

[15]  Giray Berberoglu,et al.  Differential item functioning (DIF) analysis of computation, word problem and geometry questions across gender and SES groups , 1995 .

[16]  F. Samejima.  Graded Response Model , 1997 .

[17]  Dani Gamerman,et al.  Markov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference , 1997 .

[18]  B. Hanson.  Uniform DIF and DIF Defined by Differences in Item Response Functions , 1998 .

[19]  Richard J. Patz,et al.  A Straightforward Approach to Markov Chain Monte Carlo Methods for Item Response Models , 1999 .

[20]  Brian W. Junker,et al.  Applications and Extensions of MCMC in IRT: Multiple Item Types, Missing Data, and Rated Responses , 1999 .

[21]  Rebecca Zwick,et al.  An Empirical Bayes Approach to Mantel-Haenszel DIF Analysis. , 1999 .

[22]  Rebecca Zwick,et al.  Using Loss Functions for DIF Detection: An Empirical Bayes Approach , 2000 .

[23]  A. Béguin,et al.  MCMC estimation and some model-fit analysis of multidimensional IRT models , 2001 .

[24]  J. Fox,et al.  Bayesian estimation of a multilevel IRT model using gibbs sampling , 2001 .

[25]  Dorothy T. Thayer,et al.  Application of an Empirical Bayes Enhancement of Mantel-Haenszel Differential Item Functioning Analysis to a Computerized Adaptive Test , 2002 .

[26]  R. Nungester,et al.  Analysis of Differential Item Functioning (DIF) Using Hierarchical Logistic Regression Models , 2002 .

[27]  Mark J. Gierl,et al.  Identifying Content and Cognitive Skills that Produce Gender Differences in Mathematics: A Demonstration of the Multidimensionality‐Based DIF Analysis Paradigm , 2003 .

[28]  Daniel R. Jeske,et al.  Statistical Inference: An Integrated Approach , 2003 .

[29]  Wen-Chung Wang,et al.  Effects of Anchor Item Methods on Differential Item Functioning Detection with the Likelihood Ratio Test , 2003 .

[30]  Wen-Chung Wang,et al.  Effects of Average Signed Area Between Two Item Characteristic Curves and Test Purification Procedures on the DIF Detection via the Mantel-Haenszel Method , 2004 .

[31]  Brian E. Clauser,et al.  Using Statistical Procedures to Identify Differentially Functioning Test Items , 2005 .

[32]  Henry May,et al.  A Multilevel Bayesian Item Response Theory Method for Scaling Socioeconomic Status in International Studies of Education , 2006 .

[33]  Neil J. Dorans,et al.  USING PAST DATA TO ENHANCE SMALL-SAMPLE DIF ESTIMATION: A BAYESIAN APPROACH , 2006 .

[34]  Dani Gamerman,et al.  Markov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference, Second Edition , 2006 .

[35]  Eric T. Bradlow,et al.  A Bayesian Method for Studying DIF: A Cautionary Tale Filled With Surprises and Delights , 2008 .

[36]  S. E. Ahmed,et al.  Markov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference , 2008, Technometrics.

[37]  S. Ahmed.  Markov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference (2nd ed.), by Dani Gamerman and Hedibert F. Lopes , 2008 .