Multidimensional IRT models for the assessment of competencies

Abstract Multidimensional item response theory (MIRT) provides an ideal foundation for modeling performance in complex domains, taking into account multiple basic abilities simultaneously, and representing different mixtures of the abilities required for different test items. This article provides a brief overview of different MIRT models, and the substantive implications of their differences for educational assessment. To illustrate the flexibility and benefits of MIRT, three application scenarios are described: to account for unintended multidimensionality when measuring a unidimensional construct, to model latent covariance structures between ability dimensions, and to model interactions of multiple abilities required for solving specific test items. All of these scenarios are illustrated by empirical examples. Finally, the implications of using MIRT models on educational processes are discussed.

[1]  Mark D. Reckase,et al.  A Linear Logistic Multidimensional Model for Dichotomous Item Response Data , 1997 .

[2]  Representation of Competencies in Multidimensional IRT Models with Within-Item and Between-Item Multidimensionality , 2008 .

[3]  S. Embretson A general latent trait model for response processes , 1984 .

[4]  Eckhard Klieme,et al.  Assessment of Competencies in Educational Contexts , 2008 .

[5]  Ronald K. Hambleton,et al.  Handbook of Modern Item Response Theory. , 1997 .

[6]  Kenneth A. Bollen,et al.  Structural Equations with Latent Variables , 1989 .

[7]  Eric T. Bradlow,et al.  Testlet Response Theory and Its Applications , 2007 .

[8]  M. Reckase Multidimensional Item Response Theory , 2009 .

[9]  Raymond J. Adams,et al.  The Multidimensional Random Coefficients Multinomial Logit Model , 1997 .

[10]  Eckhard Klieme,et al.  Current Issues in Competence Modeling and Assessment , 2008 .

[11]  Wen-Chung Wang,et al.  The Rasch Testlet Model , 2005 .

[12]  Mark D. Reckase Unidimensional Data from Multidimensional Tests and Multidimensional Data from Unidimensional Tests. , 1990 .

[13]  S. Natasha Beretvas,et al.  Comparing Multidimensional and Unidimensional Proficiency Classifications: Multidimensional IRT as a Diagnostic Aid , 2003 .

[14]  J. Kuha AIC and BIC , 2004 .

[15]  S. Embretson,et al.  Item response theory for psychologists , 2000 .

[16]  Christine Klein-Braley,et al.  A survey of research on the C-Test1 , 1984 .

[17]  S. Natasha Beretvas,et al.  An empirical investigation demonstrating the multidimensional DIF paradigm: A cognitive explanation for DIF , 2001 .

[18]  Derek C. Briggs,et al.  An introduction to multidimensional measurement using Rasch models. , 2003, Journal of applied measurement.

[19]  Comparison of Two Logistic Multidimensional Item Response Theory Models , 1990 .

[20]  R. P. McDonald,et al.  A Basis for Multidimensional Item Response Theory , 2000 .