The Use of Multilevel Item Response Theory Modeling in Applied Research: An Illustration

Embedding item response theory (IRT) models within a multilevel modeling framework has been shown by many authors to allow better estimation of the relationships between predictor variables and IRT latent traits (Adams, Wilson, & Wu,1997). A multilevel IRT model recently proposed by Kamata (1998, 2001) yields the additional benefit of being able to accommodate data that are collected in hierarchical settings. This expansion of multilevel IRT models to three levels allows not only the dependency typically found in hierarchical data to be accommodated, but also the estimation of (a) latent traits at different levels and (b) the relationships between predictor variables and latent traits at different levels. The purpose of this article is to provide both a description and application of Kamata's 3-level IRT model. The advantages and disadvantages of using multilevel IRT models in applied research are discussed and directions for future research are given.

[1]  Clement A. Stone,et al.  Strategies for Examining the Consequences of Assessment and Accountability Programs , 2005 .

[2]  Marie Davidian,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 2003 .

[3]  Clement A. Stone,et al.  Consequences of a State Accountability Program: Examining Relationships Between School Performance Gains and Teacher, Student, and School Variables , 2003 .

[4]  Stuart Luppescu.  DIF Detection in HLM. , 2002 .

[5]  D. Pastor.  Application of multilevel IRT modeling to the study of self-esteem in adolescents , 2001 .

[6]  Kimberly S. Maier.  A Rasch Hierarchical Measurement Model , 2001 .

[7]  Akihito Kamata,et al.  Item Analysis by the Hierarchical Generalized Linear Model. , 2001 .

[8]  S. Raudenbush,et al.  Measurement and structural models for children's problem behaviors. , 2000, Psychological methods.

[9]  Valerie E. Lee,et al.  Using Hierarchical Linear Modeling to Study Social Contexts: The Case of School Effects , 2000 .

[10]  Akihito Kamata,et al.  Nonequivalent Group Equating via 1-P HGLLM. , 2000 .

[11]  Yuk Fai Cheong,et al.  HLM 6: Hierarchical Linear and Nonlinear Modeling , 2000 .

[12]  S. Raudenbush,et al.  Maximum Likelihood for Generalized Linear Models with Nested Random Effects via High-Order, Multivariate Laplace Approximation , 2000 .

[13]  Brian W. Junker,et al.  Applications and Extensions of MCMC in IRT: Multiple Item Types, Missing Data, and Rated Responses , 1999 .

[14]  Richard J. Patz,et al.  A Straightforward Approach to Markov Chain Monte Carlo Methods for Item Response Models , 1999 .

[15]  S. Loeb,et al.  Contextual effects of prekindergarten classrooms for disadvantaged children on cognitive development: the case of Chapter 1. , 1998, Child development.

[16]  Eric M. Anderman,et al.  Victimization and Safety in Schools Serving Early Adolescents , 1997 .

[17]  Raymond J. Adams,et al.  Multilevel Item Response Models: An Approach to Errors in Variables Regression , 1997 .

[18]  J. Mckillip,et al.  Fundamentals of item response theory , 1993 .

[19]  N. Breslow,et al.  Approximate inference in generalized linear mixed models , 1993 .

[20]  S. Raudenbush,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[21]  Aeilko H. Zwinderman,et al.  A generalized rasch model for manifest predictors , 1991 .

[22]  Stephen W. Raudenbush,et al.  A Multilevel, Multivariate Model for Studying School Climate With Estimation Via the EM Algorithm and Application to U.S. High-School Data , 1991 .

[23]  R. Mislevy.  Estimating latent distributions , 1984 .

[24]  Guang Guo,et al.  Multilevel Modeling for Binary Data , 2000 .

[25]  R. Bosker,et al.  Multilevel analysis : an introduction to basic and advanced multilevel modeling , 1999 .