RealVAMS: An R Package for Fitting a Multivariate Value-added Model (VAM)

We present RealVAMS, an R package for fitting a generalized linear mixed model to multimembership data with partially crossed and partially nested random effects. RealVAMS utilizes a multivariate generalized linear mixed model with pseudo-likelihood approximation for fitting normally distributed continuous response(s) jointly with a binary outcome. In an educational context, the model is referred to as a multidimensional value-added model, which extends previous theory to estimate the relationships between potential teacher contributions toward different student outcomes and to allow the consideration of a binary, real-world outcome such as graduation. The simultaneous joint modeling of continuous and binary outcomes was not available prior to RealVAMS due to computational difficulties. In this paper, we discuss the multidimensional model, describe RealVAMS, and demonstrate the use of this package and its modeling options with an educational data set.

[1]  Sharon L. Lohr,et al.  Efficient maximum likelihood estimation of multiple membership linear mixed models, with an application to educational value-added assessments , 2013, Comput. Stat. Data Anal..

[2]  N. Breslow,et al.  Approximate inference in generalized linear mixed models , 1993 .

[3]  Andrew T. Karl,et al.  Multivariate Generalized Linear Mixed Models for Joint Estimation of Sporting Outcomes , 2017, 1710.05284.

[4]  Daniel F. McCaffrey,et al.  Bayesian Methods for Scalable Multivariate Value-Added Assessment , 2007 .

[5]  C. McCulloch.  Maximum Likelihood Variance Components Estimation for Binary Data , 1994 .

[6]  Sharon L. Lohr,et al.  Multidimensional Assessment of Value Added by Teachers to Real-World Outcomes , 2012 .

[7]  Harvey Goldstein,et al.  Multiple membership multiple classification (MMMC) models , 2001 .

[8]  R. Wolfinger,et al.  Generalized linear mixed models a pseudo-likelihood approach , 1993 .

[9]  D. Koretz,et al.  Measuring up : what educational testing really tells us , 2008 .

[10]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[11]  A. Agresti,et al.  The Authors Replied as Follows: , 2001 .

[12]  Andrew T. Karl.  The Sensitivity of College Football Rankings to Several Modeling Choices , 2012, 1403.7642.

[13]  George Leckie,et al.  R2MLwiN: A Package to Run MLwiN from within R , 2016 .

[14]  E. Demidenko,et al.  Mixed Models: Theory and Applications (Wiley Series in Probability and Statistics) , 2004 .

[15]  Education Professional Standards Board.  Evaluating Value-Added models for Teacher Accountability , 2004 .