Assessment of School Performance Through a Multilevel Latent Markov Rasch Model

An extension of the latent Markov Rasch model is described for the analysis of binary longitudinal data with covariates when subjects are collected in clusters, such as students clustered in classes. For each subject, a latent process is used to represent the characteristic of interest (e.g., ability) conditional on the effect of the cluster to which he or she belongs. The latter effect is modeled by a discrete latent variable associated to each cluster. For the maximum likelihood estimation of the model parameters, an Expectation-Maximization algorithm is outlined. Through the analysis of a data set collected in the Lombardy Region (Italy), it is shown how the proposed model may be used for assessing the development of cognitive achievement. The data set is based on test scores in mathematics observed over 3 years on middle school students attending public and non-state schools. Manuscript received March 20, 2009 Revision received July 2, 2010 Accepted July 10, 2010

[1]  L. R. Rabiner,et al.  An introduction to the application of the theory of probabilistic functions of a Markov process to automatic speech recognition , 1983, The Bell System Technical Journal.

[2]  Lee Manning Wiggins,et al.  Panel analysis : Latent probability models for attitude and behavior processes , 1974 .

[3]  Elizabeth A. Stuart,et al.  Estimating Causal Effects Using School-Level Data Sets , 2007 .

[4]  Francesco Bartolucci,et al.  Latent Markov model for longitudinal binary data: An application to the performance evaluation of nursing homes , 2009, 0908.2300.

[5]  P. McCullagh.  Regression Models for Ordinal Data , 1980 .

[6]  Barbara Schneider.  Estimating causal effects : using experimental and observational designs : a think tank white paper , 2007 .

[7]  Lain L. MacDonald,et al.  Hidden Markov and Other Models for Discrete- valued Time Series , 1997 .

[8]  S. Raudenbush,et al.  Causal Inference for Time-Varying Instructional Treatments , 2008 .

[9]  Francesco Bartolucci,et al.  A latent Markov model for detecting patterns of criminal activity , 2007 .

[10]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[11]  Thomas A Louis,et al.  Jump down to Document , 2022 .

[12]  Adjusting for measurement error in the value added model: evidence from Portugal , 2009 .

[13]  Henry Braun,et al.  Comparing Private Schools and Public Schools Using Hierarchical Linear Modeling , 2006 .

[14]  Andreas Schleicher,et al.  PISA 2006: Science Competencies for Tomorrow's World , 2007 .

[15]  James Algina,et al.  An Empirical Comparison of Statistical Models for Value-Added Assessment of School Performance , 2004 .

[16]  Francesco Bartolucci,et al.  Likelihood inference for the latent Markov Rasch model , 2010 .

[17]  Darvin M. Winick.  Comparing Private Schools and Public Schools Using Hierarchical Linear Modeling , 2006 .

[18]  Donald B. Rubin,et al.  A Potential Outcomes View of Value-Added Assessment in Education , 2004 .

[19]  Harvey Goldstein,et al.  Multilevel Structural Equation Models for the Analysis of Comparative Data on Educational Performance , 2007 .

[20]  Gregory R. Hancock,et al.  Advances in Latent Variable Mixture Models , 2007 .

[21]  Gilles Celeux,et al.  Selecting hidden Markov model state number with cross-validated likelihood , 2008, Comput. Stat..

[22]  H. Weisberg,et al.  Value-Added Analysis: A Dynamic Approach to the Estimation of Treatment Effects , 1976 .

[23]  Paul Wright,et al.  Controlling for Student Background in Value-Added Assessment of Teachers , 2004 .

[24]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[25]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[26]  David Kapland,et al.  An overview of Markov chain methods for the study of stage-sequential developmental processes. , 2008, Developmental psychology.

[27]  Eric Moulines,et al.  Inference in hidden Markov models , 2010, Springer series in statistics.

[28]  M. Seltzer,et al.  Modeling Heterogeneity in Relationships Between Initial Status and Rates of Change: Treating Latent Variable Regression Coefficients as Random Coefficients in a Three-Level Hierarchical Model , 2010 .

[29]  F. V. D. Pol,et al.  MIXED MARKOV LATENT CLASS MODELS , 1990 .

[30]  P. Róbert,et al.  Differences in Scholastic Achievement of Public, Private Government-Dependent, and Private Independent Schools , 2008 .

[31]  Jesse Rothstein,et al.  Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement , 2008 .

[32]  P. Deb.  Finite Mixture Models , 2008 .

[33]  P. McEwan.  The Potential Impact of Large-Scale Voucher Programs , 2000 .

[34]  Erik Weber,et al.  Counterfactuals and causal inference: methods and principles for social research , 2008 .

[35]  Multilevel Mixture Models , 2006 .

[36]  F. Bartolucci.  Likelihood inference for a class of latent Markov models under linear hypotheses on the transition probabilities , 2006 .

[37]  Rolf Langeheine,et al.  Applied Latent Class Analysis: Latent Markov Chains , 2002 .

[38]  G. Rasch.  On General Laws and the Meaning of Measurement in Psychology , 1961 .

[39]  Otis Dudley Duncan,et al.  Panel Analysis: Latent Probability Models for Attitude and Behavior Processes. , 1975 .

[40]  Luis A. Escobar,et al.  Teaching about Approximate Confidence Regions Based on Maximum Likelihood Estimation , 1995 .

[41]  Enrico Gori,et al.  Covariate Measurement Error Adjustment for Multilevel Models With Application to Educational Data , 2011 .

[42]  A. Farcomeni,et al.  An overview of latent Markov models for longitudinal categorical data , 2010, 1003.2804.

[43]  Francesco Bartolucci,et al.  Multidimensional Latent Markov Models in a Developmental Study of Inhibitory Control and Attentional Flexibility in Early Childhood , 2008, 0901.0024.

[44]  C. Lubienski,et al.  School Sector and Academic Achievement: A Multilevel Analysis of NAEP Mathematics Data , 2006 .

[45]  Donald B. Rubin,et al.  Public Schools Versus Private Schools: Causal Inference With Partial Compliance , 2009 .

[46]  Robert H. Meyer,et al.  Value-added indicators of school performance: A primer , 1997 .

[47]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[48]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[49]  Francesco Bartolucci,et al.  A class of multidimensional IRT models for testing unidimensionality and clustering items , 2007 .

[50]  J. Vermunt,et al.  Discrete-Time Discrete-State Latent Markov Models with Time-Constant and Time-Varying Covariates , 1999 .

[51]  Francesco Bartolucci,et al.  A Class of Latent Markov Models for Capture–Recapture Data Allowing for Time, Heterogeneity, and Behavior Effects , 2007, Biometrics.