Multilevel models for the evaluation of educational institutions: a review

The methodology for the evaluation of educational systems is being developed in different fields, such as educational statistics, psychometrics, sociology and econometrics. Each discipline has developed approaches suitable for the analysis of particular aspects of the evaluation process. For example, educational statistics focuses on learning curves using standardized scores, while econometrics mainly deals with private returns (e.g. in terms of wages) or social returns (e.g. in terms of productivity). Anyway, there is a considerable overlap among the fields, for example peer effects are studied both in educational statistics, as a major topic, and econometrics, as a minor topic.

[1]  H. Goldstein,et al.  The Graphical Presentation of a Collection of Means , 1995 .

[2]  David Draper,et al.  Statistical analysis of performance indicators in UK higher education , 2004 .

[3]  L. Fabbris Effectiveness of university education in Italy : employability, competences, human capital , 2007 .

[4]  G. Ballarino G. Boero e S. Staffolani (a cura di), Performance accademica e tassi di abbandono. Un'analisi dei primi effetti della riforma universitaria , 2008 .

[5]  A Multilevel Chain Graph Model for the Analysis of Graduates’ Employment , 2007 .

[6]  Carla Rampichini,et al.  Multilevel Factor Models for Ordinal Variables , 2007 .

[7]  Roel Bosker,et al.  Multilevel analysis : an introduction to basic and advanced multilevel modeling , 1999 .

[8]  Donald B. Rubin,et al.  Public Schools Versus Private Schools: Causal Inference With Partial Compliance , 2009 .

[9]  Carla Rampichini,et al.  Specification issues in stratified variance component ordinal response models , 2002 .

[10]  S. Bird Editorial: Performance monitoring in the public services , 2004 .

[11]  Roberto Fazioli,et al.  L'intervento pubblico e l'efficienza possibile , 1996 .

[12]  Henry Braun,et al.  27 Value-Added Modeling , 2006 .

[13]  Wayne A. Fuller,et al.  Measurement Error Models , 1988 .

[14]  M. Aitkin,et al.  Statistical Modelling Issues in School Effectiveness Studies , 1986 .

[15]  J. Gill Hierarchical Linear Models , 2005 .

[16]  J. R. Lockwood,et al.  Fitting Value-Added Models in R , 2006 .

[17]  L. Grilli,et al.  Selection bias in linear mixed models , 2010 .

[18]  Donald B. Rubin,et al.  A Potential Outcomes View of Value-Added Assessment in Education , 2004 .

[19]  H. Goldstein,et al.  Efficient Analysis of Mixed Hierarchical and Cross-Classified Random Structures Using a Multilevel Model , 1994 .

[20]  Lawrence C. Marsh The econometrics of higher education: editor's view , 2004 .

[21]  Harvey Goldstein,et al.  Modelling the effect of pupil mobility on school differences in educational achievement , 2007 .

[22]  David Afshartous,et al.  Avoiding ‘data snooping’ in multilevel and mixed effects models , 2007 .

[23]  Timothy J. Robinson,et al.  Multilevel Analysis: Techniques and Applications , 2002 .

[24]  Carla Rampichini,et al.  Alternative Specifications of Multivariate Multilevel Probit Ordinal Response Models , 2003 .

[25]  Anna Vignoles,et al.  The effect of school resources on pupil attainment: a multilevel simultaneous equation modelling approach , 2007 .

[26]  Harvey Goldstein,et al.  League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance , 1996 .

[27]  Fabrizia Mealli,et al.  Nonparametric Bounds on the Causal Effect of University Studies on Job Opportunities Using Principal Stratification , 2008 .

[28]  Harvey Goldstein,et al.  Handbook of multilevel analysis , 2008 .

[29]  Carla Rampichini,et al.  A multilevel multinomial logit model for the analysis of graduates’ skills , 2007, Stat. Methods Appl..

[30]  Adjusting for measurement error in the value added model: evidence from Portugal , 2009 .

[31]  Eric A. Hanushek,et al.  The Economics of Schooling: Production and Efficiency in Public Schools , 1986 .

[32]  Jeffrey M. Woodbridge Econometric Analysis of Cross Section and Panel Data , 2002 .

[33]  Harvey Goldstein,et al.  School league tables: what can they really tell us? , 2008 .

[34]  G. A. Marcoulides,et al.  Multilevel Analysis Techniques and Applications , 2002 .

[35]  George Leckie,et al.  The complexity of school and neighbourhood effects and movements of pupils on school differences in models of educational achievement , 2009 .

[36]  William L. Sanders,et al.  The tennessee value-added assessment system (TVAAS): Mixed-model methodology in educational assessment , 1994 .

[37]  Harvey Goldstein,et al.  Multiple membership multiple classification (MMMC) models , 2001 .

[38]  Stephen W. Raudenbush,et al.  A Crossed Random Effects Model for Unbalanced Data With Applications in Cross-Sectional and Longitudinal Research , 1993 .

[39]  Sreenivasan Ravi,et al.  Multilevel Statistical Models, 3rd edn , 2005 .

[40]  Luigi Biggeri,et al.  The transition from university to work: a multilevel approach to the analysis of the time to obtain the first job , 2001 .

[41]  Jee-Seon Kim,et al.  Multilevel Modeling with Correlated Effects , 2007 .

[42]  Daniel F. McCaffrey,et al.  Bayesian Methods for Scalable Multivariate Value-Added Assessment , 2007 .

[43]  Helen F. Ladd,et al.  Implementing value-added measures of school effectiveness: getting the incentives right , 2002 .

[44]  Alessandra Petrucci,et al.  Analysis of university course evaluations: from descriptive measures to multilevel models , 2004 .

[45]  J. Berkhof,et al.  Diagnostic Checks for Multilevel Models , 2008 .

[46]  James Algina,et al.  An Empirical Comparison of Statistical Models for Value-Added Assessment of School Performance , 2004 .

[47]  Stephen W. Raudenbush,et al.  What Are Value-Added Models Estimating and What Does This Imply for Statistical Practice? , 2004 .

[48]  L. Corrado Generalized Latent Variable Modeling: Multilevel, Longitudinal, and Structural Equation Models , 2005 .

[49]  Leonardo Grilli,et al.  The random‐effects proportional hazards model with grouped survival data: a comparison between the grouped continuous and continuation ratio versions , 2005 .

[50]  Stephen W. Raudenbush,et al.  The Estimation of School Effects , 1995 .

[51]  Ronald G. Ehrenberg,et al.  Econometric Studies of Higher Education. , 2004 .

[52]  S. Raudenbush,et al.  Causal Inference for Time-Varying Instructional Treatments , 2008 .

[53]  S. Bird,et al.  Performance indicators: good, bad, and ugly , 2004 .

[54]  H. Wainer Introduction to a Special Issue of the Journal of Educational and Behavioral Statistics on Value-Added Assessment , 2004 .

[55]  H. Goldstein,et al.  The limitations of using school league tables to inform school choice , 2009 .