The limitations of using school league tables to inform school choice

Summary. In England, so‐called ‘league tables’ based on examination results and test scores are published annually, ostensibly to inform parental choice of secondary schools. A crucial limitation of these tables is that the most recent published information is based on the current performance of a cohort of pupils who entered secondary schools several years earlier, whereas for choosing a school it is the future performance of the current cohort that is of interest. We show that there is substantial uncertainty in predicting such future performance and that incorporating this uncertainty leads to a situation where only a handful of schools’ future performances can be separated from both the overall mean and from one another with an acceptable degree of precision. This suggests that school league tables, including value‐added tables, have very little to offer as guides to school choice.

[1]  Christina M. Mastrangelo,et al.  Multilevel Statistical Models, 4th edition , 2011 .

[2]  H. Goldstein,et al.  A note on ‘The limitations of school league tables to inform school choice’ , 2011 .

[3]  Deborah Wilson,et al.  Performance Measures, Ranking and Parental Choice: An Analysis of the English School League Tables , 2008 .

[4]  Harvey Goldstein,et al.  School league tables: what can they really tell us? , 2008 .

[5]  David Afshartous,et al.  Avoiding ‘data snooping’ in multilevel and mixed effects models , 2007 .

[6]  J. Gray,et al.  Modelling patterns of improvement over time: value added trends in English secondary school performance across ten cohorts , 2007 .

[7]  Risto Lehtonen,et al.  Multilevel Statistical Models , 2005 .

[8]  S. Bird,et al.  Performance indicators: good, bad, and ugly , 2004 .

[9]  Sreenivasan Ravi,et al.  Multilevel Statistical Models, 3rd edn , 2005 .

[10]  J. Rasbash,et al.  A User's Guide to MLwiN version 2.0 , 2004 .

[11]  Harvey Goldstein,et al.  Partitioning variation in multilevel models , 2002 .

[12]  S. Thomas,et al.  Dimensions of Secondary School Effectiveness: Comparative Analyses Across Regions , 2001 .

[13]  H. Goldstein,et al.  Predicting the Future : the role of past performance in determining trends in institutional effectiveness at A level , 2001 .

[14]  Harvey Goldstein,et al.  Using Pupil Performance Data for Judging Schools and Teachers: Scope and limitations , 2001 .

[15]  Min Yang,et al.  Progress from GCSE to A and AS Level: Institutional and gender differences, and trends over time , 2001 .

[16]  Harvey Goldstein,et al.  The use of assessment data for school improvement purposes , 1999 .

[17]  R. Rumberger.  Hierarchical linear models: Applications and data analysis methods: and. Newbury Park, CA: Sage, 1992. (ISBN 0-8039-4627-9), pp. xvi + 265. Price: U.S. $45.00 (cloth) , 1997 .

[18]  Harvey Goldstein,et al.  League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance , 1996 .

[19]  H. Goldstein,et al.  Changes and Improvements in Schools Effectiveness: Trends over Five Years. , 1996 .

[20]  Thomas A. Louis,et al.  League tables and their limitations: Statistical issues in comparisons of institutional performance - Discussion , 1996 .

[21]  H. Goldstein,et al.  Using Examination Results as Indicators of School and College Performance , 1996 .

[22]  Stephen W. Raudenbush,et al.  The Estimation of School Effects , 1995 .

[23]  H. Goldstein,et al.  The Graphical Presentation of a Collection of Means , 1995 .

[24]  H. Pan,et al.  A Multilevel Analysis of School Examination Results , 1993 .

[25]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[26]  Stephen Raudenbush,et al.  A longitudinal hierarchical linear models for estimating school e?ects and their stability , 1989 .

[27]  H. Goldstein,et al.  Differential school effectiveness , 1989 .

[28]  H. Goldstein.  Multilevel mixed linear model analysis using iterative generalized least squares , 1986 .

[29]  Anthony S. Bryk,et al.  A Hierarchical Model for Studying School Effects , 1986 .

[30]  M. Aitkin,et al.  Statistical Modelling Issues in School Effectiveness Studies , 1986 .