Heterogeneity, school-effects and the North/South achievement gap in Italian secondary education: evidence from a three-level mixed model

With the aim of assessing the extent of the differences in the context of Italian educational system, the paper applies multilevel modeling to a new administrative dataset, containing detailed information for more than 500,000 students at grade 6 in the year 2011/2012, provided by the Italian Institute for the Evaluation of Educational System. Data are grouped by classes, schools and geographical areas. Different models for each area are fitted, in order to properly address the heteroscedasticity of the phenomenon. The results show that it is possible to estimate statistically significant “school effects”, i.e., the positive/negative association of attending a specific school and the student’s test score, after a case-mix adjustment. Therefore, the paper’s most important message is that school effects are different in terms of magnitude and types in the three geographical macro areas (Northern, Central and Southern Italy) and are dependent on specific students’ and schools’ characteristics.

[1]  Alex J. Bowers,et al.  Examining the Multiple Trajectories Associated with Dropping Out of High School: A Growth Mixture Model Analysis , 2012 .

[2]  Francesca Ieva,et al.  Detecting and visualizing outliers in provider profiling via funnel plots and mixed effect models , 2014, Health Care Management Science.

[3]  Harvey Goldstein,et al.  Partitioning variation in multilevel models , 2002 .

[4]  Harvey Goldstein,et al.  The Influence of Secondary and Junior Schools on Sixteen Year Examination Performance: A Cross‐classified Multilevel Analysis∗ , 1997 .

[5]  Roel Bosker,et al.  Multilevel analysis : an introduction to basic and advanced multilevel modeling , 1999 .

[6]  Stephen Gorard,et al.  How Unstable are ‘School Effects’ Assessed by a Value-Added Technique? , 2012 .

[7]  Therese D. Pigott,et al.  A Review of Methods for Missing Data , 2001 .

[8]  Anna Vignoles,et al.  The effect of school resources on pupil attainment: a multilevel simultaneous equation modelling approach , 2007 .

[9]  Francesca Ieva,et al.  Does class matter more than school? Evidence from a multilevel statistical analysis on Italian junior secondary school students , 2016 .

[10]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data: Little/Statistical Analysis with Missing Data , 2002 .

[11]  H. Goldstein.  Multilevel Statistical Models , 2006 .

[12]  Jonathan J Deeks,et al.  In the context of performance monitoring, the caterpillar plot should be mothballed in favor of the funnel plot. , 2008, The Annals of thoracic surgery.

[13]  Paolo Sestito,et al.  Value-Added Measures in Italian High Schools: Problems and Findings , 2010 .

[14]  Mia Hubert,et al.  Clustering in an object-oriented environment , 1997 .

[15]  D. Spiegelhalter,et al.  Funnel plots for institutional comparison , 2002, Quality & safety in health care.

[16]  Paolo Sestito,et al.  School cheating and social capital , 2014 .

[17]  Francesca Ieva,et al.  Performance assessment using mixed effects models: a case study on coronary patient care , 2012 .

[18]  Giorgio Vittadini,et al.  Regional Economic Disparities as Determinants of Students' Achievement in Italy , 2012 .

[19]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[20]  Andrew McConney,et al.  Does the SES of the School Matter? An Examination of Socioeconomic Status and Student Achievement Using PISA 2003 , 2010, Teachers College Record: The Voice of Scholarship in Education.

[21]  J. Heckman,et al.  Hard Evidence on Soft Skills , 2012, Labour economics.

[22]  H. Goldstein,et al.  The limitations of using school league tables to inform school choice , 2009 .

[23]  G. Brunello,et al.  When the Cat is Near, the Mice Won't Play: The Effect of External Examiners in Italian Schools , 2012, SSRN Electronic Journal.

[24]  Francesco Bartolucci,et al.  Assessment of School Performance Through a Multilevel Latent Markov Rasch Model , 2009, 0909.4961.

[25]  Stephen Raudenbush,et al.  A longitudinal hierarchical linear models for estimating school e?ects and their stability , 1989 .

[26]  Daniele Checchi,et al.  Territorial Differences in Italian Students' Mathematical Competencies: Evidence from PISA 2003 , 2007 .

[27]  B. Wolfe,et al.  The Determinants of Children's Attainments: A Review of Methods and Findings , 1995 .

[28]  Harvey Goldstein,et al.  Fitting multilevel multivariate models with missing data in responses and covariates that may include interactions and non‐linear terms , 2014 .

[29]  George Leckie,et al.  Children's educational progress: partitioning family, school and area effects , 2010 .

[30]  H. Pan,et al.  A Multilevel Analysis of School Examination Results , 1993 .

[31]  Ian Plewis,et al.  Contextual variations in ethnic group differences in educational attainments , 2011 .

[32]  David J Spiegelhalter,et al.  Funnel plots for comparing institutional performance , 2005, Statistics in medicine.

[33]  Adriana Di Liberto,et al.  Education and Italian regional development , 2008 .

[34]  Daniele Checchi,et al.  School Quality and Family Background in Italy , 2003 .

[35]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .