1 TEACHING GROUPS AS FOCI FOR EVALUATING PERFORMANCE IN COST EFFECTUVENESS OF GCE ADVANCED LEVEL PROVISION : SOME PRACTICAL METHODOLOGICAL INNOVATIONS

The use of hierarchical models of educational effectiveness are reviewed. The paper also draws attention to the inadequacy of official performance indicators currently available and in particular the inattention to resource issues. Research on this issue using teaching group cost and performance has led the present author in collaboration with others to focus on costeffectiveness issues. These issues are discussed in the paper and draw out some new methodological issues. The concern is with evaluating the performance of students on GCE Advanced Level courses at the level of the subject group with the intention of relating this to identified teaching group costs. Since students belong to several groups standard hierarchical modelling which assumes responses at the individual level are independent are precluded. Thus models are adopted which cross classify students and groups and investigate the issue using the procedures of Rasbash and Goldstein (1994). The data arises from 6020 subject entries for 2280 candidates in 525 teaching groups from 14 institutions. The impact of ignoring the crossing on substantive results is examined. A further issue in cost-effectiveness work is differential teacher effectiveness since salaries are the largest component of costs. Hill and Rowe (1996) have attributed part of the reason for sparsity of work on teacher effectiveness to the fact that classes are exposed to several teachers. This paper approaches the issue through three way 1 Some parts of this paper were presented at the 10 International Congress on School Effectiveness and Improvement , University of Manchester Institute of Science and Technology, and at the Royal Statistical Society Birmingham Local Group , both in January 1998. Continuation of work has been supported under the Analysis of Large and Complex Datasets programme by the ESRC through award H51944500497 whilst the author was a Visiting Research Fellow at the Multilevel Models Project , University of London Institute of Education. Acknowledgements are due to Michael Healy and David Reynolds for helpful comments on earlier drafts.

[1]  Carol Taylor Fitz-Gibbon,et al.  Monitoring Education: Indicators, Quality and Effectiveness , 1996 .

[2]  B. Fraser,et al.  Student perceptions of psycho-social environment in classrooms of exemplary science teachers , 1989 .

[3]  A. Fielding Perspectives on Performance Indicators: GCE Advanced Level and Differences Between Institution Types in Cost Effectiveness∗ , 1998 .

[4]  H. Luyten,et al.  Parallel classes : Differences and similarities. Teacher effects and school effects in secondary schools , 1998 .

[5]  David H. Monk,et al.  Education Productivity Research: An Update and Assessment of Its Role in Education Finance Reform , 1992 .

[6]  H. Goldstein,et al.  Efficient Analysis of Mixed Hierarchical and Cross-Classified Random Structures Using a Multilevel Model , 1994 .

[7]  Hywel Thomas Education costs and performance : a cost-effectiveness analysis , 1990 .

[8]  Antony Fielding Institutional Disparities in the Cost Effectiveness of GCE 'A' Level Provision: a Multilevel Approach to the Student Perspective , 1993 .

[9]  Harvey Goldstein,et al.  Methods in School Effectiveness Research , 1997 .

[10]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[11]  Harvey Goldstein,et al.  League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance , 1996 .

[12]  R. Coe,et al.  School Effectiveness Research: criticisms and recommendations , 1998 .

[13]  H. Goldstein,et al.  Differential school effectiveness , 1989 .

[14]  Stephen W. Raudenbush,et al.  A Crossed Random Effects Model for Unbalanced Data With Applications in Cross-Sectional and Longitudinal Research , 1993 .

[15]  David N. Figlio Functional form and the estimated effects of school resources , 1999 .

[16]  H. Goldstein Multilevel Statistical Models , 2006 .

[17]  K. Rowe,et al.  Modelling Student Progress in Studies of Educational Effectiveness. , 1998 .

[18]  Eric A. Hanushek,et al.  The Economics of Schooling: Production and Efficiency in Public Schools , 1986 .

[19]  Min Yang,et al.  Progress from GCSE to A and AS Level: Institutional and gender differences, and trends over time , 2001 .

[20]  A. Fielding,et al.  Random Effects Models for Ordered Category Responses and Complex Structures in Educational Progress , 1999 .

[21]  W. Pile The Department of Education and Science , 1979 .

[22]  Harvey Goldstein,et al.  Multilevel Modeling of Educational Data With Cross-Classification and Missing Identification for Units , 1998 .

[23]  John C. Gray,et al.  HMI's interpretations of schools’ examination results , 1986 .

[24]  H. Goldstein,et al.  Using Examination Results as Indicators of School and College Performance , 1996 .

[25]  D. Young Rural and Urban Differences in Student Achievement in Science and Mathematics: A Multilevel Analysis. , 1998 .

[26]  Kenneth J. Rowe,et al.  Multilevel Modelling in School Effectiveness Research. , 1996 .