Multilevel Modelling in an Indicator System

Purposes and practical considerations enter into choices of statistical analysis methods. This paper considers the application of multilevel modelling to data from a Performance Monitoring system in the United Kingdom known as the A-level Information System (ALIS). The practical question concerned the extent to which it was important to use this more sophisticated model rather than simply using standard OLS regressions, given the kind of data dealt with in this particular monitoring system. We begin with a consideration of dependent variables (outcome indicators) and present an example of their apparent relationship to a process variable. The example is a springboard for a brief discussion of the purpose of a monitoring system. The results of applying ML 2 2 to the analysis of four dependent variables are then presented. The paper concludes with a discussion of the limitations of the data and an attempt to assess the role of multilevel modelling for this particular indicator system. Finally, a suggestion is made that a desirable piece of statistical software might be one delivering rapid-fire graphical bootstrapping.