Transforming quality evaluation

This paper outlines the preponderant approaches to external quality evaluation, including the purpose, focus, object, rationale, and methods of external evaluations. Accountability, compliance and, in some countries, control are much more frequent rationales for external monitoring than improvement. Research on the impact of quality monitoring is difficult because it is impossible to control all relevant factors to be able to map causal relationships. Arguably, such an endeavour is a positivist device that ignores the complexity and the wider socio‐political context of the quality phenomenon. Nonetheless, there is some impact research, which might be characterised as overview studies or close‐up studies. These studies reinforce the view that quality is about compliance and accountability and has, in itself, contributed little to any effective transformation of the student learning experience. Where changes to the student experience have taken place, this has arguably been the result of factors other than the external quality monitoring: at best the existence of the latter provides a legitimation for internally‐driven innovation. If quality evaluation is to be transformed to make it transforming it is time to reclaim quality evaluation from opportunistic politicians, re‐establish trust in higher education and focus attention on internal processes and motivators. Instead of politically acceptable methods, quality evaluation needs to adopt appropriate research methodologies. The paper will conclude by exploring the conditions under which quality evaluation might be transformed.

[1]  Mary Godfrey,et al.  What Works: Evidence‐based Policy and Practice in Public Services , 2001 .

[2]  Brian W. Hogwood Leon S. Robertson, Injuries: Causes, Control Strategies, and Public Policy , Lexington Books, 1983, 219 + xiv, £22.50. , 1984, Journal of Public Policy.

[3]  N. Jackson Internal academic quality audit in UK higher education: part II ‐ implications for a national quality assurance framework , 1997 .

[4]  B. Wilson Quality in Universities, Sir Robert Menzies Oration, 4 October 1995 , 1996 .

[5]  L. Harvey,et al.  Doing Sociology: A Practical Introduction , 1993 .

[6]  M. Barrow Quality‐management Systems and Dramaturgical Compliance , 1999 .

[7]  Mantz Yorke,et al.  Enhancement‐led Higher Education? , 1994 .

[9]  Lee Harvey,et al.  Evaluation for What? , 2002 .

[10]  J. Newton,et al.  Implementing an Institution-wide Learning and Teaching Strategy: Lessons in managing change , 2003 .

[11]  Paul Trowler,et al.  Academics Responding to Change: New Higher Education Frameworks and Academic Cultures , 1998 .

[12]  M. Henkel Academic Identities and Policy Change in Higher Education , 2000 .

[13]  M. Horsburgh,et al.  Quality Monitoring in Higher Education: the impact on student learning , 1999 .

[14]  Brian W. Hogwood,et al.  Policy Analysis For The Real World , 1984 .

[15]  J. Newton,et al.  Feeding the Beast or Improving Quality?: Academics' perceptions of quality assurance and quality monitoring , 2000 .

[16]  Lee Harvey,et al.  An Assessment of past and Current Approaches to Quality in Higher Education , 1998 .

[17]  J. Newton An Evaluation of the Impact of External Quality Monitoring on a Higher Education College (1993–98) , 1999 .

[18]  B. Askling Quality Monitoring as an Institutional Enterprise , 1997 .

[19]  R. Begg The Dialogue between Higher Education Research and Practice: 25 Years of EAIR , 2003 .

[20]  Gabrielle M Baldwin Quality Assurance in Australian Higher Education: the case of Monash University , 1997 .

[21]  John Hughes,et al.  Transforming Higher Education , 1997 .

[22]  Wietse de Vries Calidad, eficiencia y evaluación de la educación superior , 2005 .

[23]  D. J. Sherwin Quality in universities , 1995 .

[24]  M. Henkel,et al.  Responses of academe to quality reforms in higher education: A comparative study of england and Sweden , 1997 .

[25]  Lee Harvey,et al.  Critical Social Research , 1990 .

[26]  Lee Harvey,et al.  The End of Quality? , 2002 .

[27]  Yona Balyage,et al.  Evaluation of teaching in higher education. , 2001 .

[28]  R. Stones Strategic Context Analysis: A New Research Strategy for Structuration Theory , 1991 .