Improving learning through whole-school evaluation: moving towards a model of internal evaluation in Irish post-primary schools

This study explores the concept of school evaluation and in particular how the Irish education system and post-primary schools can successfully move from a centrally controlled system of evaluation to a model based on school self-evaluation. Within a context of increasing interest in school evaluation nationally and internationally, the relationship between evaluation, decentralised decision making and increased school autonomy is discussed. The purpose of evaluation and its importance in fulfilling accountability and improvement needs is acknowledged. The impact of the introduction of whole-school evaluation (WSE), as a model of external evaluation, on schools whose quality assurance heretofore was assessed predominantly through state examinations is investigated. The formal introduction of internal evaluation to schools in Ireland, advanced through recent social partnership agreements, anticipates that schools will assess their teaching and learning practices through the use of a specific framework. The extent to which post-primary schools engage in internal evaluation and the support required to enhance this is examined. The experience of key personnel in the Irish education system was explored to increase knowledge and gain deeper understanding of school evaluation and its impact on the quality of education provided. Reflections and insights of inspectors who take responsibility for external evaluation, of support service personnel who provide support for school leadership and for school development planning, and of principals of post-primary schools were obtained through the use of focus groups. Their views were analysed using a number of themes. In particular, the role of evaluation in creating schools as learning organisations was investigated. The absence of teachers’ voices in particular, and of students’ and parents’ voices, is acknowledged as a limitation in the study. Results of the research indicate that support provided to assist schools to engage in school development planning, combined with the experience, support and pressure of external WSE, has laid the foundation for the introduction of internal evaluation. Collaborative improvement processes have been initiated, on which internal evaluation can be based. While aspects of external evaluation are criticised, there is general acceptance that a model that balances external and internal evaluation is desirable. The need for clear guidelines and appropriate support is stressed. Crucially, the model of internal evaluation proposed is one of reflection and inquiry, using suitable benchmarks and data, and taking account of context to ensure that evaluation assists schools in becoming learning organisations.

[1]  C. Lodge,et al.  Transforming School Improvement now and for the Future , 2003 .

[2]  H. Simons School self-evaluation in a democracy , 2002 .

[3]  P. Senge The fifth discipline : the art and practice of the learningorganization , 2006 .

[4]  Kenneth Leithwood,et al.  School leadership in the context of accountability policies , 2001 .

[5]  Moving Together: A Partnership Approach to Improvement , 1996 .

[6]  L. Easton From Professional Development to Professional Learning , 2008 .

[7]  P. Earley,et al.  Teacher Gradings and OfSTED Inspections: Help or hindrance as a management tool? , 1998 .

[8]  B. Creemers Towards a Theory on Educational Effectiveness. , 1993 .

[9]  R. Stake Qualitative Case Studies. , 2005 .

[10]  D. Hopkins,et al.  From Inspection to School Improvement? Evaluating the Accelerated Inspection Programme in Waltham Forest , 1999 .

[11]  Nathalie Baïdak,et al.  Evaluation of Schools Providing Compulsory Education in Europe. , 2004 .

[12]  Middle Level Teachers Using Focus Group Research , 2005 .

[13]  David Hopkins,et al.  Evaluation For School Development , 1989 .

[14]  K. Sirotnik Promoting Responsible Accountability in Schools and Education , 2002 .

[15]  P. Moore,et al.  The Development of an Indicator System for the Affective and Social Schooling Outcomes for Primary and Secondary Students in Hong Kong , 2006 .

[16]  Jacqueline Davies,et al.  OFSTED and Afterwards? Schools' Responses to Inspection , 1998 .

[17]  A. Hubbell,et al.  Motivating factors: perceptions of justice and their relationship with managerial and organizational trust , 2005 .

[18]  Gaynelle R. Winograd,et al.  Organizational Trust: What It Means, Why It Matters , 2000 .

[19]  The differential improvement of schools causing concern in England , 2005 .

[20]  Halia Silins,et al.  What characteristics and processes define a school as a learning organisation? Is this a useful concept to apply to schools? , 2002 .

[21]  D. Hopkins,et al.  The Empowered School: The Management and Practice of Development Planning , 1991 .

[22]  School-based evaluation : an international perspective , 2002 .

[23]  Roderick A. Rose,et al.  Assessing the Functioning of Schools as Learning Organizations , 2007 .

[24]  John MacBeath,et al.  Schools Must Speak for Themselves: The Case for School Self-Evaluation , 1999 .

[25]  John E. C. MacBeath,et al.  School Inspection and Self-Evaluation: Working with the new relationship , 2006 .

[26]  S. Thomas,et al.  Developing school evaluation methods to improve the quality of schooling in China: a pilot ‘value added’ study , 2006 .

[27]  Anthony S. Bryk,et al.  Trust in Schools: A Core Resource for School Reform. , 2003 .

[28]  R. Barbour Making sense of focus groups , 2005, Medical education.

[29]  Richard A. Krueger,et al.  Developing Questions for Focus Groups , 1997 .

[30]  H. Luyten,et al.  The effect of school autonomy and school internal decentralization on students' reading literacy , 2007 .

[31]  신택현,et al.  조직효과성(Organizational Effectiveness)에 대한 새로운 관점 , 1993 .

[32]  J. Gray FRAMES OF REFERENCE AND TRADITIONS OF INTERPRETATION: SOME ISSUES IN THE IDENTIFICATION OF ‘UNDER-ACHIEVING’ SCHOOLS , 2004 .

[33]  Halia Silins,et al.  Schools as Learning Organisations - Effects on Teacher Leadership and Student Outcomes , 2004 .

[34]  Greg Dimitriadis,et al.  Focus Groups: Strategic Articulations of Pedagogy, Politics, and Inquiry. , 2005 .

[35]  Mike Schmoker Results: The Key to Continuous Improvement , 1996 .

[36]  J. Goodlad,et al.  Continuity and Change in the Pursuit of a Democratic Public Mission for Our Schools , 2008 .

[37]  G. McNamara,et al.  Workable Compromise or Pointless Exercise? , 2006 .

[38]  Roderick M. Kramer,et al.  Trust and distrust in organizations: emerging perspectives, enduring questions. , 1999, Annual review of psychology.

[39]  L. Monsen School-based evaluation in Norway: Why is it so difficult to convince teachers of its usefulness? , 2002 .

[40]  Bert P. M. Creemers From School Effectiveness and School Improvement to Effective School Improvement: Background, Theoretical Analysis, and Outline of the Empirical Study , 2002 .

[41]  P. Neil,et al.  An Approach to Analysing Professional Discourse in a School Self-Evaluation Project , 2005 .

[42]  Janet Mancini Billson,et al.  Focus Groups: A Practical Guide for Applied Research , 1989 .

[43]  H. Tan,et al.  Toward the differentiation of trust in supervisor and trust in organization. , 2000, Genetic, social, and general psychology monographs.

[44]  Brian Wilcox,et al.  Inspecting Schools: Holding Schools to Account and Helping Schools to Improve , 1996 .

[45]  D. Hargreaves,et al.  A Capital Theory of School Effectiveness and Improvement , 2001 .

[46]  P. Earley,et al.  What Do Schools Do after OFSTED School Inspections--Or Before?. , 1997 .

[47]  Martin Guha,et al.  The Sage Handbook of Qualitative Research (3rd edition) , 2006 .

[48]  Mike Wallace,et al.  Creating and Sustaining Effective Professional Learning Communities , 2005 .

[49]  P. Black,et al.  Working inside the Black Box: Assessment for Learning in the Classroom , 2004 .

[50]  D. Reynolds,et al.  Improving Schools: Performance and Potential , 1999 .

[51]  M. Ehren,et al.  TOWARDS A THEORY ON THE IMPACT OF SCHOOL INSPECTIONS , 2006 .

[52]  Matthew Rice,et al.  Under coverThe fifth discipline: the art and practice of the learning organisation Senge Peter , 2006 .

[53]  P. Hill,et al.  Educational Accountability in a Regulated Market , 2006 .

[54]  Normalizing the Educated Subject: A Foucaultian Analysis of High-Stakes Accountability , 2006 .

[55]  P. Mortimore,et al.  Improving School Effectiveness , 2001 .

[56]  J. Ivey Focus groups. , 2011, Pediatric nursing.

[57]  Alma Harris,et al.  Organizational Effectiveness And Improvement In Education , 1997 .

[58]  Skills Delivering Equality Of Opportunity In Schools - An Action Plan for Educational Inclusion , 2005 .

[59]  G. McNamara,et al.  Internal review and self-evaluation — the chosen route to school improvement in ireland? , 2005 .

[60]  Barbara MacGilchrist,et al.  Planning Matters: The Impact of Development Planning in Primary Schools , 1995 .

[61]  H. Gardner Responsibility at work : how leading professionals act (or don't act) responsibly , 2007 .

[62]  Beverly B. Kasper Educational Reform 1983-1994: New Ideas or the Rebirth of Quintilian's Ideologies?. , 2005 .

[63]  Brian Fidler,et al.  Improvement Through Inspection? : Complementary Approaches to School Development , 1996 .

[64]  B. Creemers,et al.  Contextual factors and effective school improvement , 2007 .

[65]  Megan Tschannen-Moran,et al.  Trust Matters: Leadership for Successful Schools , 2004 .

[66]  R. Mitchell,et al.  The Political Economy of Education Policy: The Case of Class Size Reduction , 2003 .

[67]  A. Hargreaves Teaching and Betrayal , 2002 .

[68]  P. Cuckle,et al.  Developments in Development Planning in English Primary Schools: 1994-2001 , 2003 .

[69]  Louise Stoll,et al.  Professional Learning Community , 2010 .

[70]  J. Brooks Organizational Learning: Improving Learning, Teaching, and Leading in School Systems , 2008 .

[71]  Jane Perryman School leadership and management after Special Measures: discipline without the gaze? , 2005 .

[72]  A. Hargreaves,et al.  Teaching and Betrayal [ 1 ] , 2003 .

[73]  J. Doyle Strategic Direction and Development of the School , 1999 .

[74]  R. Hofman,et al.  School Self‐evaluation instruments: An assessment Framework , 2005 .

[75]  I. A. Jóhannesson,et al.  An Inevitable Progress? Educational restructuring in Finland, Iceland and Sweden at the turn of the millennium , 2002 .

[76]  J. Scheerens School self-evaluation: Origins, definition, approaches, methods and implementation , 2002 .

[77]  Rob Walker Case Study, Case Records and Multimedia , 2002 .

[78]  F. Leeuw Reciprocity and Educational Evaluations by European Inspectorates: Assumptions and reality checks , 2002 .

[79]  Richard A. Krueger,et al.  Analyzing and Reporting Focus Group Results , 1997 .

[80]  Maurice Holt The new structure of School improvement: inquiring schools and achieving students , 2000 .

[81]  L. Stoll,et al.  Changing Our Schools , 1996 .

[82]  P. Black,et al.  Inside the Black Box: Raising Standards through Classroom Assessment , 2010 .

[83]  John White,et al.  Accountability and School Inspection: In Defence of Audited Self‐Review , 2001 .

[84]  Linda Darling-Hammond Standards, Accountability, and School Reform , 2004, Teachers College Record: The Voice of Scholarship in Education.

[85]  R. Breen,et al.  A Practical Guide to Focus-Group Research , 2006 .

[86]  Joel Waldfogel,et al.  Introduction , 2010, Inf. Econ. Policy.

[87]  W. Martz Evaluating Organizational Effectiveness , 2008 .

[88]  J. Macbeath,et al.  School self‐evaluation and the role of a critical friend , 2005 .