The centrality of teachers’ judgement practice in assessment: a study of standards in moderation

There is a strong quest in several countries including Australia for greater national consistency in education and intensifying interest in standards for reporting. Given this, it is important to make explicit the intended and unintended consequences of assessment reform strategies and the pressures to pervert and conform. In a policy context that values standardisation, the great danger is that the technical, rationalist approaches that generalise and make superficial assessment practices, will emerge. In this article, the authors contend that the centrality and complexity of teacher judgement practice in such a policy context need to be understood. To this end, we discuss and analyse recorded talk in teacher moderation meetings showing the processes that teachers use as they work with stated standards to award grades (A to E). We show how they move to and fro between (1) supplied textual artefacts, including stated standards and samples of student responses, (2) tacit knowledge of different types, drawing into the moderation, and (3) social processes of dialogue and negotiation. While the stated standards play a part in judgement processes, in and of themselves they are shown to be insufficient to account for how the teachers ascribe value and award a grade to student work in moderation. At issue is the nature of judgement as cognitive and social practice in moderation and the legitimacy (or otherwise) of the mix of factors that shape how judgement occurs.

[1]  Louise Hayward,et al.  The journey so far: assessment for learning in Scotland , 2005 .

[2]  Examining how teachers judge student writing: an Australian case study , 2005 .

[3]  Graham S. Maxwell.  Quality management of school-based assessments: Moderation of teacher judgments , 2006 .

[4]  P. Black,et al.  Towards Coherence Between Classroom Assessment and Accountability (103rd Yearbook of the National Society for the Study of Education) , 2004 .

[5]  P. R. Freebody,et al.  Background rationale and specifications: Queensland Curriculum, Assessment and Reporting Framework , 2005 .

[6]  Jannette Elwood,et al.  Creating communities of shared practice: Assessment use in learning and teaching , 2002 .

[7]  D. Royce Sadler,et al.  Specifying and Promulgating Achievement Standards , 1987 .

[8]  D. Sadler,et al.  Formative Assessment: revisiting the territory , 1998 .

[9]  C. Gipps.  Beyond Testing: Towards a Theory of Educational Assessment , 1994 .

[10]  D. Prozesky,et al.  Assessment of Learning , 2020, The SAGE Encyclopedia of Higher Education.

[11]  G. Kress.  Linguistic Processes in Sociocultural Practice , 1985 .

[12]  Mehmet Aydeniz,et al.  Formative Assessment: Improving Learning in Secondary Classrooms , 2009 .

[13]  D. Royce Sadler,et al.  The Origins and Functions of Evaluative Criteria , 1985 .

[14]  A. Luke.  After the marketplace: Evidence, social science and educational research , 2003 .

[15]  R. L. Lim.  Linking Results of Distinct Assessments , 1993 .

[16]  V. Voloshinov.  Marxism and the philosophy of language , 1973 .

[17]  C. P. Goodman,et al.  The Tacit Dimension , 2003 .

[18]  P. Freebody,et al.  The assessment of literacy: working the zone between 'system' and 'site' validity , 2009 .

[19]  Mark R. Wilson,et al.  Towards coherence between classroom assessment and accountability , 2004 .

[20]  D. Sadler.  Formative assessment and the design of instructional systems , 1989 .

[21]  P. Freebody,et al.  Assessment as Judgment-in-Context: Analysing how teachers evaluate students' writing 1 , 2007 .

[22]  Robert Stake,et al.  Standards-based & responsive evaluation , 2003 .

[23]  Etienne Wenger,et al.  Communities of Practice: Learning, Meaning, and Identity , 1998 .

[24]  L. Shepard.  The Role of Assessment in a Learning Culture , 2000 .

[25]  G. Maxwell.  Implications for Moderation of Proposed Changes to Senior Secondary School Syllabuses , 2006 .

[26]  Chris Rust,et al.  Know what I mean? Enhancing student understanding of assessment standards and criteria , 2004 .

[27]  Wynne Harlen,et al.  Teachers' summative practices and assessment for learning – tensions and synergies , 2005 .

[28]  J. Hattie.  What is the nature of evidence that makes a difference to learning , 2013 .

[29]  J. Elkins,et al.  Teacher judgment: Building an evidentiary base for quality literacy and numeracy education. , 2006 .

[30]  S. R. Shaw.  Education and the Arts , 1980 .

[31]  Susan M. Bridges,et al.  Designing professional learning for effecting change: Partnerships for local and system networks , 2008 .

[32]  G. Maxwell.  Moderation of Assessments in Vocational Education and Training , 2001 .

[33]  Barbara Y. White,et al.  Designing Assessments for Instruction and Accountability: An Application of Validity Theory to Assessing Scientific Inquiry , 2004, Teachers College Record: The Voice of Scholarship in Education.