Mark my words: the role of assessment criteria in UK higher education grading practices

This article seeks to illuminate the gap between UK policy and practice in relation to the use of criteria for allocating grades. It critiques criterion-referenced grading from three perspectives. Twelve lecturers from two universities were asked to ‘think aloud’ as they graded two written assignments. The study found that assessors made holistic rather than analytical judgements. A high proportion of the tutors did not make use of written criteria in their marking and, where they were used, it was largely a post hoc process in refining, checking or justifying a holistic decision. Norm referencing was also found to be an important part of the grading process despite published criteria. The authors develop the notion of tutors’ standards frameworks, influenced by students’ work, and providing the interpretive lens used to decide grades. The implications for standards, and for students, of presenting the grading process as analytical and objective are discussed.

[1]  Eleanor Hawe,et al.  'It's Pretty Difficult to Fail': The reluctance of lecturers to award a failing grade , 2003 .

[2]  L. Elton,et al.  Assessment in universities: a critical review of research , 2002 .

[3]  Susan Orr,et al.  Assessment moderation: constructing the marks and constructing the students , 2007 .

[4]  S. Shay.  The Assessment of Complex Performance: A Socially Situated Interpretive Act. , 2004 .

[5]  P. Smagorinsky.  Thinking and speech and protocol analysis , 1998 .

[6]  D. Royce Sadler,et al.  Specifying and Promulgating Achievement Standards , 1987 .

[7]  Chris Rust,et al.  Developing student understanding of assessment standards: a nested hierarchy of approaches , 2008 .

[8]  H. Simon,et al.  How to Study Thinking in Everyday Life: Contrasting Think-Aloud Protocols With Descriptions and Explanations of Thinking , 1998 .

[9]  D. Carless.  Differing perceptions in the feedback process , 2006 .

[10]  D. Royce Sadler,et al.  Interpretations of criteria‐based assessment and grading in higher education , 2005 .

[11]  J. Jawitz.  Learning in the academic workplace: the harmonization of the collective and the individual habitus , 2009 .

[12]  Margo Blythman,et al.  Transparent opacity: assessment in the inclusive academy , 2005 .

[13]  Carol Bond,et al.  Undergraduates' experiences of critical thinking , 2004 .

[14]  D. Royce Sadler,et al.  Indeterminacy in the use of preset criteria for assessment and grading , 2009 .

[15]  Mantz Yorke,et al.  Faulty signals?:Inadequacies of grading systems and a possible response , 2009 .

[16]  Barbara Ritter,et al.  An Analysis of Expert Nurse Practitioners’ Diagnostic Reasoning , 2003, Journal of the American Academy of Nurse Practitioners.

[17]  Stella González Arnal,et al.  Tacit Knowledge and Public Accounts , 2003 .

[18]  J. Ritchie,et al.  Qualitative Research Practice: A Guide for Social Science Students and Researchers , 2013 .

[19]  Qualitatively different ways of differentiating student achievement: a phenomenographic study of academics’ conceptions of grade descriptors , 2004 .

[20]  Stuart R. Phinn,et al.  A generic framework for criterion-referenced assessment of undergraduate essays , 1999 .

[21]  Susan Bloxham,et al.  Examining the tension between academic standards and inclusion for disabled students: the impact on marking of individual academics' frameworks for assessment , 2010 .

[22]  Susan Bloxham,et al.  Marking and moderation in the UK: false assumptions and wasted resources , 2009 .

[23]  Suellen Shay,et al.  The assessment of complex tasks: a double reading , 2005 .

[24]  P. Bourdieu,et al.  实践与反思 : 反思社会学导引 = An invitation to reflexive sociology , 1994 .

[25]  Peter Knight,et al.  The local practices of assessment , 2006 .

[26]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[27]  David Baume,et al.  What is happening when we assess, and how can we use our understanding of this to improve assessment? , 2004 .

[28]  D. Royce Sadler,et al.  Transforming Holistic Assessment and Grading into a Vehicle for Complex Learning , 2009 .

[29]  Marie Stowell.  Equity, Justice and Standards: Assessment Decision Making in Higher Education. , 2004 .

[30]  Mantz Yorke,et al.  Assessment Learning and Employability , 2003 .

[31]  P. Grainger,et al.  Judging quality through substantive conversations between markers , 2008 .

[32]  Chris Rust,et al.  The experience of introducing a common criteria assessment grid across an academic department , 1999 .

[33]  Pierre Bourdieu,et al.  The State Nobility: Elite Schools in the Field of Power , 1998 .

[34]  Ginette Delandshere,et al.  Implicit Theories, Unexamined Assumptions and the Status Quo of Educational Assessment , 2001 .

[35]  J. Greatorex,et al.  What do GCSE examiners think of ‘thinking aloud’? Findings from an exploratory study , 2008 .

[36]  Jonathan W Schooler,et al.  Skimming the Surface , 2004, Psychological science.

[37]  S. Bloxham,et al.  Developing Effective Assessment in Higher Education: A Practical Guide , 2007 .

[38]  Kathryn Ecclestone,et al.  'I know a 2:1 when I see it': Understanding criteria for degree classifications in franchised university programmes , 2001 .

[39]  E. Eisner.  The Art Of Educational Evaluation: A Personal View , 1985 .

[40]  Investigating the judgemental marking process: an overview of our recent research , .

[41]  Harvey Woolf,et al.  Assessment criteria: reflections on current practices , 2004 .