Implementing summative assessment with a formative flavour: a case study in a large class

Abstract Teaching a large class can present real challenges in design, management and standardisation of assessment practices. One of the main dilemmas for university teachers is how to implement effective formative assessment practices with accompanying high-quality feedback consistently over time with large classroom groups. This article reports on how elements of formative practices can be implemented as part of summative assessment in very large undergraduate cohorts (n = 1500 in one semester), studying in different modes (on- and off-campus), with multiple markers, and under common cost and time constraints. Design features implemented include the use of exemplars, rubrics and audio feedback. The article draws on the reflections of the leading teacher, and argues that, for summative assessment to benefit learners, it should contain formative assessment elements. The teaching practices utilised in the case study provide some means to resolve the tensions between formative assessment and summative assessment that may be more generally applicable.

[1]  Alan J. Cann.  Engaging Students with Audio Feedback , 2014 .

[2]  B. Schmitz,et al.  Assessing self-regulated learning using diary measures with university students , 2011 .

[3]  D. Boud,et al.  Rethinking models of feedback for learning: the challenge of design , 2013 .

[4]  Ernesto Panadero,et al.  Co-creating rubrics: The effects on self-regulated learning, self-efficacy and performance of establishing assessment criteria with students , 2017 .

[5]  Sandra Wills,et al.  The RED Resource, Recognition - Enhancement - Development: The contribution of sessional teachers to higher education (Complete report) , 2008 .

[6]  Jon Mueller,et al.  The Authentic Assessment Toolbox: Enhancing Student Learning through Online Faculty Development , 2005 .

[7]  Tansy Jessop,et al.  The whole is greater than the sum of its parts: a large-scale study of students’ learning in response to different programme assessment patterns , 2014 .

[8]  Susan Armstrong,et al.  Constructive guidance and feedback for learning: the usefulness of exemplars, marking sheets and different types of feedback in a first year law subject , 2011 .

[9]  Karen Handley,et al.  From copying to learning: using exemplars to engage students with assessment criteria and feedback , 2011 .

[10]  Neal M. Kingston,et al.  Formative Assessment: A Meta-Analysis and a Call for Research , 2011 .

[11]  D. Boud.  Sustainable Assessment: Rethinking assessment for the learning society , 2000 .

[12]  David Boud,et al.  What is the problem with feedback , 2013 .

[13]  Josh McCarthy,et al.  Evaluating written, audio and video feedback in higher education summative assessment tasks , 2015 .

[14]  Anders Jonsson,et al.  Facilitating productive use of feedback in higher education , 2013 .

[15]  David Robert Peetz,et al.  The casual academic workforce and labour market segmentation in Australia , 2013 .

[16]  J. Strijbos,et al.  Scaffolding Self-Regulated Learning Through Self-Assessment and Peer Assessment: Guidelines for Classroom Implementation , 2016 .

[17]  Tom Lunt,et al.  ‘Are you listening please?’ The advantages of electronic audio feedback compared to written feedback , 2010 .

[18]  Jan McArthur,et al.  No longer exempt from good practice: using exemplars to close the feedback gap for exams , 2013 .

[19]  David Carless,et al.  Excellence in University Assessment: Learning from award-winning practice , 2015 .

[20]  Phillip Dawson,et al.  Assessment rubrics: towards clearer and more replicable design, research and practice , 2017 .

[21]  Teresa McConlogue,et al.  Making judgements: investigating the process of composing and receiving peer feedback , 2015 .

[22]  Amani Bell,et al.  Students’ perceptions of the usefulness of marking guides, grade descriptors and annotated exemplars , 2013 .

[23]  Jaclyn Broadbent.  Large class teaching: How does one go about the task of moderating large volumes of assessment? , 2018 .

[24]  Gavin T. L. Brown.  Teachers' conceptions of assessment: implications for policy and professional development , 2004 .

[25]  David Carless,et al.  Making productive use of exemplars: Peer discussion and teacher guidance for positive transfer of strategies , 2016 .

[26]  Anders Jonsson,et al.  The Use of Scoring Rubrics for Formative Assessment Purposes Revisited: A Review. , 2013 .

[27]  Yoon Jeon Kim,et al.  Formative and Stealth Assessment , 2014 .

[28]  Panadero Calderón,et al.  Ayudas instruccionales a la autoevaluación y la autorregulación=instructional help for self-assessment and self-regulation: evaluación de la eficacia de los guiones de autoevaluación frente a la de las rúbricas=evaluation of the efficacy of self-assessment scripts vs. rubrics , 2011 .

[29]  D. Royce Sadler,et al.  Specifying and Promulgating Achievement Standards , 1987 .

[30]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[31]  Anastasiya A. Lipnevich,et al.  Toward a Model of Student Response to Feedback , 2016 .

[32]  W. Popham.  What's Wrong--and What's Right--with Rubrics. , 1997 .

[33]  Peter Bolan,et al.  ‘I like the sound of that’ – an evaluation of providing audio feedback via the virtual learning environment for summative assessment , 2015 .

[34]  Rob Wass,et al.  An assessment arms race and its fallout: high-stakes grading and the case for slow scholarship , 2015 .

[35]  Claire Skinner.  What’s Wrong , 2013 .

[36]  D. Sadler.  Formative assessment and the design of instructional systems , 1989 .

[37]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[38]  Anders Jonsson,et al.  The use of scoring rubrics: Reliability, validity, and educational consequences , 2007 .

[39]  Stephen Merry,et al.  Students’ Attitudes to and Usage of Academic Feedback Provided Via Audio Files , 2008 .

[40]  Michael Phillips,et al.  Video-based feedback on student assessment: scarily personal , 2015 .

[41]  Royce Sadler,et al.  Ah!...So that's 'quality' , 2002 .

[42]  Peter L. Schwartz,et al.  Assessment : case studies, experience and practice from higher education , 2002 .

[43]  Jan-Willem Strijbos,et al.  Unravelling peer assessment: Methodological, functional, and conceptual developments , 2010 .

[44]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[45]  V. Shute.  Focus on Formative Feedback , 2007 .

[46]  Eric C. Nemec,et al.  Comparison of Audio Versus Written Feedback on Writing Assignments , 2016 .