Assessment rubrics: towards clearer and more replicable design, research and practice

‘Rubric’ is a term with a variety of meanings. As the use of rubrics has increased both in research and practice, the term has come to represent divergent practices. These range from secret scoring sheets held by teachers to holistic student-developed articulations of quality. Rubrics are evaluated, mandated, embraced and resisted based on often imprecise and inconsistent understandings of the term. This paper provides a synthesis of the diversity of rubrics, and a framework for researchers and practitioners to be clearer about what they mean when they say ‘rubric’. Fourteen design elements or decision points are identified that make one rubric different from another. This framework subsumes previous attempts to categorise rubrics, and should provide more precision to rubric discussions and debate, as well as supporting more replicable research and practice.

[1]  Gordon Joughin,et al.  Assessment, learning and judgement in higher education , 2009 .

[2]  Belita Gordon,et al.  The Relation Between Score Resolution Methods and Interrater Reliability: An Empirical Study of an Analytic Scoring Rubric , 2000 .

[3]  B. Macfarlane.  The morphing of academic practice: unbundling and the rise of the para-academic , 2011 .

[4]  H. Andrade,et al.  Student perspectives on rubric-referenced assessment , 2005 .

[5]  Symeon Retalis,et al.  Assessing students' performance using the learning analytics enriched rubrics , 2013, LAK '13.

[6]  Ernesto Panadero,et al.  To rubric or not to rubric? The effects of self-assessment on self-regulation, performance and self-efficacy , 2014 .

[7]  S. Lewis,et al.  Stool form scale as a useful guide to intestinal transit time. , 1997, Scandinavian journal of gastroenterology.

[8]  John C. Hafner,et al.  Quantitative analysis of the rubric as an assessment tool: an empirical study of student peer‐group rating , 2003 .

[9]  D. Royce Sadler,et al.  Indeterminacy in the use of preset criteria for assessment and grading , 2009 .

[10]  Jarene Fluckiger.  Single Point Rubric: A Tool for Responsible Student Self-Assessment , 2010 .

[11]  M. Gustafsson,et al.  Comparing student learning experiences of in-text commentary and rubric-articulated feedback: strategies for formative assessment , 2013 .

[12]  Matthew C. Makel,et al.  Facts Are More Important Than Novelty , 2014 .

[13]  D. Sadler.  Formative assessment and the design of instructional systems , 1989 .

[14]  Michele M. Dornisch,et al.  Limitations of web-based rubric resources: Addressing the challenges , 2006 .

[15]  Denise Strickland,et al.  Development of a ‘universal’ rubric for assessing undergraduates' scientific reasoning skills using scientific writing , 2011 .

[16]  W. Popham.  What's Wrong--and What's Right--with Rubrics. , 1997 .

[17]  T. Greenhalgh,et al.  Realist synthesis: Realist And Meta-narrative Evidence Syntheses – Evolving Standards (RAMESES) training materials , 2014 .

[18]  D. Royce Sadler,et al.  Transforming Holistic Assessment and Grading into a Vehicle for Complex Learning , 2009 .

[19]  K. Gansle,et al.  Elementary school teachers' perceptions of curriculum-based measures of written expression , 2006 .

[20]  笠間 慎太郎,et al.  Google Books Ngram Viewerの歯科領域への応用 : 検索用語から時代の変遷を読む , 2016 .

[21]  Larry H. Ludlow,et al.  A longitudinal approach to understanding course evaluations , 2005 .

[22]  Carlo P. Magno.  Assessing Higher Education Teachers Through Peer Assistance and Review , 2012 .

[23]  Harry Torrance.  Assessment as learning? How the use of explicit learning objectives, assessment criteria and feedback in post‐secondary education and training can come to dominate learning. 1 , 2007 .

[24]  Anders Jonsson,et al.  The use of scoring rubrics: Reliability, validity, and educational consequences , 2007 .

[25]  D. Boud,et al.  Sustainable assessment revisited , 2016 .

[26]  M. Simon,et al.  What's still wrong with rubrics: Focusing on the consistency of performance criteria across scale levels , 2004 .

[27]  Margarete Sandelowski,et al.  Mapping the Mixed Methods–Mixed Research Synthesis Terrain , 2012, Journal of mixed methods research.

[28]  G. Boulton‐Lewis.  Teaching for quality learning at university , 2008 .

[29]  H. Andrade,et al.  A review of rubric use in higher education , 2010 .

[30]  D. Anthony.  Evidence-based Policy: A Realist Perspective , 2007 .

[31]  Phillip Dawson,et al.  Beyond a Definition , 2014 .