The quality and effectiveness of descriptive rubrics

This review synthesizes the findings of studies of the use of rubrics in education settings published from 2005 to 2013. The review included studies only if the rubrics involved met the definition of having coherent sets of criteria and performance level descriptions for those criteria. Compared to the results of a previous review by Jonsson and Svingby (Educational Research Review 2(2): 130–144, 2007), the frequency, scope, and rigor of studies of rubrics have increased in recent years. Rubrics yield information of sufficient quality if certain conditions are met, most notably having clear and focused criteria. Evidence regarding the effects of rubrics on performance is positive overall. Evidence of the effects of rubrics on self-regulation of learning is mixed, though positive associations between rubric use and motivation to learn were identified in some studies.

[1]  Jon F. Schamber,et al.  Assessing and Improving the Quality of Group Critical Thinking Exhibited in the Final Projects of Collaborative Learning Groups , 2006, The Journal of General Education.

[2]  Dawn Iacobucci,et al.  Advancing Alpha: Measuring Reliability with Confidence , 2003 .

[3]  William J. Sumrall,et al.  Assessing Student Scientific Expression Using Media: The Media-Enhanced Science Presentation Rubric (MESPR) , 2011 .

[4]  Christopher F. Bauer,et al.  Validation of an Assessment Rubric via Controlled Modification of a Classroom Activity. , 2012 .

[5]  B. Everitt,et al.  Statistical methods for rates and proportions , 1973 .

[6]  B. Zimmerman.  Motivational Sources and Outcomes of Self-Regulated Learning and Performance , 2011 .

[7]  Heidi Andrade,et al.  Assessment-Driven Improvements in Middle School Students’ Writing , 2009 .

[8]  Rebecca J. Howell,et al.  Exploring the Impact of Grading Rubrics on Academic Performance: Findings from a Quasi-Experimental, Pre-Post Evaluation. , 2011 .

[9]  Ernesto Panadero,et al.  Rubrics and Self-Assessment Scripts Effects on Self-Regulation, Learning and Self-Efficacy in Secondary Education. , 2012 .

[10]  Lorrie A. Knight.  Using rubrics to assess information literacy , 2006 .

[11]  A. Dunning,et al.  The use of scoring rubrics to determine clinical performance in the operating suite. , 2009, Nurse education today.

[12]  Anders Jonsson,et al.  The use of transparency in the ‘Interactive examination’ for student teachers , 2010 .

[13]  H. Andrade,et al.  Student perspectives on rubric-referenced assessment , 2005 .

[14]  Heidi Andrade,et al.  Putting Rubrics to the Test: The Effect of a Model, Criteria Generation, and Rubric‐Referenced Self‐Assessment on Elementary School Students' Writing , 2008 .

[15]  Christine Y. Mason,et al.  Impact of Arts Integration on Voice, Choice, and Access , 2008 .

[16]  H. Andrade,et al.  A review of rubric use in higher education , 2010 .

[17]  S. Brookhart.  The public understanding of assessment in educational reform in the United States , 2013 .

[18]  R. Schwartzstein,et al.  Developing a Peer Assessment of Lecturing Instrument: Lessons Learned , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[19]  Christian D. Schunn,et al.  Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives , 2006 .

[20]  Mustafa Sabri Kocakülah,et al.  Development and Application of a Rubric for Evaluating Students’ Performance on Newton’s Laws of Motion , 2010 .

[21]  Harry Torrance.  Assessment as learning? How the use of explicit learning objectives, assessment criteria and feedback in post‐secondary education and training can come to dominate learning. 1 , 2007 .

[22]  J. Cady,et al.  Teachers' use of rubrics to score non‐traditional tasks: factors related to discrepancies in scoring , 2006 .

[23]  Roger W Moni,et al.  Student perceptions and use of an assessment rubric for a group concept map in physiology. , 2008, Advances in physiology education.

[24]  Jan Chappuis,et al.  Creating & Recognizing Quality Rubrics , 2006 .

[25]  Deborah S. Stryker,et al.  Developing a Culture of Assessment through a Faculty Learning Community: A Case Study , 2009 .

[26]  Debra Kerby,et al.  Develop Oral Presentation Skills Through Accounting Curriculum Design and Course-Embedded Assessment , 2009 .

[27]  Susan Avanzino.  Starting from Scratch and Getting Somewhere: Assessment of Oral Communication Proficiency in General Education Across Lower and Upper Division Courses , 2010 .

[28]  H. Andrade,et al.  Rubric-Referenced Self-Assessment and Self-Efficacy for Writing , 2009 .

[29]  Richard C. Anderson,et al.  Measuring Argumentative Reasoning: What's behind the Numbers?. , 2009 .

[30]  Assessment, Gender and In/Equity , 2009 .

[31]  Lisa M. Schreiber,et al.  The Development and Test of the Public Speaking Competence Rubric , 2012 .

[32]  K. Glenk,et al.  Validity and Reliability , 2008, Environmental Valuation with Discrete Choice Experiments.

[33]  Edward E. Prather,et al.  A Study of General Education Astronomy Students' Understandings of Cosmology. Part III. Evaluating Four Conceptual Cosmology Surveys: An Item Response Theory Approach. , 2011 .

[34]  Lucy K. Spence.  Discerning Writing Assessment: Insights into an Analytical Rubric , 2010 .

[35]  Mark T. Williams,et al.  An Inter-Institutional Model for College Writing Assessment. , 2008 .

[36]  Charles R. Ciorba,et al.  Measurement of Instrumental and Vocal Undergraduate Performance Juries Using a Multidimensional Assessment Rubric , 2009 .

[37]  Helen Gerretson,et al.  Synopsis of the Use of Course-Embedded Assessment in a Medium Sized Public University's General Education Program , 2005 .

[38]  Glenn W. Lambie,et al.  A Choice Theory Counseling Group Succeeds with Middle School Students Who Displayed Disciplinary Problems , 2008 .

[39]  Anders Jonsson,et al.  The Use of Scoring Rubrics for Formative Assessment Purposes Revisited: A Review. , 2013 .

[40]  Jennifer L. Fisette,et al.  Development of PE Metrics Elementary Assessments for National Physical Education Standard 1 , 2011 .

[41]  Sarah L. Ash,et al.  Integrating Reflection and Assessment to Capture and Improve Student Learning , 2005 .

[42]  J. Paris.  Performance assessment. , 1998, Journal of public health medicine.

[43]  Ernesto Panadero,et al.  Rubrics vs. self-assessment scripts effect on self-regulation, performance and self-efficacy in pre-service teachers , 2013 .

[44]  Shelley B Brundage,et al.  Formative feedback, rubrics, and assessment of professional competency through a speech-language pathology graduate program. , 2010, Journal of allied health.

[45]  P. Lemons,et al.  A New Method for Assessing Critical Thinking in the Classroom , 2006 .

[46]  H. Andrade,et al.  Rubric‐referenced self‐assessment and middle school students’ writing , 2010 .

[47]  G. Cizek,et al.  Handbook of Formative Assessment. , 2010 .

[48]  Kelly A. Loeffler.  No More Friday Spelling Tests? , 2005 .

[49]  David A. Yopp,et al.  A Curriculum Focus Intervention's Effects on Prealgebra Achievement. , 2009 .

[50]  Arlen R. Gullickson,et al.  The student evaluation standards : how to improve evaluations of students , 2003 .

[51]  Ali Reza Rezaei,et al.  Reliability and validity of rubrics for assessment through writing , 2010 .

[52]  Mick McCormick,et al.  PERCEIVED GROWTH VERSUS ACTUAL GROWTH IN EXECUTIVE LEADERSHIP COMPETENCIES: AN APPLICATION OF THE STAIR-STEP BEHAVIORALLY ANCHORED EVALUATION APPROACH , 2007 .

[53]  Denise Strickland,et al.  Development of a ‘universal’ rubric for assessing undergraduates' scientific reasoning skills using scientific writing , 2011 .

[54]  Linda Rochford,et al.  Assessing Higher Level Learning: Developing Rubrics for Case Analysis , 2011 .

[55]  Tammy Schellens,et al.  Assessing collaboration in a wiki: The reliability of university students' peer assessment , 2011, Internet High. Educ..

[56]  Herbert Sherman,et al.  Incorporating Outcomes Assessment and Rubrics into Case Instruction , 2009 .

[57]  J J Norcini,et al.  Standards and reliability in evaluation: when rules of thumb don't apply. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[58]  K. Stiller,et al.  A clinical assessment tool used for physiotherapy students—Is it reliable? , 2008, Physiotherapy theory and practice.

[59]  Laura Reynolds-Keefer,et al.  Rubric-Referenced Assessment in Teacher Preparation: An Opportunity to Learn by Using. , 2010 .

[60]  Carolyn Haynes,et al.  Targeted Assessment Rubric: An Empirically Grounded Rubric for Interdisciplinary Writing , 2009 .

[61]  P. Sadler,et al.  The Impact of Self- and Peer-Grading on Student Learning , 2006 .

[62]  Malini Y. Reddy,et al.  Design and development of rubrics to improve assessment outcomes: A pilot study in a Master's level business program in India , 2011 .

[63]  Katrin R. Harich,et al.  Diagnostic and Value-Added Assessment of Business Writing , 2005 .

[64]  T. Wigram,et al.  Therapeutic Songwriting in Music Therapy , 2008 .

[65]  Arup Mukherjee,et al.  Assessing Critical Thinking: A College's Journey and Lessons Learned , 2007 .

[66]  Joanne Harris,et al.  Before-, During-, and After-Reading Strategies. , 2005 .

[67]  D. Macdonald,et al.  (Mis)appropriations of criteria and standards‐referenced assessment in a performance‐based subject , 2008 .

[68]  Susan M. Brookhart,et al.  How to Create and Use Rubrics for Formative Assessment and Grading , 2013 .

[69]  Stephen Brookfield,et al.  Assessing Critical Thinking , 1997 .

[70]  Ken Heller,et al.  Assessment of Student Problem Solving Processes , 2009 .

[71]  Katherine K. Perkins,et al.  Colorado Upper-Division Electrostatics diagnostic: A conceptual assessment for the junior level , 2012 .

[72]  Doncho Petkov,et al.  Development of Scoring Rubrics for IS Projects as an Assessment Tool , 2006 .

[73]  Jodie Harnden.  Scientific Inquiry Scoring Guides. , 2005 .

[74]  S. Reis,et al.  Fostering and Evaluating Reflective Capacity in Medical Education: Developing the REFLECT Rubric for Assessing Reflective Writing , 2012, Academic medicine : journal of the Association of American Medical Colleges.

[75]  Petra Kaufmann,et al.  Experimental And Quasi Experimental Designs For Research , 2016 .

[76]  Paul R. Pintrich,et al.  The Development of Academic Self-Regulation: The Role of Cognitive and Motivational Factors , 2002 .

[77]  Mark A. Stellmack,et al.  An Assessment of Reliability and Validity of a Rubric for Grading APA-Style Introductions , 2009 .

[78]  Eun-Jung Lee,et al.  Effects of Instructional Rubrics on Class Engagement Behaviors and the Achievement of Lesson Objectives by Students with Mild Mental Retardation and Their Typical Peers. , 2009 .

[79]  J. Fleiss.  The design and analysis of clinical experiments , 1987 .

[80]  R. García-Ros.  Analysis and validation of a rubric to assess oral presentation skills in university contexts , 2011 .

[81]  Anthony Milanowski,et al.  Measuring and promoting inter-rater agreement of teacher and principal performance ratings. , 2012 .

[82]  H. Andrade.  Using Rubrics To Promote Thinking and Learning. , 2000 .

[83]  Karen Moni,et al.  Using student feedback to construct an assessment rubric for a concept map in physiology. , 2005, Advances in physiology education.

[84]  Anders Jonsson,et al.  The use of scoring rubrics: Reliability, validity, and educational consequences , 2007 .

[85]  M. Coe,et al.  An Investigation of the Impact of the 6+1 Trait Writing Model on Grade 5 Student Writing Achievement. Final Report. NCEE 2012-4010. , 2011 .