Grading More Accurately

Grades matter. College grading systems, however, are often ad hoc and prone to mistakes. This essay focuses on one factor that contributes to high-quality grading systems: grading accuracy (or “efficiency”). I proceed in several steps. First, I discuss the elements of “efficient” (i.e., accurate) grading. Next, I present analytical results indicating how often our grading schemes are likely to be inefficient, and I also discuss the causes for grading inefficiency. The following sections describe ways to make our grading systems more efficient, especially by increasing the number of scores and by providing clearer guidance on what constitutes high-quality performance. Finally, I offer data from my own “natural” experiment in grading and offer some concluding comments.

[1]  M. Cresswell Examination Grades: how many should there be? , 1986 .

[2]  Sally Brown,et al.  Assessment Matters in Higher Education: Choosing and Using Diverse Approaches. , 1999 .

[3]  B. Tuck,et al.  THE INFLUENCE OF CONTEXT POSITION AND SCORING METHOD ON ESSAY SCORING , 1980 .

[4]  Robert J. Marzano,et al.  Transforming Classroom Grading , 2000 .

[5]  C. Rust The Impact of Assessment on Student Learning , 2002 .

[6]  Edward Tokar,et al.  THE EFFECT OF THE QUALITY OF PRECEDING RESPONSES ON THE GRADES ASSIGNED TO SUBSEQUENT RESPONSES TO AN ESSAY QUESTION , 1975 .

[7]  K. Topping Peer Assessment Between Students in Colleges and Universities , 1998 .

[8]  P. Knight,et al.  Assessing learners in higher education , 1998 .

[9]  Joanna Bull,et al.  Assessing student learning in higher education , 1997 .

[10]  J. Suls,et al.  Flawed Self-Assessment , 2004, Psychological science in the public interest : a journal of the American Psychological Society.

[11]  Margaret Goddard Spear The Biasing Influence of Pupil Sex in a Science Marking Exercise , 1984 .

[12]  Carol O. Sweedler-Brown The Effect of Training on the Appearance Bias of Holistic Essay Graders. , 1992 .

[13]  Peter E. Kennedy A Guide to Econometrics , 1979 .

[14]  Thomas R. Guskey,et al.  Developing Grading and Reporting Systems for Student Learning , 2000 .

[15]  John A. Daly,et al.  Contrast Effects in Evaluating Essays. , 1982 .

[16]  J. Norcini,et al.  Peer assessment of competence , 2003, Medical education.

[17]  M. Carnoy,et al.  Does External Accountability Affect Student Outcomes? A Cross-State Analysis , 2002 .

[18]  Abd El-Rahman,et al.  Improving the quality of student learning , 2003 .