Rubrics on the Fly: Improving Efficiency and Consistency with a Rapid Grading and Feedback System

Many learning management systems (LMS) used in higher education provide customizable rubrics that aid in the process of grading and providing feedback for many forms of assessments commonly used by educators today. Rapid Grade is a grading and feedback feature built into a non-commercialized LMS developed by a large, public, Midwestern university in the United States. In this research, Rapid Grade was compared to a grading and feedback system found in one of the most utilized LMS found in higher education. It should be noted that the name of this particular LMS is not named. Using the Technology Acceptance Model to validate that Rapid Grade empirically improves upon existing methods, survey results indicate that Rapid Grade is a significant improvement in terms of ease of use and usefulness when grading and providing feedback for a given assessment. The Rapid Grade framework as well as the specific results of the TAM is presented.

[1]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[2]  Mary Kathryn Thompson,et al.  The Development of an Online Grading System for Distributed Grading in a Large First Year Project-Based Design Course , 2012 .

[3]  R. Likert.  “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[4]  Doug Tudhope,et al.  Reconfiguring the User: , 2000 .

[5]  Sean P. McGlynn,et al.  Automated, Web-Based, Second-Chance Homework , 2001 .

[6]  Diomidis Spinellis,et al.  Coping with plagiarism and grading load: Randomized programming assignments and reflective grading , 2007, Comput. Appl. Eng. Educ..

[7]  Michele M. Dornisch,et al.  Limitations of web-based rubric resources: Addressing the challenges , 2006 .

[8]  Paul Beynon-Davies,et al.  ‘It’s lots of bits of paper and ticks and post‐it notes and things . . .’: a case study of a rapid application development project , 2000, Inf. Syst. J..

[9]  Sandra L. Ramey,et al.  Using a written communication rubric to improve students' writing , 2007 .

[10]  Desmond A. Butler.  Closing the loop 21st century style : providing feedback on written assessment via MP3 recordings , 2011 .

[11]  Siu Cheung Hui,et al.  Automatic summary assessment for intelligent tutoring systems , 2009, Comput. Educ..

[12]  Carl L. Gordon,et al.  Systems Analysis and Design: Current Practices , 1987, MIS Q..

[13]  Joseph P. Martino.  Handbook of systems analysis: Craft issues and procedural choices , 1990 .

[14]  D. Atkinson,et al.  Improving assessment processes in Higher Education: Student and teacher perceptions of the effectiveness of a rubric embedded in a LMS , 2013 .

[15]  Guy Fitzgerald,et al.  Where now for development methodologies? , 2003, CACM.

[16]  Andrew Lim,et al.  On automated grading of programming assignments in an academic institution , 2003, Comput. Educ..

[17]  H. Andrade.  Using Rubrics To Promote Thinking and Learning. , 2000 .

[18]  John A. Kaliski,et al.  Improving the Efficiency and Effectiveness of Grading Through the Use of Computer-Assisted Grading Rubrics , 2008 .

[19]  Rebecca J. Howell,et al.  Exploring the Impact of Grading Rubrics on Academic Performance: Findings from a Quasi-Experimental, Pre-Post Evaluation. , 2011 .

[20]  Ellen Stevens,et al.  The Role of Rubrics in Advancing and Assessing Student Learning , 2007 .

[21]  H. Andrade.  Teaching With Rubrics: The Good, the Bad, and the Ugly , 2005 .

[22]  Bruce S. Cooper,et al.  Rubrics in Education: Old Term, New Meanings , 2011 .

[23]  M. Machado,et al.  Blackboard vs. moodle: Comparing user experience of learning management systems , 2007, 2007 37th Annual Frontiers In Education Conference - Global Engineering: Knowledge Without Borders, Opportunities Without Passports.

[24]  Peter M. Chen.  An automated feedback system for computer organization projects , 2004, IEEE Transactions on Education.

[25]  Joseph Klein,et al.  Impairment of teacher efficiency during extended sessions of test correction , 2003 .