Peer Assessment Enhances Student Learning: The Results of a Matched Randomized Crossover Experiment in a College Statistics Class

Feedback has a powerful influence on learning, but it is also expensive to provide. In large classes it may even be impossible for instructors to provide individualized feedback. Peer assessment is one way to provide personalized feedback that scales to large classes. Besides these obvious logistical benefits, it has been conjectured that students also learn from the practice of peer assessment. However, this has never been conclusively demonstrated. Using an online educational platform that we developed, we conducted an in-class matched-set, randomized crossover experiment with high power to detect small effects. We establish that peer assessment causes a small but significant gain in student achievement. Our study also demonstrates the potential of web-based platforms to facilitate the design of high-quality experiments to identify small effects that were previously not detectable.

[1]  B. Bloom The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring , 1984 .

[2]  P. Sadler,et al.  The Impact of Self- and Peer-Grading on Student Learning , 2006 .

[3]  A. Russell,et al.  Reducing the Gender Achievement Gap in College Science: A Classroom Study of Values Affirmation , 2010 .

[4]  David C. Haak,et al.  Increased Structure and Active Learning Reduce the Achievement Gap in Introductory Biology , 2011, Science.

[5]  N. Falchikov,et al.  Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks , 2000 .

[6]  Chen-Lin C. Kulik,et al.  Timing of Feedback and Verbal Learning , 1988 .

[7]  Chen-Lin C. Kulik,et al.  The Instructional Effect of Feedback in Test-Like Events , 1991 .

[8]  Arlene A. Russell,et al.  Web-Based Student Writing and Reviewing in a Large Biology Lecture Course , 2007 .

[9]  Wang Xiaoming,et al.  On-line Homework Management System☆ , 2012 .

[10]  Martin Chodorow,et al.  C-rater: Automated Scoring of Short-Answer Questions , 2003, Comput. Humanit..

[11]  John W. Parks,et al.  How Accurate Is Peer Grading? , 2010, CBE life sciences education.

[12]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[13]  N. Falchikov Improving Assessment through Student Involvement , 2005 .

[14]  Manuel Blum,et al.  reCAPTCHA: Human-Based Character Recognition via Web Security Measures , 2008, Science.

[15]  C. Reich Peer assessment. , 1985, Canadian Medical Association journal.

[16]  Adrien Treuille,et al.  Predicting protein structures with a multiplayer online game , 2010, Nature.

[17]  Justin Cheng,et al.  Peer and self assessment in massive online classes , 2013, ACM Trans. Comput. Hum. Interact..

[18]  Jeffrey H Silber,et al.  Optimal multivariate matching before randomization. , 2004, Biostatistics.

[19]  Anna N. Rafferty,et al.  Computer-Guided Inquiry to Improve Science Learning , 2014, Science.

[20]  K. Topping Peer Assessment Between Students in Colleges and Universities , 1998 .

[21]  F. Lord Applications of Item Response Theory To Practical Testing Problems , 1980 .

[22]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[23]  Loren Olson,et al.  CritViz: Web-Based Software Supporting Peer Critique in Large Creative Classrooms , 2013 .