Understanding the benefits of providing peer feedback: how students respond to peers’ texts of varying quality

Prior research on peer assessment often overlooks how much students learn from providing feedback to peers. By practicing revision skills, students might strengthen their ability to detect, diagnose, and solve writing problems. However, both reviewer ability and the quality of the peers’ texts affect the amount of practice available to learners. Therefore, the goal of the current study is to provide a first step towards a theoretical understanding about why students learn from peer assessment, and more specifically from providing feedback to peers. Students from a large Introduction to Psychological Science course were assigned four peers’ papers to review. The reviewing ability of each student was determined, and to whom the students provided feedback was manipulated. The features and focus of the comments from a sample of 186 participants were coded, and the amount of each type was analyzed. Overall, reviewer ability and text quality did not affect the amount of feedback provided. Instead, the content of the feedback was affected by reviewer ability. Low reviewers provided more praise than high reviewers, whereas high reviewers provided more criticism than low reviewers. This criticism from high reviewers described more problems and offered more solutions, and it focused more often on high prose and substance. In the only significant reviewer ability × text quality interaction, high reviewers described more problems in the low-quality texts than in the high-quality texts, whereas low reviewers did not make this distinction. These results suggest that high reviewers and low reviewers may utilize different commenting styles, which could significantly impact the benefits of peer assessment.

[1]  Young Hoan Cho,et al.  Peer reviewers learn from giving comments , 2011 .

[2]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[3]  A. Newell Unified Theories of Cognition , 1990 .

[4]  K. Topping Trends in Peer Learning , 2005 .

[5]  Keith Topping,et al.  Paradoxical effects of feedback in international online reciprocal peer tutoring , 2013, Comput. Educ..

[6]  H. Roediger Twelve Tips for Reviewers , 2007 .

[7]  C. Schunn,et al.  The Nature of Feedback: How Peer Feedback Features Affect Students' Implementation Rate and Quality of Revisions. , 2016 .

[8]  Allen and Rosenbloom Paul S. Newell,et al.  Mechanisms of Skill Acquisition and the Law of Practice , 1993 .

[9]  John R. Anderson,et al.  The Transfer of Cognitive Skill , 1989 .

[10]  Christian D. Schunn,et al.  The Effects of Feedback Elaboration on the Giver of Feedback , 2008 .

[11]  Zhidong Zhang,et al.  Understanding the Effectiveness of Online Peer Assessment: A Path Model , 2012 .

[12]  G. Logan Toward an instance theory of automatization. , 1988 .

[13]  Christian D. Schunn,et al.  The nature of feedback: how different types of peer feedback affect writing performance , 2009 .

[14]  M. Daane,et al.  The Nation's Report Card: Writing, 2002. , 2003 .

[15]  Kristi Lundstrom,et al.  To give is better than to receive: The benefits of peer review to the reviewer's own writing , 2009 .

[16]  Kwangsu Cho,et al.  Learning by reviewing , 2011 .

[17]  D. Ferris The Influence of Teacher Commentary on Student Revision , 1997 .

[18]  Sheldon Rosenberg,et al.  Advances in applied psycholinguistics: List of contributors , 1987 .

[19]  Lan Li,et al.  Assessor or assessee: How student learning improves by giving and receiving peer feedback , 2010, Br. J. Educ. Technol..

[20]  L. Flower Detection, Diagnosis, and the Strategies of Revision , 1986, College Composition & Communication.

[21]  E. Thorndike,et al.  The influence of improvement in one mental function upon the efficiency of other functions. (I). , 1901 .

[22]  Michelene T. H. Chi,et al.  Self-Explanations: How Students Study and Use Examples in Learning To Solve Problems. Technical Report No. 9. , 1987 .

[23]  Lan Li,et al.  Give and take: A re-analysis of assessor and assessee's roles in technology-facilitated peer assessment , 2012, Br. J. Educ. Technol..

[24]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[25]  Christian D. Schunn,et al.  Students’ perceptions about peer assessment for writing: their origin and impact on revision work , 2011 .

[26]  Christian D. Schunn,et al.  The effects of skill diversity on commenting and revisions , 2013 .

[27]  David L. Wallace,et al.  Redefining Revision for Freshmen , 1991, Reading Empirical Research Studies: The Rhetoric of Research.

[28]  J. Hayes,et al.  A Cognitive Process Theory of Writing , 1981, College Composition & Communication.

[29]  M. Chi Constructing Self-Explanations and Scaffolded Explanations in Tutoring , 1996 .

[30]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[31]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[32]  N. Law,et al.  Online peer assessment: effects of cognitive and affective feedback , 2011, Instructional Science.

[33]  Christian D. Schunn,et al.  A validation study of students' end comments: Comparing comments by students, a writing instructor, and a content instructor , 2009 .

[34]  Matthew W. Lewis,et al.  Self-Explonations: How Students Study and Use Examples in Learning to Solve Problems , 1989, Cogn. Sci..

[35]  Christian D. Schunn,et al.  Scaffolded writing and rewriting in the discipline: A web-based reciprocal peer review system , 2007, Comput. Educ..

[36]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[37]  C. Schunn,et al.  Understanding the benefits of receiving peer feedback: A case of matching ability in peer-review , 2016 .

[38]  Richard A. Carlson,et al.  Learning to Write in a Genre: What Student Writers Take from Model Texts. , 1995 .

[39]  N. Falchikov,et al.  Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks , 2000 .

[40]  Jan-Willem Strijbos,et al.  Unravelling peer assessment: Methodological, functional, and conceptual developments , 2010 .

[41]  Miwa Inuzuka Learning How to Write through Encouraging Metacognitive Monitoring: The Effect of Evaluating Essays Written by Others , 2005 .