Understanding the Effectiveness of Online Peer Assessment: A Path Model

Peer assessment has been implemented in schools as both a learning tool and an assessment tool. Earlier studies have explored the effectiveness of peer assessment from different perspectives, such as domain knowledge and skills, peer assessment skills, and attitude changes. However, there is no holistic model describing the effects of cognitive and affective feedback, grading, and prior knowledge, and earlier studies often discuss learning outcomes without ascribing them to particular causes. Moreover, few studies have differentiated between the effects of peer assessment on both assessors and assessees. This study used a path model to investigate how two online peer-assessment activities—rubric-based assessment and peer feedback—affected the learning performance of assessors and assessees. One hundred and eighty-one high school students engaged in peer assessment via an online system—iLAP. Several path models were tested and we found that the original model did not fit when the variable of cognitive feedback from peers was included. The best fit model was the one in which direct paths from cognitive feedback from peers and student exam scores in a prior Humanities course were removed.

[1]  M. Lepper,et al.  The effects of praise on children's intrinsic motivation: a review and synthesis. , 2002, Psychological bulletin.

[2]  Shyan-Ming Yuan,et al.  Developing science activities through a networked peer assessment system , 2002, Comput. Educ..

[3]  Barbara M. Moskal,et al.  Scoring Rubrics: What, When and How? , 2000 .

[4]  H. Engelhardt,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods.Anthony S. Bryk , Stephen W. Raudenbush , 1994 .

[5]  Yun Xiao,et al.  The impact of two types of peer assessment on students' performance and satisfaction within a Wiki environment , 2008, Internet High. Educ..

[6]  Wing Wah Ki,et al.  Using Web 2.0 technology to support learning, teaching and assessment in the NSS Liberal Studies subject , 2009 .

[7]  Anders Jonsson,et al.  The use of scoring rubrics: Reliability, validity, and educational consequences , 2007 .

[8]  D. Rowntree.  Assessing Students: How Shall We Know Them? , 1977 .

[9]  Patrick Onghena,et al.  Improving the effectiveness of peer feedback for learning , 2009 .

[10]  Nancy Falchikov,et al.  Learning Together: Peer Tutoring in Higher Education , 2001 .

[11]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[12]  Jyh-Chong Liang,et al.  The development of science activities via on-line peer assessment: the role of scientific epistemological views , 2009 .

[13]  Bruce Saddler,et al.  The Writing Rubric. , 2004 .

[14]  Yao-Ting Sung,et al.  Evaluating Proposals for Experiments: An Application of Web-Based Self-Assessment and Peer-Assessment , 2003 .

[15]  Chin-Chung Tsai,et al.  On-line peer assessment and the role of the peer feedback: A study of high school computer course , 2007, Comput. Educ..

[16]  Lan Li,et al.  Assessor or assessee: How student learning improves by giving and receiving peer feedback , 2010, Br. J. Educ. Technol..

[17]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[18]  Chen-Lin C. Kulik,et al.  The Instructional Effect of Feedback in Test-Like Events , 1991 .

[19]  K. Topping,et al.  Formative Peer Assessment of Academic Writing Between Postgraduate Students , 2000 .

[20]  Peter M. Bentler,et al.  EQS : structural equations program manual , 1989 .

[21]  Chin-Chung Tsai,et al.  University Students’ Perceptions of and Attitudes Toward (Online) Peer Assessment , 2006 .

[22]  Richard Straub,et al.  Students' Reactions to Teacher Comments: An Exploratory Study. , 1997 .

[23]  D. Sluijsmans,et al.  Effective peer assessment processes: Research findings and future directions , 2010 .

[24]  P. Sadler,et al.  The Impact of Self- and Peer-Grading on Student Learning , 2006 .

[25]  J. V. van Merriënboer,et al.  Training teachers in peer-assessment skills: effects on performance and perceptions , 2004 .

[26]  Vicki L. Brakel Olson,et al.  The revising processes of sixth-grade writers with and without peer feedback. , 1990 .

[27]  T. Chan,et al.  A web‐based learning system for question‐posing and peer assessment , 2005 .

[28]  Nancy Falchikov,et al.  PRODUCT COMPARISONS AND PROCESS BENEFITS OF COLLABORATIVE PEER GROUP AND SELF ASSESSMENTS , 1986 .

[29]  D. Ferris.  The Influence of Teacher Commentary on Student Revision , 1997 .

[30]  Phil Davies,et al.  Peer assessment: judging the quality of students’ work by comments rather than marks , 2006 .

[31]  R. C. Murray,et al.  Towards a Theory of Learning During Tutoring. , 1995 .

[32]  E. Ziegel,et al.  Basic Principles of Structural Equation Modelling , 1996 .

[33]  Eric Zhi-Feng Liu,et al.  Web-based peer assessment: feedback for students with various thinking-styles , 2001, J. Comput. Assist. Learn..

[34]  Clare Brindley,et al.  Peer Assessment in Undergraduate Programmes , 1998 .

[35]  H. Andrade.  Using Rubrics To Promote Thinking and Learning. , 2000 .

[36]  D. Carless,et al.  Peer feedback: the learning element of peer assessment , 2006 .

[37]  Eric Zhi-Feng Liu,et al.  Web-based peer review: the learner as both adapter and reviewer , 2001, IEEE Trans. Educ..

[38]  Christian D. Schunn,et al.  The nature of feedback: how different types of peer feedback affect writing performance , 2009 .

[39]  T. Crooks.  The Impact of Classroom Evaluation Practices on Students , 1988 .

[40]  Barbara M. Byrne,et al.  Structural equation modeling with EQS : basic concepts, applications, and programming , 2000 .

[41]  C. Reich.  Peer assessment. , 1985, Canadian Medical Association journal.

[42]  J. H. Steiger.  Structural Model Evaluation and Modification: An Interval Estimation Approach. , 1990, Multivariate behavioral research.

[43]  John C. Hafner,et al.  Quantitative analysis of the rubric as an assessment tool: an empirical study of student peer‐group rating , 2003 .

[44]  Yu-Fen Yang,et al.  A reciprocal peer review system to support college students' writing , 2011, Br. J. Educ. Technol..

[45]  K. Topping,et al.  Peer Assisted Learning: A Framework for Consultation , 2001 .

[46]  Chin-Chung Tsai,et al.  Internet-Based Peer Assessment in High School Settings , 2009 .

[47]  R. Mueller.  Basic Principles of Structural Equation Modeling: An Introduction to LISREL and EQS , 1996 .

[48]  P. Orsmond,et al.  The Importance of Marking Criteria in the Use of Peer Assessment , 1996 .

[49]  Neil Ellman.  Peer Evaluation and Peer Grading. , 1975 .

[50]  K. Topping.  Peer Assessment Between Students in Colleges and Universities , 1998 .