Peer evaluation in online anchored discussion for an increased local relevance of replies

This study investigates the use of an evaluation function to increase the local relevance of replies in online anchored discussion. Being implemented in a university course on French linguistics, a regular system for anchored discussion is compared with two versions that are enhanced with an integrated evaluation function. The function asks students to evaluate the relevance of each others' replies. To compare between experimental and control conditions, the collaboration protocols are analysed with a newly developed coding scheme for the local relevance of replies. Statistical processing of the data is done with a multilevel approach and results indicate that an evaluation function can effectively increase the local relevance of students' replies, but only if it is actually used to a certain extent. Using the evaluation function is hypothesized to increase students' awareness of the importance of writing relevant replies.

[1]  J. Roschelle.  Learning by Collaborating: Convergent Conceptual Change , 1992 .

[2]  Barbara Wasson,et al.  Designing for change in networked learning environments : proceedings of the International Conference on Computer Support for Collaborative Learning 2003 , 2003 .

[3]  Christopher M. Hoadley,et al.  Between information and communication: middle spaces in computer media for learning , 1999, CSCL.

[4]  Päivi Häkkinen,et al.  Web-based Cases in Teaching and Learning – the Quality of Discussions and a Stage of Perspective Taking in Asynchronous Communication , 2002, Interact. Learn. Environ..

[5]  Alejandra Martínez-Monés,et al.  From Mirroring to Guiding: A Review of State of the Art Technology for Supporting Collaborative Learning , 2005, Int. J. Artif. Intell. Educ..

[6]  Jerry Andriessen,et al.  Where is Education Heading and How About AI , 1999 .

[7]  Alan R. Dennis,et al.  Rethinking media richness: towards a theory of media synchronicity , 1999, Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers.

[8]  Sherry Hsiao-Rai Hsi.  Facilitating knowledge integration in science through electronic discussion: The Multimedia Forum Kiosk , 1997 .

[9]  S. Garrod,et al.  Group Discussion as Interactive Dialogue or as Serial Monologue: The Influence of Group Size , 2000, Psychological science.

[10]  L. Lipponen,et al.  Models of Innovative Knowledge Communities and Three Metaphors of Learning , 2004 .

[11]  Ulrike Cress,et al.  Improving quality and quantity of contributions: Two models for promoting knowledge exchange with shared databases , 2007, Comput. Educ..

[12]  Hans van der Meij,et al.  An examination of interactional coherence in email use in elementary school , 2005, Comput. Hum. Behav..

[13]  Cathy Bishop-Clark,et al.  The use of computer-mediated communication to enhance subsequent face-to-face discussions , 2001, Comput. Hum. Behav..

[14]  Barbara Wasson,et al.  Designing for Change in Networked Learning Environments, Proceedings of the International Conference on Computer Support for Collaborative Learning, CSCL 2003, Bergen, Norway, June 14-18, 2003 , 2003, CSCL.

[15]  Susan C. Herring.  Interactional Coherence in CMC , 1999, J. Comput. Mediat. Commun..

[16]  Judith C. Lapadat,et al.  Written Interaction: A Key Component in Online Learning , 2006, J. Comput. Mediat. Commun..

[17]  P. Robert-Jan Simons,et al.  The affordance of anchored discussion for the collaborative processing of academic texts , 2006, Int. J. Comput. Support. Collab. Learn..

[18]  Pierre Tchounikine,et al.  Supporting Emergence of Threaded Learning Conversations Through Augmenting Interactional and Sequential Coherence , 2003, CSCL.

[19]  A. L. Veerman,et al.  Computer-supported collaborative learning through argumentation , 2000 .

[20]  Bryan Smith,et al.  The Use of Communication Strategies in Computer-Mediated Communication , 2003 .

[21]  J. Gill.  Hierarchical Linear Models , 2005 .

[22]  W. R. Sharp,et al.  A Steering and Visualization Toolkit for Distributed Applications , 2006, PDPTA.

[23]  David Bargeron,et al.  Supporting interaction outside of class: anchored discussions vs. discussion boards , 2002, CSCL.

[24]  Colin Tattersall,et al.  Encouraging contributions in learning networks using incentive mechanisms , 2005, J. Comput. Assist. Learn..

[25]  J. Guthrie.  Encyclopedia of Education , 2002 .

[26]  H. H. Clark.  Arenas of language use , 1993 .

[27]  Laurence R. Horn,et al.  The handbook of pragmatics , 2004 .

[28]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[29]  N. Webb,et al.  Promoting effective helping behavior in peer-directed groups , 2003 .

[30]  Matthias Nückles,et al.  The assessment tool: a method to support asynchronous communication between computer experts and laypersons , 2006, Comput. Hum. Behav..