The Design and Evaluation of a Peer Ratings System for Online Learning Communities

In this paper we explore the idea that ratings systems, common across successful e-commerce sites, can better engage individuals in online learning networks. To test this we implement a ratings system as a mechanism for influencing social interaction in our university's online learning community (OLC). Our research measures the impact this system had on five graduate courses over the course of two semesters. Our research also provides insight into how user-driven content can provide input into other systems, such as a recommender system to aid in fostering new online social connections.

[1]  H. Russell Bernard,et al.  Social Research Methods: Qualitative and Quantitative Approaches , 2000 .

[2]  John Short,et al.  The social psychology of telecommunications , 1976 .

[3]  Jennifer Preece,et al.  Lurker demographics: counting the silent , 2000, CHI.

[4]  Brian Thoms,et al.  Online learning communities in the New 'U' , 2009 .

[5]  James V. Wertsch,et al.  Grounding Social Identity for Professional Practice , 2004 .

[6]  Hugh Somervell,et al.  Issues in Assessment, Enterprise and Higher Education: the case for self‐peer and collaborative assessment , 1993 .

[7]  Christopher G. Lasater,et al.  Design Patterns , 2008, Wiley Encyclopedia of Computer Science and Engineering.

[8]  Kenton O'Hara,et al.  Social Impact , 2019, Encyclopedia of Food and Agricultural Ethics.

[9]  Xu Zhou,et al.  A trust model of p2p system based on confirmation theory , 2005, OPSR.

[10]  C. Tu,et al.  The Relationship of Social Presence and Interaction in Online Classes , 2002 .

[11]  Ashish Goel,et al.  Avoiding ballot stuffing in eBay-like reputation systems , 2005, P2PECON '05.

[12]  Sam Redfern,et al.  Collaborative Virtual Environments to Support Communication and Community in Internet-Based Distance Education , 2002, J. Inf. Technol. Educ..

[13]  R. Goffin,et al.  The self‐rater's personality and self‐other disagreement in multi‐source performance ratings: Is disagreement healthy? , 2007 .

[14]  Paul Resnick,et al.  Reputation Systems: Facilitating Trust in Internet Interactions , 2000 .

[15]  P. L. Adams.  THE ORIGINS OF INTELLIGENCE IN CHILDREN , 1976 .

[16]  L. Miles,et al.  Assessing contributions to group assignments , 2004 .

[17]  W. Neuman,et al.  Social Research Methods: Qualitative and Quantitative Approaches , 2002 .

[18]  Elizabeth Stacey,et al.  Social Presence Online: Networking Learners at a Distance , 2001, Education and Information Technologies.

[19]  Detmar W. Straub,et al.  Validation in Information Systems Research: A State-of-the-Art Assessment , 2001, MIS Q..

[20]  Susanne Bødker.  A Human Activity Approach to User Interfaces , 1989, Hum. Comput. Interact..

[21]  B. J. Fogg,et al.  Silicon sycophants: the effects of computers that flatter , 1997, Int. J. Hum. Comput. Stud..

[22]  Anabel Quan-Haase.  Trends in online learning communities , 2005, SIGG.

[23]  Monique Janneck,et al.  Community-Building with Web-Based Systems – Investigating a Hybrid Community of Students , 2004, Computer Supported Cooperative Work (CSCW).

[24]  Yaqub Rafiq,et al.  Peer Assessment of Group Projects in Civil Engineering , 1996 .

[25]  Jordi Sabater-Mir,et al.  Social ReGreT, a reputation model based on social relations , 2001, SECO.

[26]  Vladimiro Sassone,et al.  A framework for concrete reputation-systems with applications to history-based access control , 2005, CCS '05.

[27]  Paul Resnick,et al.  Reputation systems , 2000, CACM.

[28]  Nigel K. L. Pope,et al.  The impact of stress in self‐ and peer assessment , 2005 .

[29]  Masakazu Fujimoto,et al.  The active lurker: a new viewpoint for evaluating the influence of an in-house online community , 2002, SIGG.

[30]  Richard M. Felder,et al.  Peer Ratings in Cooperative Learning Teams , 1999 .

[31]  Sheizaf Rafaeli,et al.  Invisible participants: how cultural capital relates to lurking behavior , 2006, WWW '06.