Effects of an online team project-based learning environment with group awareness and peer evaluation on socially shared regulation of learning and self-regulated learning

ABSTRACT Recently, some studies proposed methods to promote socially shared regulation of learning (SSRL) level within a team because high SSRL levels enable an effective collaboration. Meanwhile, several studies also proposed methods in online collaboration to enhance individual self-regulated learning (SRL). Notably, most existing studies focused on proposing methods and tools either for enhancing SSRL level within a team or for enhancing individual SRL. A computer-supported collaborative learning (CSCL) environment with proper supports is promising for simultaneously enhancing the SSRL level within a team and individual SRL because SSRL and SRL have an inseparable relation and mutually influence during collaborative process. Based on the existing principles and theories, this work adopts the supports of group awareness and peer evaluation in CSCL with project-based learning. Group awareness (GA) can reveal collaborative behaviour of group members and regulate their participation while peer assessment (PE), which can appraise member’s contribution, can encourage individual responsibility and refine regulatory strategies. This study finds that the proposed group awareness and peer assessment (GAPE) (i.e. the experimental class) moderately reduces the free-rider effect and enhanced SSRL level and individual SRL, compared with NO-GAPE (i.e. the control group). Furthermore, this study also confirms that the perceived SSRL level can effectively predict individual SRL.

[1]  M. Vauras,et al.  Socially shared metacognition of dyads of pupils in collaborative mathematical problem-solving processes , 2011 .

[2]  Sanna Järvelä,et al.  Designing Simple Tools for Socially Shared Regulation: Experiences of Using Google Docs and Mobile SRL Tools in Mathematics Education , 2015, CSCL.

[3]  Paul A. Kirschner,et al.  Awareness of group performance in a CSCL-environment: Effects of peer feedback and reflection , 2010, Comput. Hum. Behav..

[4]  Daniel Bodemer,et al.  Group awareness in CSCL environments , 2011, Comput. Hum. Behav..

[5]  D. Laplane Thought and language. , 1992, Behavioural neurology.

[6]  Eric Zhi-Feng Liu,et al.  Alternatives to Instructor Assessment: A Case Study of Comparing Self and Peer Assessment with Instructor Assessment under a Networked Innovative Assessment Procedures , 2002 .

[7]  Tzu-Hua Wang,et al.  Developing Web-based assessment strategies for facilitating junior high school students to perform self-regulated learning in an e-Learning environment , 2011, Comput. Educ..

[8]  Linda R. Cooper,et al.  Exploring the transformative potential of project-based learning in university adult education , 2000 .

[9]  Lanqin Zheng A Socially Shared Regulation Approach to Improving Group Cohesion, Collective Efficacy, and Regulation Skills in CSCL , 2017 .

[10]  A. Kitsantas,et al.  Supporting Student Self-Regulated Learning in Problem-and Project-Based Learning. , 2013 .

[11]  P. Pintrich The role of goal orientation in self-regulated learning. , 2000 .

[12]  M. Vauras,et al.  SHARED-REGULATION AND MOTIVATION OF COLLABORATING PEERS: A CASE ANALYSIS , 2003 .

[13]  Hanna Järvenoja,et al.  Research on Motivation in Collaborative Learning: Moving Beyond the Cognitive–Situative Divide and Combining Individual and Social Processes , 2010 .

[14]  Friedrich W. Hesse,et al.  Evoking Knowledge and Information Awareness for Enhancing Computer-Supported Collaborative Problem Solving , 2009 .

[15]  Chao-hsiu Chen,et al.  The implementation and evaluation of a mobile self- and peer-assessment system , 2010, Comput. Educ..

[16]  Kipling D. Williams,et al.  Interpersonal Relations and Group Processes Social Loafing: a Meta-analytic Review and Theoretical Integration , 2022 .

[17]  L. Lipponen,et al.  Patterns of participation and discourse in elementary students’ computer-supported collaborative learning , 2003 .

[18]  Yong-Ming Huang,et al.  Using the UTAUT Model to Examine the Acceptance Behavior of Synchronous Collaboration to Support Peer Translation. , 2015 .

[19]  Sanna Järvelä,et al.  Socially Constructed Self-Regulated Learning and Motivation Regulation in Collaborative Learning Groups , 2011, Teachers College Record: The Voice of Scholarship in Education.

[20]  Georgios Tsaparlis,et al.  Student Self-Assessment of Higher-Order Cognitive Skills in College Science Teaching. , 1997 .

[21]  Anna Lee Socially shared regulation in computer-supported collaborative learning , 2014 .

[22]  V. Grau,et al.  Self and social regulation of learning during collaborative activities in the classroom: The interplay of individual and group cognition , 2012 .

[23]  Matthew W. Ohland,et al.  Development of a Theory-Based Assessment of Team Member Effectiveness , 2007 .

[24]  Chaoyun Liang,et al.  Constructing and evaluating online goal-setting mechanisms in web-based portfolio assessment system for facilitating self-regulated learning , 2013, Comput. Educ..

[25]  Annemarie S. Palincsar,et al.  Motivating Project-Based Learning: Sustaining the Doing, Supporting the Learning , 1991 .

[26]  Geoffrey J. Kennedy,et al.  Peer-assessment in Group Projects: Is It Worth It? , 2005, ACE.

[27]  Kirsti Lonka,et al.  Studying in higher education: students' approaches to learning, self‐regulation, and cognitive strategies , 2006 .

[28]  N. DiDonato Effective self- and co-regulation in collaborative learning groups: An analysis of how students regulate problem solving of authentic interdisciplinary tasks , 2013 .

[29]  Yuan-Cheng Lai,et al.  Harnessing Collaborative Annotations on Online Formative Assessments , 2013, J. Educ. Technol. Soc..

[30]  B. Rogoff Apprenticeship in Thinking: Cognitive Development in Social Context , 1990 .

[31]  Jian-Wei Lin,et al.  User acceptance in a computer-supported collaborative learning (CSCL) environment with social network awareness (SNA) support , 2019, Australasian Journal of Educational Technology.

[32]  Allyson F. Hadwin,et al.  CoNoteS2: A Software Tool for Promoting Self-Regulation , 2001 .

[33]  R. A. Olatoye,et al.  Self-Regulation and Peer Influence as Determinants of Senior Secondary School Students' Achievement in Science , 2014 .

[34]  Roger Azevedo,et al.  Does adaptive scaffolding facilitate students ability to regulate their learning with hypermedia? q , 2004 .

[35]  Hanna Salovaara,et al.  An exploration of students' strategy use in inquiry-based computer-supported collaborative learning , 2005, J. Comput. Assist. Learn..

[36]  Chi-Cheng Chang,et al.  Using a Web-based portfolio assessment system to elevate project-based learning performances , 2011, Interact. Learn. Environ..

[37]  Nada Dabbagh,et al.  Personal Learning Environments, social media, and self-regulated learning: A natural formula for connecting formal and informal learning , 2012, Internet High. Educ..

[38]  K. Topping,et al.  Transferable skills for online peer learning , 2004 .

[39]  Jeroen Janssen,et al.  Group awareness tools: It's what you do with it that matters , 2011, Comput. Hum. Behav..

[40]  B. Zimmerman,et al.  Motivation An Essential Dimension of Self-Regulated Learning , 2012 .

[41]  Steven C. Fleisher,et al.  Book Review: Motivation and Self-Regulated Learning: Theory, Research, and Applications by Edited by Dale H. Schunk and Barry J. Zimmerman (Lawrence Erlbaum Associates, 2008) , 2009 .

[42]  Charles M. Brooks,et al.  Free Riding in Group Projects and the Effects of Timing, Frequency, and Specificity of Criteria in Peer Assessments , 2003 .

[43]  Cheolil Lim,et al.  Promoting socially shared metacognitive regulation in collaborative project-based learning: a framework for the design of structured guidance , 2018 .

[44]  Jeroen Janssen,et al.  Visualization of participation: Does it contribute to successful computer-supported collaborative learning? , 2007, Comput. Educ..

[45]  Bradford A. Anderson Learning to Learn with Integrative Learning Technologies (ILT): A Practical Guide for Academic Success. By Anastasia Kitsantas and Nada Dabbagh . Charlotte, N.C.: Information Age Publishing, 2010. ix + 178 pages. ISBN 978-1-60752-302-4. $45.99. , 2012 .

[46]  S. Järvelä,et al.  Sequential and temporal characteristics of self and socially regulated learning , 2014 .

[47]  Jo McKenzie,et al.  SPARK, a confidential web-based template for self and peer assessment of student teamwork: benefits of evaluating across different subjects , 2002, Br. J. Educ. Technol..

[48]  Walter Bender,et al.  The Impact of Increased Awareness While Face-to-Face , 2007, Hum. Comput. Interact..

[49]  Nicolas Michinov,et al.  Improving productivity and creativity in online groups through social comparison process: New evidence for asynchronous electronic brainstorming , 2005, Comput. Hum. Behav..

[50]  John R. Mergendoller,et al.  Pervasive Management of Project Based Learning , 2006 .

[51]  Pierre Dillenbourg,et al.  Facilitating peer knowledge modeling: Effects of a knowledge awareness tool on collaborative learning outcomes and processes , 2011, Comput. Hum. Behav..

[52]  C. Burke,et al.  The impact of cross-training on team effectiveness. , 2002, The Journal of applied psychology.

[53]  Joseph A. Bonito,et al.  The Effect of Contributing Substantively on Perceptions of Participation , 2000 .

[54]  Hye-Jung Lee,et al.  Peer Evaluation in Blended Team Project-Based Learning: What Do Students Find Important? , 2009, J. Educ. Technol. Soc..

[55]  Chia-Wen Tsai The Effects of Feedback in the Implementation of Web-Mediated Self-Regulated Learning , 2010, Cyberpsychology Behav. Soc. Netw..

[56]  N. Falchikov,et al.  Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks , 2000 .

[57]  S. Järvelä,et al.  Self-Regulated, Co-Regulated, and Socially Shared Regulation of Learning , 2011 .

[58]  Alain Jaillet,et al.  Can Online Peer Assessment be Trusted? , 2009, J. Educ. Technol. Soc..

[59]  L.-C. Chang,et al.  Fostering self-regulated learning in a blended environment using group awareness and peer assistance as external scaffolds , 2016, J. Comput. Assist. Learn..

[60]  P. Kirschner,et al.  Toward a Framework for CSCL Research , 2013 .

[61]  Bin Hu,et al.  Supporting Group Awareness in Web Based Learning Environments , 2002, EDCIS.

[62]  Hsiu-Ping Yueh,et al.  Exploring Factors Affecting Students' Continued Wiki Use for Individual and Collaborative Learning: An Extended UTAUT Perspective. , 2015 .

[63]  Vive Kumar,et al.  Supporting Self-Regulated Learning with gStudy Software: The Learning Kit Project ** , 2006 .

[64]  Chia-Wen Tsai,et al.  The impact of an online project-based learning environment with group awareness support on students with different self-regulation levels: An extended-period experiment , 2016, Comput. Educ..

[65]  Daniel Bodemer,et al.  Tacit guidance for collaborative multimedia learning , 2011, Comput. Hum. Behav..

[66]  Friedrich W. Hesse,et al.  Guiding knowledge communication in CSCL via group knowledge awareness , 2011, Comput. Hum. Behav..

[67]  Phil Davies,et al.  Computerized Peer Assessment , 2000 .

[68]  Michael J. Middleton,et al.  Turning the Kaleidoscope: What We See When Self-Regulated Learning is Viewed With a Qualitative Lens , 2002 .

[69]  Paul A. Kirschner,et al.  Identifying the pitfalls for social interaction in computer-supported collaborative learning environments: a review of the research , 2003, Comput. Hum. Behav..

[70]  Myron H. Dembo,et al.  Self-Regulation of Academic Learning in Middle-Level Schools , 2000, The Elementary School Journal.

[71]  Sanna Järvelä,et al.  Enhancing socially shared regulation in collaborative learning groups: designing for CSCL regulation tools , 2014, Educational Technology Research and Development.

[72]  Chih-Yung Chang,et al.  The Development and Implementation of Scaffolding-Based Self-Regulated Learning System for e/m-Learning , 2010, J. Educ. Technol. Soc..

[73]  N. Kerr,et al.  Dispensability of member effort and group motivation losses: Free-rider effects , 1983 .

[74]  S. Järvelä,et al.  Socially Shared Regulation of Learning: A Review , 2015 .

[75]  S. Järvelä,et al.  New Frontiers: Regulating Learning in CSCL , 2013 .

[76]  Hee-Young Kang,et al.  Effects of team-based learning on problem-solving, knowledge and clinical performance of Korean nursing students. , 2016, Nurse Education Today.

[77]  Allyson Hadwin,et al.  Innovative ways for using gStudy to orchestrate and research social aspects of self-regulated learning , 2010, Comput. Hum. Behav..

[78]  Gijsbert Erkens,et al.  Mediating team effectiveness in the context of collaborative learning: The importance of team and task awareness , 2011, Comput. Hum. Behav..

[79]  Mike Joy,et al.  Effective peer assessment for learning computer programming , 2004, ITiCSE '04.

[80]  James M. Laffey,et al.  The educational impact of metacognitive group coordination in computer-supported collaborative learning , 2013, Comput. Hum. Behav..

[81]  Ulrike Cress,et al.  Group awareness and self-presentation in computer-supported information exchange , 2008, Int. J. Comput. Support. Collab. Learn..

[82]  Yung-Cheng Lai,et al.  Peer interaction and social network analysis of online communities with the support of awareness of different contexts , 2015, International Journal of Computer-Supported Collaborative Learning.

[83]  Sanna Järvelä,et al.  Enhancing socially shared regulation in working groups using a CSCL regulation tools , 2013, AIED Workshops.

[84]  Jonna Malmberg,et al.  Exploring Socially Shared Regulation in the Context of Collaboration , 2013, Journal of Cognitive Education and Psychology.

[85]  Andrew Litchfield,et al.  Supporting peer assessment of individual contributions in groupwork , 2007 .

[86]  D. Schunk Self-regulation of self-efficacy and attributions in academic settings. , 1994 .