A meta-analysis examining the moderating effects of educational level and subject area on CSCL effectiveness

The positive effects of computer-supported collaborative learning (CSCL) on students’ learning outcomes and processes have been widely reported in individual empirical studies and meta-analyses. More specifically, in the meta-analysis by Chen, Wang, Kirschner, and Tsai (2018), the effects were found to be attributed to the three main elements of CSCL including collaborative learning, computer use, extra learning environments/tools or extra supporting strategies This study extends that meta-analysis by examining the moderating effects of educational level and subject area on the effectiveness of CSCL. The moderating effects of educational level were found not to be significant on the effectiveness of collaborative learning, computer use, extra learning environments or tools, or extra supporting strategies with respect to student knowledge achievement. Subject area, on the other hand, was found to be a significant moderator for the effectiveness of extra learning environments or tools and extra supporting strategies. When using extra learning environments or tools for CSCL, larger effect sizes were found for engineering and science courses; when using extra supporting strategies for CSCL, larger effect sizes were found for science and social science courses. The results also showed that more studies were conducted at the university level and in engineering, science, and social science disciplines. https://doi.org/10.34105/j.kmel.2019.11.022

[1]  T. Schirato,et al.  Effective reading , 2020, Beginning University.

[2]  Minhong Wang,et al.  The Role of Collaboration, Computer Use, Learning Environments, and Supporting Strategies in CSCL: A Meta-Analysis , 2018, Review of Educational Research.

[3]  Minhong Wang,et al.  The use of web-based collaborative concept mapping to support group learning and interaction in an online environment , 2017, Internet High. Educ..

[4]  F. Fischer,et al.  Socio-Cognitive Scaffolding with Computer-Supported Collaboration Scripts: a Meta-Analysis , 2017 .

[5]  Bei Yuan,et al.  Design of a computer-based learning environment to support diagnostic problem solving towards expertise development , 2016 .

[6]  Sanna Järvelä,et al.  Socially shared regulation of learning in CSCL: understanding and prompting individual- and group-level shared regulatory activities , 2016, Int. J. Comput. Support. Collab. Learn..

[7]  Åke Grönlund,et al.  Closing the gaps - Improving literacy and mathematics by ict-enhanced collaboration , 2016, Comput. Educ..

[8]  Richard F. Schmid,et al.  Technology-supported student interaction in post-secondary education: A meta-analysis of designed versus contextual treatments , 2016, Comput. Educ..

[9]  Cindy E. Hmelo-Silver,et al.  CSCL in STEM Education: Preliminary Findings from a Meta-Analysis , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[10]  Chih-Ming Chen,et al.  Enhancing digital reading performance with a collaborative reading annotation system , 2014, Comput. Educ..

[11]  Ali Shariq Imran,et al.  HIP - A Technology-Rich and Interactive Multimedia Pedagogical Platform , 2014, HCI.

[12]  Sankar K. Pal,et al.  Recent Advances in Intelligent Informatics - Proceedings of the Second International Symposium on Intelligent Informatics, ISI 2013, August 23-24 2013, Mysore, India , 2014, ISI.

[13]  Jure Leskovec,et al.  Mining of Massive Datasets, 2nd Ed , 2014 .

[14]  Gwo-Jen Hwang,et al.  An Augmented Reality-based Mobile Learning System to Improve Students' Learning Achievements and Motivations in Natural Science Inquiry Activities , 2014, J. Educ. Technol. Soc..

[15]  Zhang Liangliang,et al.  Studies included in this meta-analysis. , 2013 .

[16]  Wu-Yuin Hwang,et al.  Analysis of peer learning behaviors using multiple representations in virtual reality and their impacts on geometry problem solving , 2013, Comput. Educ..

[17]  Minhong Wang,et al.  Integrating problem solving and knowledge construction through dual mapping , 2012 .

[18]  Cary J. Roseth,et al.  Effects of face-to-face and computer-mediated constructive controversy on social interdependence, motivation, and achievement. , 2011 .

[19]  Jeffrey V. Nickerson,et al.  Process and learning outcomes from remotely-operated, simulated, and hands-on student laboratories , 2011, Comput. Educ..

[20]  F. Paas,et al.  Differential effects of problem-solving demands on individual and collaborative learning outcomes. , 2011 .

[21]  Yuanyuan Wang,et al.  Automatic Generation of Learning Channels by Using Semantic Relations among Lecture Slides and Recorded Videos for Self-Learning Systems , 2009, 2009 11th IEEE International Symposium on Multimedia.

[22]  Robert E. Slavin,et al.  Effective Reading Programs for the Elementary Grades: A Best-Evidence Synthesis , 2009 .

[23]  Mohan S. Kankanhalli,et al.  A robust framework for aligning lecture slides with video , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[24]  Quanfu Fan,et al.  Accurate alignment of presentation slides with educational video , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[25]  Avi Hofstein,et al.  Enhancing students' understanding of the concept of chemical bonding by using activities provided on an interactive website , 2009 .

[26]  Xueqing Li,et al.  The multimedia educational resources editing system on synchronization of PPT presentation videos and electronic slides , 2008, 2008 IEEE International Symposium on IT in Medicine and Education.

[27]  Martin Halvey,et al.  An assessment of tag presentation techniques , 2007, WWW '07.

[28]  Pamela Taylor Northrup,et al.  Learning Objects for Instruction: Design and Evaluation , 2007 .

[29]  Dogan Ibrahim,et al.  Assessing the Success Rate of Students Using a Learning Management System Together with a Collaborative Tool in Web-Based Teaching of Programming Languages , 2007 .

[30]  Robert E. Slavin,et al.  Effective Programs in Elementary Mathematics: A Best-Evidence Synthesis , 2007 .

[31]  Victor Kaptelinin,et al.  Group Cognition Computer Support for Building Collaborative Knowledge , 2007 .

[32]  Daniel D. Suthers,et al.  Computer-supported collaborative learning: An historical perspective , 2006 .

[33]  Naser-Nick Manochehr.  The Influence of Learning Styles on Learners in E-Learning Environments: An Empirical Study , 2006 .

[34]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[35]  Miguel Nussbaum,et al.  Computer supported collaborative learning using wirelessly interconnected handheld computers , 2004, Comput. Educ..

[36]  Paul A. Kirschner,et al.  Identifying the pitfalls for social interaction in computer-supported collaborative learning environments: a review of the research , 2003, Comput. Hum. Behav..

[37]  Jian Ma,et al.  Effects of Group Support Systems and Content Facilitation on Knowledge Acquisition , 2002, J. Manag. Inf. Syst..

[38]  Chong-Wah Ngo,et al.  Structuring lecture videos for distance learning applications , 2003, Fifth International Symposium on Multimedia Software Engineering, 2003. Proceedings..

[39]  Chong-Wah Ngo,et al.  Detection of slide transition for topic indexing , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[40]  Y. Lou,et al.  Small Group and Individual Learning with Technology: A Meta-Analysis , 2001 .

[41]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[42]  P. Dillenbourg.  What do you mean by collaborative learning , 1999 .

[43]  David H. Jonassen,et al.  Computers as mindtools for engaging learners in critical thinking , 1998 .

[44]  D. Perkins,et al.  Individual and Social Aspects of Learning , 1998 .

[45]  Leonard Springer,et al.  Effects of Small-Group Learning on Undergraduates in Science, Mathematics, Engineering, and Technology: A Meta-Analysis , 1997 .

[46]  John S. Boreczky,et al.  Comparison of video shot boundary detection techniques , 1996, J. Electronic Imaging.

[47]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[48]  T. C. Bello.  COMPARISON OF ELEVEN MAJOR LEARNING STYLES MODELS: VARIABLES, APPROPRIATE POPULATIONS, VALIDITY OF INSTRUMENTATION, AND THE RESEARCH BEHIND THEM , 1990 .

[49]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  R. Felder,et al.  Learning and Teaching Styles in Engineering Education. , 1988 .