Meta-analysis to study the impact of learning engagement strategies in introductory computer programming courses: a multi-institutional study

Various Learning Engagement Strategies (LESs) have been used in CS education to motivate students and facilitate learning. More recently, LESs are being used to support programming pedagogy. Therefore, investigating the influence that the multiple attributes of LESs used as instruction interventions have on students' academic performance is a fertile educational research area. For the past few years, a group of CSEd researchers across three different U.S. institutions have been using a cyberlearning environment (incorporating LESs) to promote student learning and engagement in introductory programming courses. While there have been researches on independent studies on particular LES, the current paper is a meta-analysis of the effectiveness of various combinations of Learning Engagement Strategies (LESs) across different student groups using a series of studies conducted across these three separate institutions over a period of time. Specifically, we investigate the impact of different combinations of LESs such as collaborative learning (CL), gamification (G), and social interaction (SI) embedded in a cyberlearning environment on student understanding of programming concepts in an introductory programming course. In terms of findings that can be generalized across institutions and students, we found that using LESs had a positive impact on student engagement and learning especially when using SI and G in combination.

[1]  Travis J. Bristol,et al.  Advancing a New Focus on Teaching Quality: A Critical Synthesis. Teachers' Time: Collaborating for Learning, Teaching, and Leading. , 2018 .

[2]  R. Seagram,et al.  Educational game models: conceptualization and evaluation , 2004 .

[3]  Julio Sánchez-Meca,et al.  Meta-analysis in psychological research. , 2010 .

[4]  James D. Kiper,et al.  Evaluating the Impact of Combination of Engagement Strategies in SEP-CyLE on Improve Student Learning of Programming Concepts , 2019, SIGCSE.

[5]  Alex Radermacher,et al.  Board 67: Evaluating Learning Engagement Strategies in a Cyber Learning Environment during Introductory Computer Programming Courses – an Empirical Investigation , 2018 .

[6]  Hao Lei,et al.  Relationships between Student Engagement and Academic Achievement: A Meta-Analysis , 2018 .

[7]  David M. Johnstone Millennials Rising: The Next Great Generation , 2001 .

[8]  Galia Angelova,et al.  Gamification in Education: A Systematic Mapping Study , 2015, J. Educ. Technol. Soc..

[9]  Dana E. Sims,et al.  Is there a “Big Five” in Teamwork? , 2005 .

[10]  L. Hedges,et al.  The Handbook of Research Synthesis and Meta-Analysis , 2009 .

[11]  Ronny Scherer,et al.  The cognitive benefits of learning computer programming: A meta-analysis of transfer effects. , 2019, Journal of Educational Psychology.

[12]  Barbara Means,et al.  Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies , 2009 .

[13]  James D. Kiper,et al.  TP-GraphMiner: A Clustering Framework for Task-Based Information Networks , 2018, 2018 IEEE International Conference on System, Computation, Automation and Networking (ICSCA).

[14]  D. Randy Garrison,et al.  Critical Thinking and Computer Conferencing: A Model and Tool to Assess Cognitive Presence , 2001 .

[15]  James R. Eagan,et al.  JHAVÉ—an environment to actively engage students in Web-based algorithm visualizations , 2000, SIGCSE '00.

[16]  L. Hedges,et al.  Power Analysis for Meta‐Analysis , 2009, Introduction to Meta‐Analysis.

[17]  Larry V. Hedges,et al.  Identifying and Quantifying Heterogeneity , 2009, Introduction to Meta‐Analysis.

[18]  David W. Johnson,et al.  The State of Cooperative Learning in Postsecondary and Professional Settings , 2007 .

[19]  Lorraine Angelino,et al.  Strategies to Engage Online Students and Reduce Attrition Rates. , 2007 .

[20]  Pierre Dillenbourg,et al.  The Evolution of Research on Computer-Supported Collaborative Learning , 2009 .

[21]  Nicola Whitton Digital Games and Learning: Research and Theory , 2014 .

[22]  Paul A. Kirschner,et al.  Identifying the pitfalls for social interaction in computer-supported collaborative learning environments: a review of the research , 2003, Comput. Hum. Behav..