The effectiveness of self-regulated learning scaffolds on academic performance in computer-based learning environments: a meta-analysis

This meta-analysis examined research on the effects of self-regulated learning scaffolds on academic performance in computer-based learning environments from 2004 to 2015. A total of 29 articles met inclusion criteria and were included in the final analysis with a total sample size of 2648 students. Moderator analyses were performed using a random effects model that focused on the three main areas of scaffold characteristics (including the mechanism, functions, delivery forms, mode, and number of scaffolds; how to promote self-regulated learning by scaffolds); demographics of the selected studies (including sample groups, sample size, learning domain, research settings, and types of computer-based learning environments); and research methodological features (including research methods, types of research design, types of organization for treatment, and duration of treatment). Findings revealed that self-regulated learning scaffolds in computer-based learning environments generally produced a significantly positive effect on academic performance (ES = 0.438). It is also suggested that both domain-general and domain-specific scaffolds can support the entire process of self-regulated learning since they demonstrated substantial effects on academic performance. Different impacts of various studies and their methodological features are presented and discussed.

[1]  M. Borenstein,et al.  Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments , 2006 .

[2]  Alison H. Paris,et al.  Classroom Applications of Research on Self-Regulated Learning , 2001 .

[3]  Philip H. Winne,et al.  Self-regulated learning viewed from models of information processing. , 2001 .

[4]  Joseph Krajcik,et al.  Making Dynamic Modeling Accessible to Precollege Science Students , 1994, Interact. Learn. Environ..

[5]  Chen-Lin C. Kulik,et al.  The concept of meta-analysis , 1989 .

[6]  Daniel C. Moos,et al.  Measuring Cognitive and Metacognitive Regulatory Processes During Hypermedia Learning: Issues and Challenges , 2010 .

[7]  L. Hedges,et al.  Introduction to Meta‐Analysis , 2009, International Coaching Psychology Review.

[8]  Charlotte Dignath,et al.  Components of fostering self-regulated learning among students. A meta-analysis on intervention studies at primary and secondary school level , 2008 .

[9]  Erhan Delen,et al.  Effects of interactivity and instructional scaffolding on learning: Self-regulation in online video-based environments , 2014, Comput. Educ..

[10]  Rainer Bromme,et al.  Not everybody needs help to seek help: Surprising effects of metacognitive instructions to foster help-seeking in an online-learning environment , 2009, Comput. Educ..

[11]  K. Koedinger,et al.  Automated, Unobtrusive, Action-by-Action Assessment of Self-Regulation During Learning With an Intelligent Tutoring System , 2010 .

[12]  Lisa D. Bendixen,et al.  Educational Research in the Internet Age: Examining the Role of Individual Characteristics , 2001 .

[13]  A. Efklides.  Interactions of Metacognition With Motivation and Affect in Self-Regulated Learning: The MASRL Model , 2011 .

[14]  Karin Archer,et al.  Examining the effectiveness of technology use in classrooms: A tertiary meta-analysis , 2014, Comput. Educ..

[15]  Susanne P. Lajoie,et al.  Developing an agent-based adaptive system for scaffolding self-regulated inquiry learning in history education , 2014, Educational Technology Research and Development.

[16]  A. Renkl,et al.  Enhancing self-regulated learning by writing learning protocols , 2009 .

[17]  R. Clark.  Reconsidering Research on Learning from Media , 1983 .

[18]  Charlotte Dignath,et al.  How can primary school students learn self-regulated learning strategies most effectively? A meta-analysis on self-regulation training programmes , 2008 .

[19]  Kent J. Crippen,et al.  The impact of web-based worked examples and self-explanation on performance, problem solving, and self-efficacy , 2007, Comput. Educ..

[20]  Susanne Narciss,et al.  Promoting self-regulated learning in web-based learning environments , 2007, Comput. Hum. Behav..

[21]  Amy M. Shapiro,et al.  Hypermedia design as learner scaffolding , 2008 .

[22]  Nada Dabbagh,et al.  Using Web-based Pedagogical Tools as Scaffolds for Self-regulated Learning , 2005 .

[23]  R. Azevedo,et al.  Scaffolding Self-regulated Learning and Metacognition – Implications for the Design of Computer-based Scaffolds , 2005 .

[24]  Tzu-Hua Wang,et al.  Developing Web-based assessment strategies for facilitating junior high school students to perform self-regulated learning in an e-Learning environment , 2011, Comput. Educ..

[25]  K. Koedinger,et al.  Exploring the Assistance Dilemma in Experiments with Cognitive Tutors , 2007 .

[26]  Philip H. Winne,et al.  Studying as self-regulated learning. , 1998 .

[27]  Randy M. Isaacson,et al.  Metacognitive Knowledge Monitoring and Self-Regulated Learning: Academic Success and Reflections on Learning. , 2006 .

[28]  Chih-Ming Chen.  Personalized E-learning system with self-regulated learning assisted mechanisms for promoting learning performance , 2009, Expert Syst. Appl..

[29]  N. Purdie,et al.  Effects of Learning Skills Interventions on Student Learning: A Meta-Analysis , 1996 .

[30]  Ruomeng Zhao,et al.  Effects of online note taking formats and self-monitoring prompts on learning from online text: Usin , 2011 .

[31]  James D. Klein,et al.  The Impact of Scaffolding and Student Achievement Levels in a Problem-based Learning Environment , 2007 .

[32]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[33]  Robert E. Slavin,et al.  The Relationship Between Sample Sizes and Effect Sizes in Systematic Reviews in Education , 2009 .

[34]  Candice Burkett,et al.  MetaTutor: A MetaCognitive Tool for Enhancing Self-Regulated Learning , 2009, AAAI Fall Symposium: Cognitive and Metacognitive Educational Systems.

[35]  Chih-Ming Chen,et al.  Web-based reading annotation system with an attention-based self-regulated learning mechanism for promoting reading performance , 2014, Br. J. Educ. Technol..

[36]  Chih-Ming Chen,et al.  Facilitating English-Language Reading Performance by a Digital Reading Annotation System with Self-Regulated Learning Mechanisms , 2014, J. Educ. Technol. Soc..

[37]  Fred Paas,et al.  Reflection prompts and tutor feedback in a web-based learning environment: effects on students' self-regulated learning competence , 2004, Comput. Hum. Behav..

[38]  W. Jochems,et al.  Effective self-regulated science learning through multimedia-enriched skeleton concept maps , 2013 .

[39]  Katrin Rakoczy,et al.  Promotion of self-regulated learning in classrooms: investigating frequency, quality, and consequences for student performance , 2010 .

[40]  Roger Azevedo,et al.  Adaptive Human Scaffolding Facilitates Adolescents’ Self-regulated Learning with Hypermedia , 2005 .

[41]  B. Zimmerman,et al.  Impact of Self-Regulatory Influences on Writing Course Attainment , 1994 .

[42]  Ying-Tien Wu,et al.  A Review of Research on Technology-Assisted School Science Laboratories , 2014, J. Educ. Technol. Soc..

[43]  Mei-Mei Chang,et al.  Strategy-Oriented Web-Based English Instruction--A Meta-Analysis. , 2013 .

[44]  Barbara Y. White,et al.  Facilitating Students’ Inquiry Learning and Metacognitive Development Through Modifiable Software Advisers , 2000 .

[45]  Alan C. K. Cheung,et al.  The Effectiveness of Educational Technology Applications for Enhancing Mathematics Achievement in K-12 Classrooms: A Meta-Analysis. Best Evidence Encyclopedia (BEE). , 2011 .

[46]  Susan Pedersen,et al.  Advancing young adolescents' hypothesis-development performance in a computer-supported and problem-based learning environment , 2011, Comput. Educ..

[47]  Roger Azevedo,et al.  Motivation matters: Interactions between achievement goals and agent scaffolding for self-regulated learning within an intelligent tutoring system , 2015, Comput. Hum. Behav..

[48]  Charlotte Dignath van Ewijk.  Assessing Students’ Acquisition of Self-Regulated Learning Skills Using Meta-Analysis , 2011 .

[49]  Thomas Brush,et al.  Scaffolding critical reasoning about history and social issues in multimedia-supported learning environments , 2002 .

[50]  Roger Azevedo,et al.  Teaching and Learning in Technology-Rich Environments , 2006 .

[51]  Stephen M. Mutula,et al.  A proposed model for evaluating the success of WebCT course content management system , 2010, Comput. Hum. Behav..

[52]  Inge Molenaar,et al.  Dynamic scaffolding of socially regulated learning in a computer-based learning environment , 2012, Comput. Educ..

[53]  Susanne P. Lajoie,et al.  Constructing knowledge in the context of BioWorld , 2001 .

[54]  Johan van Braak,et al.  Supporting self-regulated learning in computer-based learning environments: systematic review of effects of scaffolding in the domain of science education , 2012, J. Comput. Assist. Learn..

[55]  Gilan M El Saadawi,et al.  Factors affecting feeling-of-knowing in a medical intelligent tutoring system: the role of immediate feedback as a metacognitive scaffold , 2010, Advances in health sciences education : theory and practice.

[56]  Bracha Kramarski,et al.  Using computer algebra systems in mathematical classrooms , 2003, J. Comput. Assist. Learn..

[57]  Fatih Bektaş,et al.  The effect of educational leadership on students’ achievement: a meta-analysis study , 2015 .

[58]  P. Pintrich.  The role of goal orientation in self-regulated learning. , 2000 .

[59]  Nian-Shing Chen,et al.  Trends in Educational Technology through the Lens of the Highly Cited Articles Published in the Journal of Educational Technology and Society , 2013, J. Educ. Technol. Soc..

[60]  Mi-Kyung Chung,et al.  The development of self-regulated learning , 2000 .

[61]  Susan M. Land,et al.  Open learning environments: Foundations, methods, and models , 2013 .

[62]  Douglas J. Hacker,et al.  Handbook of Metacognition in Education , 2009 .

[63]  I. Molenaar,et al.  Metacognitive scaffolding in an innovative learning arrangement , 2011 .

[64]  B. Hout-Wolters,et al.  Metacognition and learning: conceptual and methodological considerations , 2006 .

[65]  Philip H. Winne,et al.  Learning from Learning Kits: gStudy Traces of Students’ Self-Regulated Engagements with Computerized Content , 2006 .

[66]  Dirk Ifenthaler,et al.  Determining the effectiveness of prompts for self-regulated learning in problem-solving scenarios , 2012, J. Educ. Technol. Soc..

[67]  Roger Azevedo,et al.  Does adaptive scaffolding facilitate students ability to regulate their learning with hypermedia? q , 2004 .

[68]  Maria Bannert,et al.  Supporting self-regulated hypermedia learning through prompts , 2011, Instructional Science.

[69]  Maria Bannert,et al.  Short- and long-term effects of students' self-directed metacognitive prompts on navigation behavior and learning performance , 2015, Comput. Hum. Behav..

[70]  John Hattie,et al.  Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement , 2008 .

[71]  Traci Sitzmann,et al.  A meta-analysis of self-regulated learning in work-related training and educational attainment: what we know and where we need to go. , 2011, Psychological bulletin.

[72]  Silvia Micheletta.  John Hattie, Visible Learning. A synthesis of over 800 meta-analyses relating to achievement. London & New York: Routledge (2009). John Hattie, Visible Learning for teachers. Maximizing impact on learning. London & New York: Routledge (2012). , 2013 .

[73]  B. Zimmerman.  Investigating Self-Regulation and Motivation: Historical Background, Methodological Developments, and Future Prospects , 2008, American Educational Research Journal.

[74]  G. Buela-Casal,et al.  The h index of the presidents of the American Psychological Association (APA) through journal articles included in the Web of Science database , 2011 .

[75]  Y. Hsu,et al.  Exploring the Impacts of Cognitive and Metacognitive Prompting on Students’ Scientific Inquiry Practices Within an E-Learning Environment , 2015 .

[76]  Gautam Biswas,et al.  LEARNING BY TEACHING: A NEW AGENT PARADIGM FOR EDUCATIONAL SOFTWARE , 2005, Appl. Artif. Intell..

[77]  Harris Cooper,et al.  Research Synthesis and Meta-Analysis: A Step-by-Step Approach , 2009 .

[78]  Qing Li,et al.  A Meta-analysis of the Effects of Computer Technology on School Students’ Mathematics Learning , 2010 .

[79]  Richard F. Schmid,et al.  The effects of technology use in postsecondary education: A meta-analysis of classroom applications , 2014, Comput. Educ..

[80]  Michael Pressley,et al.  Scaffolding student learning: Instructional approaches and issues. , 1997 .

[81]  Barbara L. Grabowski,et al.  Improving self-regulation, learning strategy use, and achievement with metacognitive feedback , 2010 .

[82]  T. Jong,et al.  Software scaffolds to promote regulation during scientific inquiry learning , 2007 .

[83]  Fielding I. Winters,et al.  Self-Regulation of Learning within Computer-based Learning Environments: A Critical Analysis , 2008 .

[84]  Richard Niemiec,et al.  The Effects of Computer Based Instruction in Elementary Schools: A Quantitative Synthesis. , 1987 .

[85]  Ingram Olkin,et al.  Statistical Methods for Meta-Analysis. , 1986 .

[86]  Dirk Ifenthaler,et al.  Cognitive, metacognitive and motivational perspectives on preflection in self-regulated online learning , 2014, Comput. Hum. Behav..

[87]  Bracha Kramarski,et al.  Online Discussion and Self-Regulated Learning: Effects of Instructional Methods on Mathematical Literacy , 2006 .

[88]  Yasushige Ishikawa,et al.  Mobile Assisted Language Learning in university EFL courses in Japan: developing attitudes and skills for self-regulated learning , 2012, ReCALL.

[89]  Roger Azevedo,et al.  Exploring the fluctuation of motivation and use of self-regulatory processes during learning with hypermedia , 2008 .