Self-regulated learning strategies predict learner behavior and goal attainment in Massive Open Online Courses

Individuals with strong self-regulated learning (SRL) skills, characterized by the ability to plan, manage and control their learning process, can learn faster and outperform those with weaker SRL skills. SRL is critical in learning environments that provide low levels of support and guidance, as is commonly the case in Massive Open Online Courses (MOOCs). Learners can be trained to engage in SRL and actively supported with prompts and activities. However, effective implementation of learner support systems in MOOCs requires an understanding of which SRL strategies are most effective and how these strategies manifest in online behavior. Moreover, identifying learner characteristics that are predictive of weaker SRL skills can advance efforts to provide targeted support without obtrusive survey instruments. We investigated SRL in a sample of 4,831 learners across six MOOCs based on individual records of overall course achievement, interactions with course content, and survey responses. We found that goal setting and strategic planning predicted attainment of personal course goals, while help seeking was associated with lower goal attainment. Learners with stronger SRL skills were more likely to revisit previously studied course materials, especially course assessments. Several learner characteristics, including demographics and motivation, predicted learners' SRL skills. We discuss implications for theory and the development of learning environments that provide adaptive support. Goal setting and strategic planning positively predict goal attainment in MOOCs.Help seeking negatively predicts goal attainment, e.g., earning a certificate.Self-reported SRL strategies manifest behaviorally in revisiting course content.Learner characteristics (demographics, motivation, etc.) predict self-reported SRL.

[1]  Ryan Shaun Joazeiro de Baker,et al.  Towards Understanding How to Assess Help-Seeking Behavior Across Cultures , 2015, International Journal of Artificial Intelligence in Education.

[2]  Angela L. Duckworth,et al.  Self‐regulation strategies improve self‐discipline in adolescents: benefits of mental contrasting and implementation intentions , 2011 .

[3]  David M. Shannon,et al.  Students’ characteristics, self-regulated learning, technology self-efficacy, and course outcomes in online learning , 2013 .

[4]  George Siemens,et al.  Let’s not forget: Learning analytics are about learning , 2015 .

[5]  Esther Duflo,et al.  Dis)organization and Success in an Economics MOOC , 2014 .

[6]  Charlotte Dignath,et al.  Components of fostering self-regulated learning among students. A meta-analysis on intervention studies at primary and secondary school level , 2008 .

[7]  Philip H. Winne,et al.  Examining trace data to explore self-regulated learning , 2007 .

[8]  Katharina Reinecke,et al.  Demographic differences in how students navigate through MOOCs , 2014, L@S.

[9]  Chin-Chung Tsai,et al.  Conceptions of learning versus conceptions of web-based learning: The differences revealed by college students , 2009, Comput. Educ..

[10]  Ryan S. Baker,et al.  The Potentials of Educational Data Mining for Researching Metacognition, Motivation and Self-Regulated Learning , 2013, EDM 2013.

[11]  Jeffrey D. Karpicke,et al.  The Critical Importance of Retrieval for Learning , 2008, Science.

[12]  Daniel C. Moos,et al.  Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia? , 2008 .

[13]  Mar Pérez-Sanagustín,et al.  Recommending Self-Regulated Learning Strategies Does Not Improve Performance in a MOOC , 2016, L@S.

[14]  P. Pintrich.  The role of goal orientation in self-regulated learning. , 2000 .

[15]  Patrick C. Shih,et al.  Understanding Student Motivation, Behaviors and Perceptions in MOOCs , 2015, CSCW.

[16]  M. Puustinen,et al.  Models of Self-regulated Learning: A review , 2001 .

[17]  B. Zimmerman.  Attaining self-regulation: A social cognitive perspective. , 2000 .

[18]  Gregory Schraw,et al.  Assessing metacognitive awareness , 1994 .

[19]  Geert-Jan Houben,et al.  Gauging MOOC Learners' Adherence to the Designed Learning Path , 2016, EDM.

[20]  D. Schunk.  Self-Regulated Learning: The Educational Legacy of Paul R. Pintrich , 2005 .

[21]  V. Aleven,et al.  Help Seeking and Help Design in Interactive Learning Environments , 2003 .

[22]  W. Lan,et al.  Online self-regulatory learning behaviors as a mediator in the relationship between online course perceptions with achievement , 2008 .

[23]  Geert-Jan Houben,et al.  Retrieval Practice and Study Planning in MOOCs: Exploring Classroom-Based Self-regulated Learning Strategies at Scale , 2016, EC-TEL.

[24]  J. Reich,et al.  Democratizing education? Examining access and usage patterns in massive open online courses , 2015, Science.

[25]  Philip H. Winne,et al.  The psychology of academic achievement. , 2010, Annual review of psychology.

[26]  K. Hew,et al.  Students’ and instructors’ use of massive open online courses (MOOCs): Motivations and challenges , 2014 .

[27]  René F. Kizilcec,et al.  Motivation as a Lens to Understand Online Learners , 2015, ACM Trans. Comput. Hum. Interact..

[28]  Claire E. Weinstein,et al.  Self-regulation and learning strategies , 2011 .

[29]  Roger Azevedo,et al.  Teaching and Learning in Technology-Rich Environments , 2006 .

[30]  Charles B. Hodges,et al.  Effects of an emotion control treatment on academic emotions, motivation and achievement in an online mathematics course , 2012 .

[31]  Kenneth R. Koedinger,et al.  Learning is Not a Spectator Sport: Doing is Better than Watching for Learning from a MOOC , 2015, L@S.

[32]  Jos Beishuizen,et al.  A conceptual framework for research on self-regulated learning , 2011 .

[33]  Hongyan Liu,et al.  Effective Selection of a Compact and High-Quality Review Set with Information Preservation , 2017 .

[34]  Paula de Barba,et al.  The role of students' motivation and participation in predicting performance in a MOOC , 2016, J. Comput. Assist. Learn..

[35]  J. Henrich,et al.  The weirdest people in the world? , 2010, Behavioral and Brain Sciences.

[36]  P. Pintrich.  A Manual for the Use of the Motivated Strategies for Learning Questionnaire (MSLQ). , 1991 .

[37]  Geert-Jan Houben,et al.  Beyond the MOOC platform: gaining insights about learners from the social web , 2016, WebSci.

[38]  John G. Borkowski,et al.  Metacognition: Theory or chapter heading? , 1996 .

[39]  C. B. Colby.  The weirdest people in the world , 1973 .

[40]  V. Aleven,et al.  Metacognition and Learning Technologies: An Overview of Current Interdisciplinary Research , 2013 .

[41]  B. Zimmerman.  Investigating Self-Regulation and Motivation: Historical Background, Methodological Developments, and Future Prospects , 2008, American Educational Research Journal.

[42]  J. Downing,et al.  Learning strategies, learning anxiety and knowledge acquisition. , 2000, British journal of psychology.

[43]  Anne Nevgi,et al.  Towards self-regulation in web-based learning , 2003 .

[44]  P. Reimann,et al.  Process mining techniques for analysing patterns and strategies in students’ self-regulated learning , 2013, Metacognition and Learning.

[45]  M. Boekaerts.  Self-Regulated Learning. , 1999 .

[46]  Allison Littlejohn,et al.  Context counts: How learners' contexts influence learning in a MOOC , 2015, Comput. Educ..

[47]  Joseph Jay Williams,et al.  HarvardX and MITx: Two Years of Open Online Courses Fall 2012-Summer 2014 , 2015 .

[48]  S. Levinson,et al.  WEIRD languages have misled us, too , 2010, Behavioral and Brain Sciences.

[49]  Jyh-Chong Liang,et al.  Internet Self-Efficacy and Preferences Toward Constructivist Internet-based Learning Environments: A Study of Pre-school Teachers in Taiwan , 2006, J. Educ. Technol. Soc..

[50]  J. Broadbent,et al.  Self-regulated learning strategies & academic achievement in online higher education learning environments: A systematic review , 2015, Internet High. Educ..

[51]  Antoine Doucet,et al.  Building engagement for MOOC students: introducing support for time management on online learning platforms , 2014, WWW.

[52]  Jyh-Chong Liang,et al.  Self-efficacy in Internet-based Learning Environments: A Literature Review , 2011, J. Educ. Technol. Soc..

[53]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[54]  David E. Pritchard,et al.  Studying Learning in the Worldwide Classroom Research into edX's First MOOC. , 2013 .

[55]  Sherif Halawa,et al.  Attrition and Achievement Gaps in Online Learning , 2015, L@S.

[56]  Nan Bahr,et al.  Self-Regulated Learning: Key strategies and their sources in a sample of adolescent males , 2013 .

[57]  Angela L. Duckworth,et al.  From Fantasy to Action , 2013, Social psychological and personality science.

[58]  Barry J. Zimmerman,et al.  Self-Regulated Learning: Theories, Measures, and Outcomes , 2015 .

[59]  P. Pintrich.  A Conceptual Framework for Assessing Motivation and Self-Regulated Learning in College Students , 2004 .

[60]  W. Lan,et al.  Profiles in self-regulated learning in the online learning environment , 2010 .

[61]  Philip H. Winne,et al.  Issues in researching self-regulated learning as patterns of events , 2014 .

[62]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[63]  C. Abraham,et al.  Psychological correlates of university students' academic performance: a systematic review and meta-analysis. , 2012, Psychological bulletin.

[64]  P. Winne,et al.  Feedback and Self-Regulated Learning: A Theoretical Synthesis , 1995 .

[65]  R. Azevedo,et al.  Does training on self-regulated learning facilitate students' learning with hypermedia? , 2004 .

[66]  Pei-Di Shen,et al.  Applying Web-Enabled Problem-Based Learning and Self-Regulated Learning to Add Value to Computing Education in Taiwan's Vocational Schools , 2008, J. Educ. Technol. Soc..

[67]  Allison Littlejohn,et al.  Designing MOOCs for professional learners: Tools and patterns to encourage self-regulated learning , 2015 .

[68]  Yoav Bergner,et al.  Who does what in a massive open online course? , 2014, Commun. ACM.

[69]  Robert F. Boruch,et al.  Moving Through MOOCs , 2014 .

[70]  Rachel B. Baker,et al.  Persistence Patterns in Massive Open Online Courses (MOOCs) , 2015 .

[71]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[72]  Birgit Schyns,et al.  A Short Version of the Occupational Self-Efficacy Scale: Structural and Construct Validity Across Five Countries , 2008 .

[73]  Marek Hatala,et al.  A process mining approach to linking the study of aptitude and event facets of self-regulated learning , 2015, LAK.

[74]  Ryan S. Baker,et al.  Content or platform: Why do students complete MOOCs? , 2015 .

[75]  B. Zimmerman,et al.  Development of a Structured Interview for Assessing Student Use of Self-Regulated Learning Strategies , 1986 .

[76]  Philip H. Winne,et al.  Studying as self-regulated learning. , 1998 .

[77]  Allison Littlejohn,et al.  Learning in MOOCs: Motivations and self-regulated learning in MOOCs , 2016, Internet High. Educ..

[78]  Justin Reich,et al.  Rebooting MOOC Research , 2015, Science.

[79]  Pei-Jung Kuo,et al.  Validation of an instrument to measure students’ motivation and self-regulation towards technology learning , 2014 .

[80]  Chris Piech,et al.  Deconstructing disengagement: analyzing learner subpopulations in massive open online courses , 2013, LAK '13.

[81]  Katy Jordan,et al.  Initial trends in enrolment and completion of massive open online courses , 2014 .

[82]  A. Bandura.  Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[83]  R. Little.  Missing-Data Adjustments in Large Surveys , 1988 .

[84]  Ido Roll,et al.  Understanding, evaluating, and supporting self-regulated learning using learning analytics , 2015, J. Learn. Anal..

[85]  P. Pintrich.  The role of motivation in promoting and sustaining self-regulated learning , 1999 .

[86]  Stef van Buuren,et al.  MICE: Multivariate Imputation by Chained Equations in R , 2011 .

[87]  David Boud,et al.  Enhancing learning through self assessment , 1995 .

[88]  Trevor Hastie,et al.  The Elements of Statistical Learning Theory , 2001 .

[89]  Roderick J. A. Little.  Missing-Data Adjustments in Large Surveys: Reply , 1988 .

[90]  Justin Reich,et al.  Staggered Versus All-At-Once Content Release in Massive Open Online Courses: Evaluating a Natural Experiment , 2015, L@S.

[91]  Robert Rueda,et al.  Situational interest, computer self-efficacy and self-regulation: Their impact on student engagement in distance education , 2012, Br. J. Educ. Technol..

[92]  Erman Yükseltürk,et al.  Exploring the link among entry characteristics, participation behaviors and course outcomes of online learners: An examination of learner profile using cluster analysis , 2013, Br. J. Educ. Technol..

[93]  Michelle Taub,et al.  Can the use of cognitive and metacognitive self-regulated learning strategies be predicted by learners' levels of prior knowledge in hypermedia-learning environments? , 2014, Comput. Hum. Behav..

[94]  Jure Leskovec,et al.  Engaging with massive online courses , 2014, WWW.

[95]  Gulsah Basol,et al.  A multivariate investigation of gender differences in the number of online tests received-checking for perceived self-regulation , 2016, Comput. Hum. Behav..

[96]  Onjaree Natakuatoong,et al.  Self-Regulated Learning: A Key of a Successful Learner in Online Learning Environments in Thailand , 2013 .

[97]  Marek Hatala,et al.  Associations between technological scaffolding and micro-level processes of self-regulated learning: A workplace study , 2016, Comput. Hum. Behav..