From Study Tactics to Learning Strategies: An Analytical Method for Extracting Interpretable Representations

Research into self-regulated learning has traditionally relied upon self-reported data. While there is a rich body of literature that has extracted invaluable information from such sources, it suffers from a number of shortcomings. For instance, it has been shown that surveys often provide insight into students’ perceptions about learning rather than how students actually employ study tactics and learning strategies. Accordingly, recent research has sought to assess students’ learning strategies and, by extension, their self-regulated learning via trace data collected from digital learning environments. A number of studies have amply demonstrated the ability of educational data mining and learning analytics methods to identify patterns indicative of learning strategies within trace log data. However, many of these methods are limited in their ability to describe and interpret differences between extracted latent representations at varying levels of granularity (for instance, in terms of the underlying data of student actions and behavior). To address this limitation, the present study proposes a new methodology whereby interpretable representations of student's self-regulating behavior are derived at two theoretically inspired levels: that of learning strategies, and the study tactics that compose them.

[1]  Marcelo Worsley,et al.  Programming Pluralism: Using Learning Analytics to Detect Patterns in the Learning of Computer Programming , 2014, Journal of the Learning Sciences.

[2]  Simon A. Fraser Does Time-on-task Estimation Matter? Implications for the Validity of Learning Analytics Findings , 2016 .

[3]  Maria Bannert,et al.  e-Research and learning theory: What do sequence and process mining methods contribute? , 2014, Br. J. Educ. Technol..

[4]  R. Azevedo,et al.  Does training on self-regulated learning facilitate students' learning with hypermedia? , 2004 .

[5]  Marek Hatala,et al.  Analytics of communities of inquiry: Effects of learning technology use on cognitive presence in asynchronous online discussions , 2015, Internet High. Educ..

[6]  B. Zimmerman Self-Regulated Learning and Academic Achievement: An Overview , 1990 .

[7]  D. Perkins The Fingertip Effect: How Information-Processing Technology Shapes Thinking , 1985 .

[8]  Woei Hung,et al.  Theory to reality: a few issues in implementing problem-based learning , 2011 .

[9]  Gilbert Ritschard,et al.  Analyzing and Visualizing State Sequences in R with TraMineR , 2011 .

[10]  Philip H. Winne,et al.  How Software Technologies Can Improve Research on Learning and Bolster School Reform , 2006 .

[11]  C. Phillips,et al.  The use of flipped classrooms in higher education: A scoping review , 2015, Internet High. Educ..

[12]  Dragan Gasevic,et al.  Using learning analytics to scale the provision of personalised feedback , 2019, Br. J. Educ. Technol..

[13]  Geraldine Clarebout,et al.  Tool-use in a blended undergraduate course: In Search of user profiles , 2011, Comput. Educ..

[14]  Dragan Gasevic,et al.  Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success , 2016, Internet High. Educ..

[15]  E. Wagenmakers,et al.  Hidden multiplicity in exploratory multiway ANOVA: Prevalence and remedies , 2014, Psychonomic Bulletin & Review.

[16]  R. Haase,et al.  Multivariate analysis of variance. , 1987 .

[17]  R. Schmidt,et al.  New Conceptualizations of Practice: Common Principles in Three Paradigms Suggest New Concepts for Training , 1992 .

[18]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[19]  Geraldine Clarebout,et al.  Regulation of tool-use within a blended course: Student differences and performance effects , 2013, Comput. Educ..

[20]  P. Pintrich,et al.  Motivational and self-regulated learning components of classroom academic performance. , 1990 .

[21]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[22]  Kathleen E. Cook,et al.  Comparing the Effectiveness of an Inverted Classroom to a Traditional Classroom in an Upper-Division Engineering Course , 2013, IEEE Transactions on Education.

[23]  R. Schmidt,et al.  Knowledge of results and motor learning: a review and critical reappraisal. , 1984, Psychological bulletin.

[24]  Abelardo Pardo,et al.  Data2U: scalable real time student feedback in active learning environments , 2016, LAK.

[25]  P. Alexander,et al.  A Perspective on Strategy Research: Progress and Prospects , 1998 .

[26]  C. Weinstein,et al.  Self-Regulation Interventions with a Focus on Learning Strategies , 2000 .

[27]  Philip H. Winne,et al.  Self-regulated learning viewed from models of information processing. , 2001 .

[28]  M. Lage,et al.  Inverting the Classroom: A Gateway to Creating an Inclusive Learning Environment , 2000 .

[29]  Peter Reimann,et al.  Connecting learning analytics with learning research: the role of design-based research , 2016 .

[30]  C. Weinstein Assessment and Training of Student Learning Strategies , 1988 .

[31]  Michelle K. Smith,et al.  Active learning increases student performance in science, engineering, and mathematics , 2014, Proceedings of the National Academy of Sciences.

[32]  Philip H. Winne,et al.  Exploring students’ calibration of self reports about study tactics and achievement , 2002 .

[33]  Hiromi Yamashita,et al.  Switched off? A study of disengagement among computing students at two universities , 2008 .

[34]  Judy Kay,et al.  Clustering and Sequential Pattern Mining of Online Collaborative Learning Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[35]  Thomas M. Duffy,et al.  Online learning: Learner characteristics and their approaches to managing learning , 2009 .

[36]  N. Purdie,et al.  Effects of Learning Skills Interventions on Student Learning: A Meta-Analysis , 1996 .

[37]  F. Marton,et al.  On qualitative differences in learning , 2013 .

[38]  Philip H. Winne,et al.  Learning Strategies, Study Skills, and Self-Regulated Learning in Postsecondary Education , 2013 .

[39]  Mingming Zhou,et al.  Modeling Academic Achievement by Self-Reported versus Traced Goal Orientation. , 2012 .

[40]  Taylor Martin,et al.  Using Learning Analytics to Understand the Learning Pathways of Novice Programmers , 2013 .

[41]  Daniel C. Moos,et al.  Flipping the Classroom: Embedding Self-Regulated Learning Prompts in Videos , 2015, Technology, Knowledge and Learning.

[42]  P. Reimann,et al.  Process mining techniques for analysing patterns and strategies in students’ self-regulated learning , 2013, Metacognition and Learning.

[43]  Chen-Lin C. Kulik,et al.  Timing of Feedback and Verbal Learning , 1988 .

[44]  Min Kyu Kim,et al.  The experience of three flipped classrooms in an urban university: an exploration of design principles , 2014, Internet High. Educ..

[45]  Roger Azevedo,et al.  Teaching and Learning in Technology-Rich Environments , 2006 .

[46]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[47]  Dorit Maor,et al.  Exploring Learning Analytics as Indicators of Study Behaviour , 2012 .

[48]  Philip H. Winne,et al.  Studying as self-regulated learning. , 1998 .

[49]  Noel Entwistle,et al.  Universities into the 21st Century: Teaching for Understanding at University: Deep Approaches and Distinctive Ways of Thinking , 2009 .

[50]  Philip H. Winne,et al.  Examining trace data to explore self-regulated learning , 2007 .

[51]  Gautam Biswas,et al.  Using Hidden Markov Models to Characterize Student Behaviors in Learning-by-Teaching Environments , 2008, Intelligent Tutoring Systems.

[52]  Gregory M. Donoghue,et al.  Learning strategies: a synthesis and conceptual model , 2016, npj Science of Learning.

[53]  Marek Hatala,et al.  Does Time-on-task Estimation Matter? Implications on Validity of Learning Analytics Findings , 2016, J. Learn. Anal..

[54]  R. D. Bock,et al.  Multivariate Statistical Methods in Behavioral Research , 1978 .

[55]  M. Speekenbrink,et al.  depmixS4: An R Package for Hidden Markov Models , 2010 .

[56]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[57]  Dragan Gasevic,et al.  Detecting Learning Strategies with Analytics: Links with Self-reported Measures and Academic Performance , 2017, J. Learn. Anal..

[58]  Philip H. Winne,et al.  Measuring Self-Regulated Learning , 2000 .

[59]  Dragan Gasevic,et al.  Learning analytics to unveil learning strategies in a flipped classroom , 2017, Internet High. Educ..

[60]  Gautam Biswas,et al.  Analysis of Productive Learning Behaviors in a Structured Inquiry Cycle Using Hidden Markov Models , 2010, EDM.

[61]  Abelardo Pardo,et al.  A feedback model for data-rich learning experiences , 2018 .

[62]  J. Biggs What the student does: teaching for enhanced learning , 1999 .

[63]  Hsiu-Ting Hung,et al.  Flipping the classroom for English language learners to foster active learning , 2015 .

[64]  R. Gillies,et al.  Teachers' reflections on cooperative learning: Issues of implementation , 2010 .

[65]  C. Abraham,et al.  Psychological correlates of university students' academic performance: a systematic review and meta-analysis. , 2012, Psychological bulletin.