Analysing the Use of Worked Examples and Tutored and Untutored Problem-Solving in a Dispositional Learning Analytics Context

The identification of students’ learning strategies by using multi-modal data that combine trace data with self-report data is the prime aim of this study. Our context is an application of dispositional learning analytics in a large introductory course mathematics and statistics, based on blended learning. Building on previous studies in which we found marked differences in how students use worked examples as a learning strategy, we compare different profiles of learning strategies on learning dispositions and learning outcome. Our results cast a new light on the issue of efficiency of learning by worked examples, tutored and untutored problem-solving: in contexts where students can apply their own preferred learning strategy, we find that learning strategies depend on learning dispositions. As a result, learning dispositions will have a confounding effect when studying the efficiency of worked examples as a learning strategy in an ecologically valid context.

[1]  Francisco J. García-Peñalvo,et al.  Learning Analytics to Assess Students' Behavior With Scratch Through Clickstream , 2018, LASI-SPAIN.

[2]  Dirk T. Tempelaar,et al.  A structural equation model analyzing the relationship of student achievement motivations and personality factors in a range of academic subject-matter areas , 2007 .

[3]  Dragan Gasevic,et al.  Effects of instructional conditions and experience on the adoption of a learning tool , 2017, Comput. Hum. Behav..

[4]  TempelaarDirk,et al.  Student profiling in a dispositional learning analytics application using formative assessment , 2018 .

[5]  Dirk T. Tempelaar How Dispositional Learning Analytics Helps Understanding the Worked-Example Principle. , 2017 .

[6]  Dirk T. Tempelaar,et al.  Towards Actionable Learning Analytics Using Dispositions , 2017, IEEE Transactions on Learning Technologies.

[7]  J. Vermunt Metacognitive, cognitive and affective aspects of learning styles and strategies: A phenomenographic analysis , 1996 .

[8]  E. Duval,et al.  Formative assessment and learning analytics , 2013 .

[9]  Tamara van Gog,et al.  Exploring the Assistance Dilemma: Comparing Instructional Support in Examples and Problems , 2014, Intelligent Tutoring Systems.

[10]  Dirk T. Tempelaar,et al.  In search for the most informative data for feedback generation: Learning analytics in a data-rich context , 2015, Comput. Hum. Behav..

[11]  Dirk T. Tempelaar,et al.  Adding dispositions to create pedagogy-based Learning Analytics , 2017 .

[12]  Francisco J. García-Peñalvo,et al.  Clickstream for learning analytics to assess students' behavior with Scratch , 2019, Future Gener. Comput. Syst..

[13]  Dragan Gasevic,et al.  Detecting Learning Strategies with Analytics: Links with Self-reported Measures and Academic Performance , 2017, J. Learn. Anal..

[14]  Dirk T. Tempelaar,et al.  What learning analytics based prediction models tell us about feedback preferences of students , 2016 .

[15]  Anastasios A. Economides,et al.  Learning Analytics and Educational Data Mining in Practice: A Systematic Literature Review of Empirical Evidence , 2014, J. Educ. Technol. Soc..

[16]  Bart Rienties,et al.  Implementing a Learning Analytics Intervention and Evaluation Framework: what works? , 2017 .

[17]  Reinhard Pekrun,et al.  Measuring emotions during epistemic activities: the Epistemically-Related Emotion Scales , 2017, Cognition & emotion.

[18]  Simon Buckingham Shum,et al.  Learning dispositions and transferable competencies: pedagogy, modelling and learning analytics , 2012, International Conference on Learning Analytics and Knowledge.

[19]  Kenneth R. Koedinger,et al.  A Response Time Model For Bottom-Out Hints as Worked Examples , 2008, EDM.

[20]  Jason M. Harley,et al.  Using Trace Data to Examine the Complex Roles of Cognitive, Metacognitive, and Emotional Self-Regulatory Processes During Learning with Multi-agent Systems , 2013 .

[21]  Simon Andrewes,et al.  On formative assessment , 2015 .