Characterizing Comment Types and Levels of Engagement in Video-Based Learning as a Basis for Adaptive Nudging

Video is frequently used as a learning medium in a variety of educational settings, including large online courses as well as informal learning scenarios. To foster learner engagement around instructional videos, our learning scenario facilitates interactive note taking and commenting similar to popular social video-sharing platforms. This approach has recently been enriched by introducing nudging mechanisms, which raises questions about ensuing learning effects. To better understand the nature of these effects, we take a closer look at the content of the comments. Our study is based on an ex post analysis of a larger data set from a recent study. As a first step of analysis, video comments are clustered based on a feature set that captures the temporal and semantic alignment of comments with the videos. Based on the ensuing typology of comments, learners are characterized through the types of comments that they have contributed. The results will allow for a better targeting of nudges to improve video-based learning.

[1]  Tobias Hecking,et al.  Using Network-Text analysis to characterise learner engagement in active video watching , 2017 .

[2]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[3]  M. Chi,et al.  The ICAP Framework: Linking Cognitive Engagement to Active Learning Outcomes , 2014 .

[4]  Antonija Mitrovic,et al.  Investigating the Effect of Adding Nudges to Increase Engagement in Active Video Watching , 2019, AIED.

[5]  Mihaela Cocea,et al.  Disengagement Detection in Online Learning: Validation Studies and Perspectives , 2011, IEEE Transactions on Learning Technologies.

[6]  Michail N. Giannakos,et al.  Making Sense of Video Analytics: Lessons Learned from Clickstream Interactions, Attitudes, and Learning Outcome in a Video-Assisted Course. , 2015 .

[7]  Kristy Elizabeth Boyer,et al.  The Affective Impact of Tutor Questions: Predicting Frustration and Engagement , 2016, EDM.

[8]  Paul R. Pintrich,et al.  Motivated Strategies for Learning Questionnaire , 2012 .

[9]  Antonija Mitrovic,et al.  Using Learning Analytics to Devise Interactive Personalised Nudges for Active Video Watching , 2017, UMAP.

[10]  Thushari Atapattu,et al.  Impact of Lecturer's Discourse for Students' Video Engagement: Video Learning Analytics Case Study of MOOCs , 2018, J. Learn. Anal..

[11]  Stephanie D. Teasley,et al.  A time series interaction analysis method for building predictive models of learners using log data , 2015, LAK.

[12]  Moffat Mathews,et al.  Detecting Gaming the System in Constraint-Based Tutors , 2010, UMAP.

[13]  Arthur C. Graesser,et al.  To Quit or Not to Quit: Predicting Future Behavioral Disengagement from Reading Patterns , 2014, Intelligent Tutoring Systems.

[14]  Tobias Hecking,et al.  Role Modelling in MOOC Discussion Forums , 2017 .

[15]  Carolyn Penstein Rosé,et al.  Towards triggering higher-order thinking behaviors in MOOCs , 2016, LAK.

[16]  H. Ulrich Hoppe,et al.  Using content analysis and domain ontologies to check learners’ understanding of science concepts , 2014, Journal of Computers in Education.

[17]  Ulrik Schroeder,et al.  Video annotation and analytics in CourseMapper , 2016, Smart Learning Environments.

[18]  Moffat Mathews,et al.  Supporting Constructive Video-Based Learning: Requirements Elicitation from Exploratory Studies , 2017, AIED.

[19]  Geza Kovacs,et al.  Effects of In-Video Quizzes on MOOC Lecture Viewing , 2016, L@S.

[20]  Joanna Drummond,et al.  In the Zone: Towards Detecting Student Zoning Out Using Supervised Machine Learning , 2010, Intelligent Tutoring Systems.

[21]  Andreas Paepcke,et al.  YouEDU: Addressing Confusion in MOOC Discussion Forums by Recommending Instructional Video Clips , 2015, EDM.

[22]  Kenneth R. Koedinger,et al.  Learning is Not a Spectator Sport: Doing is Better than Watching for Learning from a MOOC , 2015, L@S.

[23]  P. Pintrich A Manual for the Use of the Motivated Strategies for Learning Questionnaire (MSLQ). , 1991 .

[24]  Sidney K. D'Mello,et al.  Automatic gaze-based user-independent detection of mind wandering during computerized reading , 2016, User Modeling and User-Adapted Interaction.

[25]  D. Steinberg CART: Classification and Regression Trees , 2009 .

[26]  Jure Leskovec,et al.  Engaging with massive online courses , 2014, WWW.