Understanding in-video dropouts and interaction peaks in online lecture videos Citation

With thousands of learners watching the same online lecture videos, analyzing video watching patterns provides a unique opportunity to understand how students learn with videos. This paper reports a large-scale analysis of in-video dropout and peaks in viewership and student activity, using second-by-second user interaction data from 862 videos in four Massive Open Online Courses (MOOCs) on edX. We find higher dropout rates in longer videos, re-watching sessions (vs first-time), and tutorials (vs lectures). Peaks in rewatching sessions and play events indicate points of interest and confusion. Results show that tutorials (vs lectures) and re-watching sessions (vs first-time) lead to more frequent and sharper peaks. In attempting to reason why peaks occur by sampling 80 videos, we observe that 61% of the peaks accompany visual transitions in the video, e.g., a slide view to a classroom view. Based on this observation, we identify five student activity patterns that can explain peaks: starting from the beginning of a new material, returning to missed content, following a tutorial step, replaying a brief segment, and repeating a non-visual explanation. Our analysis has design implications for video authoring, editing, and interface design, providing a richer understanding of video learning on MOOCs.

[1]  Philip J. Guo,et al.  How video production affects student engagement: an empirical study of MOOC videos , 2014, L@S.

[2]  Andreas Girgensohn,et al.  Time-Constrained Keyframe Selection Technique , 2004, Multimedia Tools and Applications.

[3]  Jeffrey Heer,et al.  D³ Data-Driven Documents , 2011, IEEE Transactions on Visualization and Computer Graphics.

[4]  Wei Tsang Ooi,et al.  Crowdsourced automatic zoom and scroll for video retargeting , 2010, ACM Multimedia.

[5]  Susan T. Dumais,et al.  Understanding temporal query dynamics , 2011, WSDM '11.

[6]  Chris Piech,et al.  Deconstructing disengagement: analyzing learner subpopulations in massive open online courses , 2013, LAK '13.

[7]  H. Wickham Bin-summarise-smooth : A framework for visualising large data , 2013 .

[8]  Stephen W. Smoliar,et al.  Content based video indexing and retrieval , 1994, IEEE MultiMedia.

[9]  M. Wand Fast Computation of Multivariate Kernel Estimators , 1994 .

[10]  Konstantinos Chorianopoulos,et al.  Collective intelligence within web video , 2013, Human-centric Computing and Information Sciences.

[11]  Gordon Rugg,et al.  The sorting techniques: a tutorial paper on card sorts, picture sorts and item sorts , 1997, Expert Syst. J. Knowl. Eng..

[12]  Shane Dawson,et al.  The Collaborative Lecture Annotation System (CLAS): A New TOOL for Distributed Learning , 2013, IEEE Transactions on Learning Technologies.

[13]  Michael S. Bernstein,et al.  Twitinfo: aggregating and visualizing microblogs for event exploration , 2011, CHI.

[14]  W. Cleveland LOWESS: A Program for Smoothing Scatterplots by Robust Locally Weighted Regression , 1981 .

[15]  Krzysztof Z. Gajos,et al.  Crowdsourcing step-by-step information extraction to enhance existing how-to videos , 2014, CHI.

[16]  David A. Shamma,et al.  Knowing funny: genre perception and categorization in social video sharing , 2011, CHI.

[17]  Dan R. Olsen,et al.  Video summarization based on user interaction , 2011, EuroITV '11.

[18]  Ryan Shaw,et al.  Toward emergent representations for video , 2005, MULTIMEDIA '05.

[19]  Anoop Gupta,et al.  Browsing digital video , 2000, CHI.

[20]  Yoav Bergner,et al.  Who does what in a massive open online course? , 2014, Commun. ACM.

[21]  Fernando Diaz,et al.  Temporal profiles of queries , 2007, TOIS.

[22]  Jing Xiao,et al.  Content-Based Video Indexing and Retrieval , 2004 .

[23]  David E. Pritchard,et al.  Studying Learning in the Worldwide Classroom Research into edX's First MOOC. , 2013 .

[24]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Susan T. Dumais,et al.  Towards Supporting Search over Trending Events with Social Media , 2013, ICWSM.