Finding Video-watching Behavior Patterns in a Flipped CS1 Course

Flipped courses often rely on pre-recorded videos that students are expected to watch before in-class time with the instructor. In this study, we investigated the video-watching behavior of students in a flipped CS1 programming course (n=490). We computed three behavioral metrics related to video watching: percentage of the videos watched, the number of times a video was opened to be watched, and when a video is watched with respect to the due date. We used k-medoids clustering on these metrics finding two distinct groups: 1) Low Video Engagement Group (53% of the students) watched 12% of the videos and 2) High Video Engagement Group (47% of the students) watched 75% of the videos. Analysis of these two different groups of engagement showed that students with prior programming experience watch fewer videos. We also found that students that watch more videos perform slightly better on summative assessments in the course. We discuss how regular video watching can be a key learning strategy for some but not all students in a flipped CS1 course, where some students can achieve good learning outcomes with minimal watching of the course videos.

[1]  Zahira Merchant,et al.  Analysis of Student Use of Video in a Flipped Classroom , 2019 .

[2]  Chris Wilcox,et al.  Quantifying the Benefits of Prior Programming Experience in an Introductory Computer Science Course , 2018, SIGCSE.

[3]  Saturnino Garcia,et al.  Improving Classroom Preparedness Using Guided Practice , 2018, SIGCSE.

[4]  Eva Mary Bures,et al.  Interaction in distance education and online learning: using evidence and theory to improve practice , 2011, J. Comput. High. Educ..

[5]  Dragan Gasevic,et al.  Detecting Learning Strategies with Analytics: Links with Self-reported Measures and Academic Performance , 2017, J. Learn. Anal..

[6]  Samuel B. Williams,et al.  ASSOCIATION FOR COMPUTING MACHINERY , 2000 .

[7]  M. Lage,et al.  Inverting the Classroom: A Gateway to Creating an Inclusive Learning Environment , 2000 .

[8]  Jürgen Börstler,et al.  Educational Data Mining and Learning Analytics in Programming: Literature Review and Case Studies , 2015, ITiCSE-WGR.

[9]  Saleh Alhazbi,et al.  Flipping introductory programming class: potentials, challenges, and research gaps , 2018, ICETC '18.

[10]  Kathleen E. Cook,et al.  Comparing the Effectiveness of an Inverted Classroom to a Traditional Classroom in an Upper-Division Engineering Course , 2013, IEEE Transactions on Education.

[11]  Michelle K. Smith,et al.  Active learning increases student performance in science, engineering, and mathematics , 2014, Proceedings of the National Academy of Sciences.

[12]  Yu Zhang,et al.  Including Coding Questions in Video Quizzes for a Flipped CS1 , 2018, SIGCSE.

[13]  Brian Dorn,et al.  An Empirical Analysis of Video Viewing Behaviors in Flipped CS1 Courses , 2016, ITiCSE.

[14]  Michael Waugh,et al.  Students’ Perceptions of the Value of Using Videos as a Pre-class Learning Experience in the Flipped Classroom , 2016 .

[15]  Michael Whitney,et al.  Captioning Online Course Videos: An Investigation into Knowledge Retention and Student Perception , 2019, SIGCSE.

[16]  Dave L. Edyburn,et al.  Would You Recognize Universal Design for Learning if You Saw it? Ten Propositions for New Directions for the Second Decade of UDL , 2010 .

[17]  Lijuan Cao,et al.  Interactive Preparatory Work in a Flipped Programming Course , 2019, CompEd.

[18]  Robert McCartney,et al.  A Multi-institutional Study of Peer Instruction in Introductory Computing , 2016, SIGCSE.

[19]  Mia Minnes,et al.  The Persistent Effect of Pre-College Computing Experience on College CS Course Grades , 2018, SIGCSE.

[20]  Dragan Gasevic,et al.  Learning analytics to unveil learning strategies in a flipped classroom , 2017, Internet High. Educ..

[21]  P. Rousseeuw.  Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[22]  Hassan Khosravi,et al.  Using Learning Analytics to Investigate Patterns of Performance and Engagement in Large Classes , 2017, SIGCSE.

[23]  Ignacio X. Domínguez,et al.  Toward Finding Online Activity Patterns in a Flipped Programming Course , 2020, SIGCSE.

[24]  J. Gower.  A General Coefficient of Similarity and Some of Its Properties , 1971 .