Evaluating Educational Videos using Bayesian Knowledge Tracing and Big Data

Along with the advent of MOOCs and other online learning platforms such as Khan Academy, the role of online education has continued to grow in relation to that of traditional on-campus instruction. Rather than tackle the problem of evaluating large educational units such as entire online courses, this paper approaches a smaller problem: exploring a framework for evaluating more granular educational units, in this case, short educational videos. We have chosen to leverage an adaptation of traditional Bayesian Knowledge Tracing (BKT), intended to incorporate the usage of video content in addition to assessment activity. By exploring the change in predictive error when alternately including or omitting video activity, we suggest a metric for determining the relevance of videos to associated assessments. To validate our hypothesis and demonstrate the application of our proposed methods we use data obtained from both the popular Khan Academy website and two MOOCs offered by Stanford University in the summer of 2014.

[1]  Philip J. Guo,et al.  How video production affects student engagement: an empirical study of MOOC videos , 2014, L@S.

[2]  Ulrik Schroeder,et al.  What Drives a Successful MOOC? An Empirical Examination of Criteria to Assure Design Quality of MOOCs , 2014, 2014 IEEE 14th International Conference on Advanced Learning Technologies.

[3]  Vincent Aleven,et al.  More Accurate Student Modeling through Contextual Estimation of Slip and Guess Probabilities in Bayesian Knowledge Tracing , 2008, Intelligent Tutoring Systems.

[4]  B. K. Tripathy,et al.  Reinforcement learning approach towards effective content recommendation in MOOC environments , 2014, 2014 IEEE International Conference on MOOC, Innovation and Technology in Education (MITE).

[5]  Zachary A. Pardos,et al.  KT-IDEM: introducing item difficulty to the knowledge tracing model , 2011, UMAP'11.

[6]  J. P. Meyer,et al.  Fair and Equitable Measurement of Student Learning in MOOCS: An Introduction to Item Response Theory, Scale Linking, and Score Equating. , 2013 .

[7]  Carolyn Penstein Rosé,et al.  Forum Thread Recommendation for Massive Open Online Courses , 2014, EDM.

[8]  Zachary A. Pardos,et al.  Modeling Individualization in a Bayesian Networks Implementation of Knowledge Tracing , 2010, UMAP.

[9]  Krzysztof Z. Gajos,et al.  Understanding in-video dropouts and interaction peaks inonline lecture videos , 2014, L@S.

[10]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[11]  Katia Kermanidis,et al.  Studying massive open online courses: recommendation in social media , 2013, PCI '13.