Evaluating the Relevance of Educational Videos Using BKT and Big Data.

Along with the advent of MOOCs and other online learning platforms such as Khan Academy, the role of online education has continued to grow in relation to that of traditional on-campus instruction. Rather than tackle the problem of evaluating large educational units such as entire online courses, this paper approaches a smaller problem: exploring a framework for evaluating more granular educational units, in this case, short educational videos. We have chosen to leverage an adaptation of traditional Bayesian Knowledge Tracing (BKT), intended to incorporate the usage of video content in addition to assessment activity. By exploring the change in predictive error when alternately including or omitting video activity, we suggest a metric for determining the relevance of videos to associated assessments. To validate our hypothesis and demonstrate the application of our proposed methods we use data obtained from both the popular Khan Academy website and two MOOCs offered by Stanford University in the summer of 2014.

[1]  Zachary A. Pardos,et al.  Modeling Individualization in a Bayesian Networks Implementation of Knowledge Tracing , 2010, UMAP.

[2]  J. P. Meyer,et al.  Fair and Equitable Measurement of Student Learning in MOOCS: An Introduction to Item Response Theory, Scale Linking, and Score Equating. , 2013 .

[3]  Katia Kermanidis,et al.  Studying massive open online courses: recommendation in social media , 2013, PCI '13.

[4]  Krzysztof Z. Gajos,et al.  Understanding in-video dropouts and interaction peaks inonline lecture videos , 2014, L@S.

[5]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[6]  Carolyn Penstein Rosé,et al.  Forum Thread Recommendation for Massive Open Online Courses , 2014, EDM.

[7]  Ulrik Schroeder,et al.  What Drives a Successful MOOC? An Empirical Examination of Criteria to Assure Design Quality of MOOCs , 2014, 2014 IEEE 14th International Conference on Advanced Learning Technologies.

[8]  Zachary A. Pardos,et al.  KT-IDEM: introducing item difficulty to the knowledge tracing model , 2011, UMAP'11.

[9]  Philip J. Guo,et al.  How video production affects student engagement: an empirical study of MOOC videos , 2014, L@S.

[10]  B. K. Tripathy,et al.  Reinforcement learning approach towards effective content recommendation in MOOC environments , 2014, 2014 IEEE International Conference on MOOC, Innovation and Technology in Education (MITE).

[11]  Vincent Aleven,et al.  More Accurate Student Modeling through Contextual Estimation of Slip and Guess Probabilities in Bayesian Knowledge Tracing , 2008, Intelligent Tutoring Systems.