Grade prediction of weekly assignments in MOOCS: mining video-viewing behavior

Massive open online courses (MOOCs) hold the promise of democratizing the learning process. However, providing effective feedback has proven hard to offer at scale since most methods require a teacher or tutor. Leveraging big data in MOOCs offers a mechanism to develop predictive models that can inform computer-based pedagogical tutors. We review research on grade prediction and examine the predictive power of a model based on user video-watching behavior. In a MOOC organized around weekly assignments, we find that frequency of video viewing per week is a better predictor than individual viewing features such as plays, pauses, seeking, and rate changes. This finding is useful for MOOCs that use assignments for course evaluations in addition or to the exclusion of in-video quizzes for formative assessment. Engaging, well-crafted assignments in MOOCs have the potential of boosting student retention and course completion by fostering a deeper understanding through application and practice.

[1]  Mung Chiang,et al.  Behavior-Based Grade Prediction for MOOCs Via Time Series Neural Networks , 2017, IEEE Journal of Selected Topics in Signal Processing.

[2]  Galit Shmueli,et al.  To Explain or To Predict? , 2010, 1101.0891.

[3]  Bowei Hong,et al.  Online education performance prediction via time-related features , 2017, 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS).

[4]  Meina Zhu,et al.  A systematic review of research methods and topics of the empirical MOOC literature (2014-2016) , 2018, Internet High. Educ..

[5]  Patrick Jermann,et al.  Your click decides your fate: Inferring Information Processing and Attrition Behavior from MOOC Video Clickstream Interactions , 2014, Proceedings of the EMNLP 2014 Workshop on Analysis of Large Scale Social Interaction in MOOCs.

[6]  Qian Zhang,et al.  Modeling and Predicting Learning Behavior in MOOCs , 2016, WSDM.

[7]  Tenzin Doleck,et al.  Examining the Link Between Prior Achievement in Secondary Education and Performance in College: Using Data from Pre-university Physics Courses , 2018 .

[8]  Sebastián Ventura,et al.  Educational Data Mining: A Review of the State of the Art , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[9]  Olaf Zawacki-Richter,et al.  Trends and Patterns in Massive Open Online Courses: Review and Content Analysis of Research on MOOCs (2008-2015) , 2017 .

[10]  Jeffrey D. Karpicke,et al.  The Power of Testing Memory Basic Research and Implications for Educational Practice , 2006 .

[11]  H WittenIan,et al.  The WEKA data mining software , 2009 .

[12]  Geoff Brumfiel,et al.  Changing course , 2007, Nature.

[13]  Maureen Ebben,et al.  Unpacking MOOC scholarly discourse: a review of nascent MOOC scholarship , 2014 .

[14]  Mung Chiang,et al.  MOOC performance prediction via clickstream data and social learning networks , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[15]  R. Azevedo,et al.  Scaffolding Self-regulated Learning and Metacognition – Implications for the Design of Computer-based Scaffolds , 2005 .

[16]  Mihaela van der Schaar,et al.  Personalized Grade Prediction: A Data Mining Approach , 2015, 2015 IEEE International Conference on Data Mining.

[17]  Henry L. Roediger,et al.  Examining the Testing Effect with Open-and Closed-book Tests , 2022 .

[18]  Huimin Wang,et al.  Grade Prediction in MOOCs , 2016, 2016 IEEE Intl Conference on Computational Science and Engineering (CSE) and IEEE Intl Conference on Embedded and Ubiquitous Computing (EUC) and 15th Intl Symposium on Distributed Computing and Applications for Business Engineering (DCABES).

[19]  Giuseppe Riccardi,et al.  Predicting students' final exam scores from their course activities , 2015, 2015 IEEE Frontiers in Education Conference (FIE).

[20]  Geoffrey S. Hubona,et al.  Using PLS path modeling in new technology research: updated guidelines , 2016, Ind. Manag. Data Syst..

[21]  Qinghua Zheng,et al.  Modeling and Predicting the Active Video-Viewing Time in a Large-Scale E-Learning System , 2017, IEEE Access.

[22]  Dragan Gasevic,et al.  Tools for Educational Data Mining , 2016, Journal of Educational and Behavioral Statistics.

[23]  Uday Kumar Mothukuri,et al.  Improvisation of learning experience using learning analytics in eLearning , 2017, 2017 5th National Conference on E-Learning & E-Learning Technologies (ELELTECH).

[24]  Jeffrey D. Karpicke,et al.  Test-Enhanced Learning , 2006, Psychological science.

[25]  Martin Formanek,et al.  Insights about large-scale online peer assessment from an analysis of an astronomy MOOC , 2017, Comput. Educ..

[26]  James A. Kulik,et al.  Effects of Frequent Classroom Testing. , 1991 .

[27]  Tutut Herawan,et al.  A Systematic Review on Educational Data Mining , 2017, IEEE Access.

[28]  Justin Reich,et al.  Rebooting MOOC Research , 2015, Science.

[29]  Brit Toven-Lindsey,et al.  Virtually unlimited classrooms: Pedagogical practices in massive open online courses , 2015, Internet High. Educ..

[30]  Robert Schuwer,et al.  Institutional MOOC strategies in Europe , 2015 .

[31]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[32]  Tayeb Brahimi,et al.  Learning outside the classroom through MOOCs , 2015, Comput. Hum. Behav..

[33]  Andrew D. Ho,et al.  Changing “Course” , 2014 .

[34]  George Siemens,et al.  What public media reveals about MOOCs: A systematic analysis of news reports , 2015, Br. J. Educ. Technol..

[35]  Gautam Biswas,et al.  Expert Feature-Engineering vs. Deep Neural Networks: Which Is Better for Sensor-Free Affect Detection? , 2018, AIED.