Predicting course achievement of university students based on their procrastination behaviour on Moodle

A significant amount of educational data mining (EDM) research consider students’ past performance or non-academic factors to build predictive models, paying less attention to students’ activity data. While procrastination has been found as a crucial indicator which negatively affects performance of students, no research has investigated this underlying factor in predicting achievement of students in online courses. In this study, we aim to predict students’ course achievement in Moodle through their procrastination behaviour using their homework submission data. We first build feature vectors of students’ procrastination tendencies by considering their active, inactive, and spare time for homework, along with homework grades. Accordingly, we then use clustering and classification methods to optimally sort and put students into various categories of course achievement. We use a Moodle course from the University of Tartu in Estonia which includes 242 students to assess the efficacy of our proposed approach. Our findings show that our approach successfully predicts course achievement for students through their procrastination behaviour with precision and accuracy of 87% and 84% with L-SVM outperforming other classification methods. Furthermore, we found that students who procrastinate more are less successful and are potentially going to do poorly in a course, leading to lower achievement in courses. Finally, our results show that it is viable to use a less complex approach that is easy to implement, interpret, and use by practitioners to predict students’ course achievement with a high accuracy, and possibly take remedial actions in the semester.

[1]  Sebastián Ventura,et al.  Educational Data Mining: A Review of the State of the Art , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[2]  Ryan M Hill,et al.  Enhancing depression screening to identify college students at risk for persistent depressive symptoms. , 2015, Journal of affective disorders.

[3]  J. C. Núñez,et al.  Procrastinating Behavior in Computer-Based Learning Environments to Predict Performance: A Case Study in Moodle , 2017, Front. Psychol..

[4]  B. Tuckman Relations of Academic Procrastination, Rationalizations, and Performance in a Web Course with Deadlines , 2005, Psychological reports.

[5]  Moti Zwilling,et al.  Student data mining solution-knowledge management system related to higher education institutions , 2014, Expert Syst. Appl..

[6]  Mewati Ayub,et al.  Exploration of classification using NBTree for predicting students' performance , 2014, 2014 International Conference on Data and Software Engineering (ICODSE).

[7]  Laura Hirsto,et al.  Perspectives on University Students’ Self-Regulated Learning, Task-Avoidance, Time Management and Achievement in a Flipped Classroom Context , 2019 .

[8]  Danial Hooshyar,et al.  Mining biometric data to predict programmer expertise and task difficulty , 2017, Cluster Computing.

[9]  Margus Pedaste,et al.  The potential of open learner models to promote active thinking by enhancing self-regulated learning in online higher education learning environments , 2019, Br. J. Educ. Technol..

[10]  Vicente García-Díaz,et al.  Supporting academic decision making at higher educational institutions using machine learning-based algorithms , 2018, Soft Computing.

[11]  Philip Owende,et al.  An application of classification models to predict learner progression in tertiary education , 2014, 2014 IEEE International Advance Computing Conference (IACC).

[12]  Shaobo Huang,et al.  Predicting student academic performance in an engineering dynamics course: A comparison of four types of predictive mathematical models , 2013, Comput. Educ..

[13]  Margus Pedaste,et al.  Developing an effective support system for inquiry learning in a Web-based environment , 2006, J. Comput. Assist. Learn..

[14]  Margus Pedaste,et al.  Factors That Influence Students' Motivation to Start and to Continue Studying Information Technology in Estonia , 2016, IEEE Transactions on Education.

[15]  Mervyn J. Wighting,et al.  Distinguishing Sense of Community and Motivation Characteristics between Online and Traditional College Students. , 2008 .

[16]  A. W. Melton The situation with respect to the spacing of repetitions and memory , 1970 .

[17]  Rosa Alarcón,et al.  Centralized student performance prediction in large courses based on low-cost variables in an institutional context , 2018, Internet High. Educ..

[18]  Geraldine Clarebout,et al.  Tool-use in a blended undergraduate course: In Search of user profiles , 2011, Comput. Educ..

[19]  Mark Reynolds,et al.  A Quest for a One-Size-Fits-All Neural Network: Early Prediction of Students at Risk in Online Courses , 2019, IEEE Transactions on Learning Technologies.

[20]  Margus Pedaste,et al.  Mining Educational Data to Predict Students’ Performance through Procrastination Behavior , 2019, Entropy.

[21]  Bart Rienties,et al.  The scalable implementation of predictive learning analytics at a distance learning university: Insights from a longitudinal case study , 2020, Internet High. Educ..

[22]  Philip S. Yu,et al.  A Score Prediction Approach for Optional Course Recommendation via Cross-User-Domain Collaborative Filtering , 2019, IEEE Access.

[23]  Tutut Herawan,et al.  A Systematic Review on Educational Data Mining , 2017, IEEE Access.

[24]  Sebastián Ventura,et al.  Educational data mining: A survey from 1995 to 2005 , 2007, Expert Syst. Appl..

[25]  M. Letseka,et al.  High university drop-out rates: a threat to South Africa's future , 2008 .

[26]  Ji Won You,et al.  Identifying significant indicators using LMS data to predict course achievement in online learning , 2016, Internet High. Educ..

[27]  Stavros Valsamidis,et al.  Proposed S-Algo+ data mining algorithm for web platforms course content and usage evaluation , 2020, Soft Comput..

[28]  S. Parack,et al.  Application of data mining in educational databases for predicting academic trends and patterns , 2012, 2012 IEEE International Conference on Technology Enhanced Education (ICTEE).

[29]  J. Ferrari,et al.  Indecision and Avoidant Procrastination: The Role of Morningness—Eveningness and Time Perspective in Chronic Delay Lifestyles , 2008, The Journal of general psychology.

[30]  Yuyao Li,et al.  Predicting Students’ Academic Procrastination in Blended Learning Course Using Homework Submission Data , 2019, IEEE Access.

[31]  Olivier Le Bohec,et al.  Procrastination, participation, and performance in online learning environments , 2011, Comput. Educ..

[32]  Sotiris Kotsiantis,et al.  Using learning analytics to identify successful learners in a blended learning course , 2013 .

[33]  Miltiadis D. Lytras,et al.  Predicting at-risk university students in a virtual learning environment via a machine learning algorithm , 2020, Comput. Hum. Behav..

[34]  Meir Graff Self-Efficacy Beliefs and Academic Procrastination , 2019 .

[35]  Juho Leinonen,et al.  Predicting academic performance: a systematic literature review , 2018, ITiCSE.

[36]  Radu Vasiu,et al.  Predicting Assignment Submissions in a Multi-class Classification Problem , 2015 .

[37]  Cen Li,et al.  Modeling student online learning using clustering , 2006, ACM-SE 44.

[38]  Nicolas Michinov,et al.  Improving productivity and creativity in online groups through social comparison process: New evidence for asynchronous electronic brainstorming , 2005, Comput. Hum. Behav..

[39]  Il-Hyun Jo,et al.  Clustering blended learning courses by online behavior data: A case study in a Korean higher education institute , 2016, Internet High. Educ..

[40]  Zeynep Cemalcilar,et al.  Inequality in social capital: social capital, social risk and drop-out in the Turkish education system , 2014 .

[41]  Sebastián Ventura,et al.  Data mining in education , 2013, WIREs Data Mining Knowl. Discov..

[42]  Nikola M. Tomasevic,et al.  An overview and comparison of supervised data mining techniques for student exam performance prediction , 2020, Comput. Educ..

[43]  C. Abraham,et al.  Psychological correlates of university students' academic performance: a systematic review and meta-analysis. , 2012, Psychological bulletin.

[44]  Margus Pedaste,et al.  The Academic, Social, and Professional Integration Profiles of Information Technology Students , 2018, ACM Trans. Comput. Educ..

[45]  Reynol Junco,et al.  Predicting course outcomes with digital textbook usage data , 2015, Internet High. Educ..

[46]  Bruce W. Tuckman Academic Procrastinators: Their Rationalizations and Web-Course Performance. , 2002 .

[47]  Roger Azevedo,et al.  Does adaptive scaffolding facilitate students ability to regulate their learning with hypermedia? q , 2004 .

[48]  Sotiris B. Kotsiantis,et al.  PREDICTING STUDENTS' PERFORMANCE IN DISTANCE LEARNING USING MACHINE LEARNING TECHNIQUES , 2004, Appl. Artif. Intell..

[49]  Ji Won You,et al.  The Relationship among Academic Procrastination, Self-Regulated Learning, ear, Academic Self-Efficacy, and Perceived Academic Control in e-Learning , 2012 .

[50]  Jie Xu,et al.  Predicting Grades , 2015, IEEE Transactions on Signal Processing.

[51]  Gregory Schraw,et al.  Doing the Things We Do: A Grounded Theory of Academic Procrastination. , 2007 .

[52]  María del Puerto Paule Ruíz,et al.  Students' LMS interaction patterns and their relationship with achievement: A case study in higher education , 2016, Comput. Educ..

[53]  W. F. Punch,et al.  Predicting student performance: an application of data mining methods with an educational Web-based system , 2003, 33rd Annual Frontiers in Education, 2003. FIE 2003..

[54]  Fadhilah Ahmad,et al.  The Prediction of Students' Academic Performance Using Classification Data Mining Techniques , 2015 .

[55]  Paula Carroll,et al.  Identifying Patterns of Learner Behaviour: What Business Statistics Students Do with Learning Resources , 2017, INFORMS Trans. Educ..

[56]  Farshid Marbouti,et al.  Models for early prediction of at-risk students in a course using standards-based grading , 2016, Comput. Educ..

[57]  Kenneth A. Graetz,et al.  Procrastination in Online Courses: Performance and Attitudinal Differences , 2003 .

[58]  Minhong Wang,et al.  Open learner models in supporting self-regulated learning in higher education: A systematic literature review , 2020, Comput. Educ..