Mining Educational Data to Predict Students’ Performance through Procrastination Behavior

A significant amount of research has indicated that students’ procrastination tendencies are an important factor influencing the performance of students in online learning. It is, therefore, vital for educators to be aware of the presence of such behavior trends as students with lower procrastination tendencies usually achieve better than those with higher procrastination. In the present study, we propose a novel algorithm—using student’s assignment submission behavior—to predict the performance of students with learning difficulties through procrastination behavior (called PPP). Unlike many existing works, PPP not only considers late or non-submissions, but also investigates students’ behavioral patterns before the due date of assignments. PPP firstly builds feature vectors representing the submission behavior of students for each assignment, then applies a clustering method to the feature vectors for labelling students as a procrastinator, procrastination candidate, or non-procrastinator, and finally employs and compares several classification methods to best classify students. To evaluate the effectiveness of PPP, we use a course including 242 students from the University of Tartu in Estonia. The results reveal that PPP could successfully predict students’ performance through their procrastination behaviors with an accuracy of 96%. Linear support vector machine appears to be the best classifier among others in terms of continuous features, and neural network in categorical features, where categorical features tend to perform slightly better than continuous. Finally, we found that the predictive power of all classification methods is lowered by an increment in class numbers formed by clustering.

[1]  Mervyn J. Wighting,et al.  Distinguishing Sense of Community and Motivation Characteristics between Online and Traditional College Students. , 2008 .

[2]  Margus Pedaste,et al.  The potential of open learner models to promote active thinking by enhancing self-regulated learning in online higher education learning environments , 2019, Br. J. Educ. Technol..

[3]  Sotiris Kotsiantis,et al.  Using learning analytics to identify successful learners in a blended learning course , 2013 .

[4]  Lei Gao,et al.  Automatic Clustering of Different Solutions to Programming Assignments in Computing Education , 2019, CompEd.

[5]  W. The Situation with Respect to the Spacing of Repetitions and Memory , 2005 .

[6]  Radu Vasiu,et al.  Predicting Assignment Submissions in a Multi-class Classification Problem , 2015 .

[7]  Kenneth A. Graetz,et al.  Procrastination in Online Courses: Performance and Attitudinal Differences , 2003 .

[8]  Alaa M. El-Halees,et al.  Mining educational data to improve students' performance: a case study , 2012 .

[9]  Sebastián Ventura,et al.  Data mining in course management systems: Moodle case study and tutorial , 2008, Comput. Educ..

[10]  Wendelien van Eerde,et al.  A meta-analytically derived nomological network of procrastination , 2003 .

[11]  Piers Steel The nature of procrastination: a meta-analytic and theoretical review of quintessential self-regulatory failure. , 2007, Psychological bulletin.

[12]  Fadhilah Ahmad,et al.  The Prediction of Students' Academic Performance Using Classification Data Mining Techniques , 2015 .

[13]  Georgios Kostopoulos,et al.  Multiview Learning for Early Prognosis of Academic Performance: A Case Study , 2019, IEEE Transactions on Learning Technologies.

[14]  Nikola M. Tomasevic,et al.  An overview and comparison of supervised data mining techniques for student exam performance prediction , 2020, Comput. Educ..

[15]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[16]  Sotiris B. Kotsiantis Educational data mining: a case study for predicting dropout-prone students , 2009, Int. J. Knowl. Eng. Soft Data Paradigms.

[17]  Stefan Fries,et al.  Procrastination in a distance university setting , 2012 .

[18]  Margus Pedaste,et al.  Developing an effective support system for inquiry learning in a Web-based environment , 2006, J. Comput. Assist. Learn..

[19]  Juho Leinonen,et al.  Predicting academic performance: a systematic literature review , 2018, ITiCSE.

[20]  J. C. Núñez,et al.  Procrastinating Behavior in Computer-Based Learning Environments to Predict Performance: A Case Study in Moodle , 2017, Front. Psychol..

[21]  David S. Ackerman,et al.  My Instructor Made Me Do It: Task Characteristics of Procrastination , 2005 .

[22]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[23]  Vassilios S. Verykios,et al.  A predictive analytics framework as a countermeasure for attrition of students , 2019 .

[24]  M. K. Akinsola,et al.  Correlates of Academic Procrastination and Mathematics Achievement of University Undergraduate Students , 2007 .

[25]  Jin Nam Choi,et al.  Rethinking Procrastination: Positive Effects of "Active" Procrastination Behavior on Attitudes and Performance , 2005, The Journal of social psychology.

[26]  B. Tuckman Relations of Academic Procrastination, Rationalizations, and Performance in a Web Course with Deadlines , 2005, Psychological reports.

[27]  Sotiris B. Kotsiantis,et al.  A combinational incremental ensemble of classifiers as a technique for predicting students' performance in distance education , 2010, Knowl. Based Syst..

[28]  A. P. Rovai,et al.  Blended Learning and Sense of Community: A Comparative Analysis with Traditional and Fully Online Graduate Courses , 2004 .

[29]  Yuyao Li,et al.  Predicting Students’ Academic Procrastination in Blended Learning Course Using Homework Submission Data , 2019, IEEE Access.

[30]  Olivier Le Bohec,et al.  Procrastination, participation, and performance in online learning environments , 2011, Comput. Educ..

[31]  Fred A. J. Korthagen,et al.  De invloed van intrapersoonlijke factoren op studieresultaten van eerstejaars pabostudenten en de mediërende rol van academisch uitstelgedrag , 2015 .

[32]  Marina Goroshit,et al.  Academic Procrastination, Emotional Intelligence, Academic Self-Efficacy, and GPA , 2014, Journal of learning disabilities.

[33]  Sebastián Ventura,et al.  Educational Data Mining: A Review of the State of the Art , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[34]  Cen Li,et al.  Modeling student online learning using clustering , 2006, ACM-SE 44.

[35]  Nicolas Michinov,et al.  Improving productivity and creativity in online groups through social comparison process: New evidence for asynchronous electronic brainstorming , 2005, Comput. Hum. Behav..

[36]  Shaobo Huang,et al.  Predicting student academic performance in an engineering dynamics course: A comparison of four types of predictive mathematical models , 2013, Comput. Educ..

[37]  H. Steven Scholte,et al.  Representational similarity analysis offers a preview of the noradrenergic modulation of long-term fear memory at the time of encoding , 2015, Psychoneuroendocrinology.

[38]  Sotiris B. Kotsiantis,et al.  PREDICTING STUDENTS' PERFORMANCE IN DISTANCE LEARNING USING MACHINE LEARNING TECHNIQUES , 2004, Appl. Artif. Intell..

[39]  Farshid Marbouti,et al.  Models for early prediction of at-risk students in a course using standards-based grading , 2016, Comput. Educ..

[40]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[41]  C. Abraham,et al.  Psychological correlates of university students' academic performance: a systematic review and meta-analysis. , 2012, Psychological bulletin.

[42]  J. Ferrari,et al.  Indecision and Avoidant Procrastination: The Role of Morningness—Eveningness and Time Perspective in Chronic Delay Lifestyles , 2008, The Journal of general psychology.

[43]  Bruce W. Tuckman Academic Procrastinators: Their Rationalizations and Web-Course Performance. , 2002 .

[44]  Roger Azevedo,et al.  Does adaptive scaffolding facilitate students ability to regulate their learning with hypermedia? q , 2004 .

[45]  Ji Won You,et al.  The Relationship among Academic Procrastination, Self-Regulated Learning, ear, Academic Self-Efficacy, and Perceived Academic Control in e-Learning , 2012 .

[46]  Arie W. Kruglanski,et al.  Wishful thinking and procrastination. , 2000 .

[47]  Mark Reynolds,et al.  A Quest for a One-Size-Fits-All Neural Network: Early Prediction of Students at Risk in Online Courses , 2019, IEEE Transactions on Learning Technologies.

[48]  Tutut Herawan,et al.  A Systematic Review on Educational Data Mining , 2017, IEEE Access.

[49]  Gregory Schraw,et al.  Doing the Things We Do: A Grounded Theory of Academic Procrastination. , 2007 .

[50]  María del Puerto Paule Ruíz,et al.  Students' LMS interaction patterns and their relationship with achievement: A case study in higher education , 2016, Comput. Educ..

[51]  Rob Phillips Tools used in learning management systems: Analysis of WebCT usage logs , 2006 .