PREDICTING ACADEMIC PERFORMANCE FROM BEHAVIOURAL AND LEARNING DATA

The volume and quality of data, but also their relevance, are crucial when performing data analysis. In this paper, a study of the influence of different types of data is presented, particularly in the context of educational data obtained from Learning Management Systems (LMSs). These systems provide a large amount of data from the student activity but they usually do not describe the results of the learning process, i.e., they describe the behaviour but not the learning results. The starting hypothesis states that complementing behavioural data with other more relevant data (regarding learning outcomes) can lead to a better analysis of the learning process, that is, in particular it is possible to early predict the student final performance. A learning platform has been spe cially developed to collect data not just from the usage but also related to the way students learn and progress in training activities. Data of both types are used to build a progressive predictive system for helping in the learning process. This model is based on a classifier that uses the Support Vector Machine technique. As a result, the system obtains a weekly classification of each student as the probability of belonging to one of three classes: high, medium and low performance. The results show that, supplementing behavioural data with learning data allows us to obtain better predictions about the results of the students in a learning system. Moreover, it can be deduced that the use of heterogeneous data enriches the final performance of the prediction algorithms.

[1]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[2]  George Siemens,et al.  Penetrating the fog: analytics in learning and education , 2014 .

[3]  Ioanna Lykourentzou,et al.  Early and dynamic student achievement prediction in e-learning courses using neural networks , 2009 .

[4]  C. Villagrá Arnedo,et al.  REAL-TIME EVALUATION , 2009 .

[5]  Alvin Y. Wang,et al.  Characteristics of students who enroll and succeed in psychology Web-based classes. , 2000 .

[6]  Rafael Molina-Carmona,et al.  Boosting the Learning Process with Progressive Performance Prediction , 2015, EC-TEL.

[7]  A. I. Illanas Vila,et al.  PREDICTING STUDENT PERFORMANCE IN TRANSLATING FOREIGN LANGUAGES WITH A SERIOUS GAME , 2013 .

[8]  Peter R. Turner,et al.  Predictive assessment of student performance for early strategic guidance , 2011, 2011 Frontiers in Education Conference (FIE).

[9]  Jihie Kim,et al.  Can Online Discussion Participation Predict Group Project Performance? Investigating the Roles of Linguistic Features and Participation Patterns , 2013, International Journal of Artificial Intelligence in Education.

[10]  George Siemens,et al.  Learning analytics: envisioning a research discipline and a domain of practice , 2012, LAK.

[11]  Alvin Y. Wang,et al.  Predictors of Performance in the Virtual Classroom: Identifying and Helping At-Risk Cyber-Students , 2002 .

[12]  Chih-Jen Lin,et al.  Probability Estimates for Multi-class Classification by Pairwise Coupling , 2003, J. Mach. Learn. Res..

[13]  Tobias Ley,et al.  Which User Interactions Predict Levels of Expertise in Work-Integrated Learning? , 2013, EC-TEL.

[14]  Shaobo Huang,et al.  Predicting student academic performance in an engineering dynamics course: A comparison of four types of predictive mathematical models , 2013, Comput. Educ..

[15]  Jerome L. Myers,et al.  Research Design and Statistical Analysis: Third Edition , 1991 .

[16]  Sotiris B. Kotsiantis Use of machine learning techniques for educational proposes: a decision support system for forecasting students’ grades , 2011, Artificial Intelligence Review.

[17]  Jerome L. Myers,et al.  Research Design and Statistical Analysis , 1991 .

[18]  Shane Dawson,et al.  Mining LMS data to develop an "early warning system" for educators: A proof of concept , 2010, Comput. Educ..

[19]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[20]  Philip J. Goldstein,et al.  Academic Analytics : The Uses of Management Information and Technology in Higher Education , 2005 .

[21]  Shihong Huang,et al.  Work in progress: A machine learning approach for assessment and prediction of teamwork effectiveness in software engineering education , 2012, 2012 Frontiers in Education Conference Proceedings.