Implementing predictive learning analytics on a large scale: the teacher's perspective

In this paper, we describe a large-scale study about the use of predictive learning analytics data with 240 teachers in 10 modules at a distance learning higher education institution. The aim of the study was to illuminate teachers' uses and practices of predictive data, in particular identify how predictive data was used to support students at risk of not completing or failing a module. Data were collected from statistical analysis of 17,033 students' performance by the end of the intervention, teacher usage statistics, and five individual semi-structured interviews with teachers. Findings revealed that teachers endorse the use of predictive data to support their practice yet in diverse ways and raised the need for devising appropriate intervention strategies to support students at risk.

[1]  Rebecca Ferguson,et al.  Social learning analytics: five approaches , 2012, LAK.

[2]  Zdenek Zdráhal,et al.  Developing predictive models for early detection of at-risk students on distance learning modules , 2014, LAK Workshops.

[3]  Shane Dawson,et al.  Mining LMS data to develop an "early warning system" for educators: A proof of concept , 2010, Comput. Educ..

[4]  Marek Hatala,et al.  Learning at distance: Effects of interaction traces on academic achievement , 2015, Comput. Educ..

[5]  Ormond Simpson,et al.  Supporting students for success in online and distance education , 2012 .

[6]  Agustín C. Caminero,et al.  Analyzing the students' behavior and relevant topics in virtual learning communities , 2014, Comput. Hum. Behav..

[7]  Anouschka van Leeuwen,et al.  Teacher regulation of cognitive activities during student collaboration: Effects of learning analytics , 2015, Comput. Educ..

[8]  Bart Rienties,et al.  Analytics4Action Evaluation Framework: A Review of Evidence-Based Learning Analytics Interventions at the Open University UK , 2016 .

[9]  Martin Hlosta,et al.  OU Analyse: analysing at-risk students at The Open University , 2015 .

[10]  Dragan Gasevic,et al.  Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success , 2016, Internet High. Educ..

[11]  Anouschka van Leeuwen,et al.  Supporting teachers in guiding collaborating students: Effects of learning analytics in CSCL , 2014, Comput. Educ..

[12]  Anastasios A. Economides,et al.  Learning Analytics and Educational Data Mining in Practice: A Systematic Literature Review of Empirical Evidence , 2014, J. Educ. Technol. Soc..

[13]  Erik Duval,et al.  Dataset-driven research for improving recommender systems for learning , 2011, LAK.

[14]  Bart Rienties,et al.  Implementing a Learning Analytics Intervention and Evaluation Framework: what works? , 2017 .

[15]  References , 1971 .

[16]  Dirk T. Tempelaar,et al.  In search for the most informative data for feedback generation: Learning analytics in a data-rich context , 2015, Comput. Hum. Behav..

[17]  Carol Calvert,et al.  Developing a model and applications for probabilities of student success: a case study of predictive analytics , 2014 .

[18]  Marek Hatala,et al.  A qualitative evaluation of evolution of a learning analytics tool , 2012, Comput. Educ..

[19]  Dennis Zielke,et al.  Design and Implementation of a Learning Analytics Toolkit for Teachers , 2012, J. Educ. Technol. Soc..

[20]  Barbara Wasson,et al.  Editorial: Learning design, teacher inquiry into student learning and learning analytics: A call for action , 2015, Br. J. Educ. Technol..

[21]  D. Torgerson,et al.  Designing randomised trials in health, education and the social sciences : an introduction , 2008 .

[22]  Hendrik Drachsler,et al.  Translating Learning into Numbers: A Generic Framework for Learning Analytics , 2012, J. Educ. Technol. Soc..