Generating actionable predictive models of academic performance

The pervasive collection of data has opened the possibility for educational institutions to use analytics methods to improve the quality of the student experience. However, the adoption of these methods faces multiple challenges particularly at the course level where instructors and students would derive the most benefit from the use of analytics and predictive models. The challenge lies in the knowledge gap between how the data is captured, processed and used to derive models of student behavior, and the subsequent interpretation and the decision to deploy pedagogical actions and interventions by instructors. Simply put, the provision of learning analytics alone has not necessarily led to changing teaching practices. In order to support pedagogical change and aid interpretation, this paper proposes a model that can enable instructors to readily identify subpopulations of students to provide specific support actions. The approach was applied to a first year course with a large number of students. The resulting model classifies students according to their predicted exam scores, based on indicators directly derived from the learning design.

[1]  George Siemens,et al.  Current state and future trends: a citation network analysis of the learning analytics field , 2014, LAK.

[2]  Arthur C. Graesser,et al.  Better to be frustrated than bored: The incidence, persistence, and impact of learners' cognitive-affective states during interactions with three different computer-based learning environments , 2010, Int. J. Hum. Comput. Stud..

[3]  Ian Witten,et al.  Data Mining , 2000 .

[4]  Matthew D. Pistilli,et al.  Course signals at Purdue: using learning analytics to increase student success , 2012, LAK.

[5]  P. Winne,et al.  Feedback and Self-Regulated Learning: A Theoretical Synthesis , 1995 .

[6]  Abhijit Ghatak,et al.  Machine Learning with R , 2017, Springer Singapore.

[7]  George Siemens,et al.  Let’s not forget: Learning analytics are about learning , 2015 .

[8]  Carl E Wieman,et al.  Large-scale comparison of science teaching methods sends clear message , 2014, Proceedings of the National Academy of Sciences.

[9]  Abigail Selzer King,et al.  Using Signals for appropriate feedback: Perceptions and practices , 2011, Comput. Educ..

[10]  Alyssa Friend Wise,et al.  Designing pedagogical interventions to support student use of learning analytics , 2014, LAK.

[11]  Mike Sharkey,et al.  Course correction: using analytics to predict course success , 2012, LAK '12.

[12]  Jeffrey W. Alstete,et al.  Performance indicators in online distance learning courses: a study of management education , 2004 .

[13]  John Hattie,et al.  Assessment and Classroom Learning: a deductive approach , 1998 .

[14]  Sebastián Ventura,et al.  Predicting students' final performance from participation in on-line discussion forums , 2013, Comput. Educ..

[15]  Michelle K. Smith,et al.  Active learning increases student performance in science, engineering, and mathematics , 2014, Proceedings of the National Academy of Sciences.

[16]  Jody Clarke,et al.  Comparing Novice and Experienced Students in Virtual Performance Assessments , 2015, EDM.

[17]  Eitel J. M. Lauría,et al.  Early Alert of Academically At-Risk Students: An Open Source Analytics Initiative , 2014, J. Learn. Anal..

[18]  Miguel Ángel Conde González,et al.  Can we predict success from log data in VLEs? Classification of interactions for learning analytics and their relation with performance in VLE-supported F2F and online learning , 2014, Comput. Hum. Behav..

[19]  Dragan Gasevic,et al.  Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success , 2016, Internet High. Educ..

[20]  Sebastián Ventura,et al.  Data mining in course management systems: Moodle case study and tutorial , 2008, Comput. Educ..

[21]  TanesZeynep,et al.  Using Signals for appropriate feedback , 2011 .

[22]  Marek Hatala,et al.  Analytics of communities of inquiry: Effects of learning technology use on cognitive presence in asynchronous online discussions , 2015, Internet High. Educ..

[23]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.