Data-Driven Learner Profiling Based on Clustering Student Behaviors: Learning Consistency, Pace and Effort

While it is important to individualize instruction, identifying and implementing the right intervention for individual students is too time-consuming for instructors to do manually in large classes. One approach to addressing this challenge is to identify groups of students who would benefit from the same intervention. As such, this work attempts to identify groups of students with similar academic and behavior characteristics who can benefit from the same intervention. In this paper, we study a group of 700 students who have been using ALEKS, a Web-based, adaptive assessment and learning system. We group these students into a set of clusters using six key characteristics, using their data from the first half of the semester, including their prior knowledge, number of assessments, average days and score increase between assessments, and how long after the start of the class the student begins to use ALEKS. We used mean-shift clustering to select a number of clusters, and k-mean clustering to identify distinct student profiles. Using this approach, we identified five distinct profiles within these students. We then analyze whether these profiles differ in terms of students’ eventual degree of content mastery. These profiles have the potential to enable institutions and instructors using ALEKS to identify students in need and devise and implement appropriate interventions for groups of students with similar characteristics and needs.

[1]  Ma. Mercedes T. Rodrigoa,et al.  Use of Unsupervised Clustering to Characterize Learner Behaviors and Affective States while Using an Intelligent Tutoring System , 2008 .

[2]  Jean-Claude Falmagne,et al.  The Assessment of Knowledge, in Theory and in Practice , 2006, ICFCA.

[3]  Rebecca Ferguson,et al.  Examining engagement: analysing learner subpopulations in massive open online courses (MOOCs) , 2015, LAK.

[4]  Angela L. Duckworth,et al.  Grit: perseverance and passion for long-term goals. , 2007, Journal of personality and social psychology.

[5]  Jason M. Harley,et al.  Clustering and Profiling Students According to their Interactions with an Intelligent Tutoring System Fostering Self-Regulated Learning , 2013, EDM 2013.

[6]  Cristina Conati,et al.  Combining Unsupervised and Supervised Classification to Build User Models for Exploratory , 2009, EDM 2009.

[7]  Lei Qu,et al.  Classifying Learner Engagement through Integration of Multiple Data Sources , 2006, AAAI.

[8]  C. Dweck,et al.  Mind-Set Interventions Are a Scalable Treatment for Academic Underachievement , 2015, Psychological science.

[9]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[10]  Matthew D. Pistilli,et al.  Course signals at Purdue: using learning analytics to increase student success , 2012, LAK.

[11]  Geoffrey L. Cohen,et al.  Instructional interventions that motivate classroom learning. , 2016 .

[12]  Arthur C. Graesser,et al.  The impact of a technology-based mathematics after-school program using ALEKS on student's knowledge and behaviors , 2013, Comput. Educ..