Clustering and Profiling Students According to their Interactions with an Intelligent Tutoring System Fostering Self-Regulated Learning

In this paper, we present the results obtained using a clustering algorithm (Expectation-Maximization) on data collected from 106 college students learning about the circulatory system with MetaTutor, an agent-based Intelligent Tutoring System (ITS) designed to foster self-regulated learning (SRL). The three extracted clusters were validated and analyzed using multivariate statistics (MANOVAs) in order to characterize three distinct profiles of students, displaying statistically significant differences over all 12 variables used for the clusters formation (including performance, use of note-taking and number of sub-goals attempted). We show through additional analyses that variations also exist between the clusters regarding prompts they received by the system to perform SRL processes. We conclude with a discussion of implications for designing a more adaptive ITS based on an identification of learners’ profiles.

[1]  Arthur C. Graesser,et al.  A Time for Emoting: When Affect-Sensitivity Is and Isn't Effective at Promoting Deep Learning , 2010, Intelligent Tutoring Systems.

[2]  C. Manikandan,et al.  Collaborative E-Learning for Remote Education; An Approach For Realizing Pervasive Learning Environments , 2006, 2006 International Conference on Information and Automation.

[3]  Jason M. Harley,et al.  Examining Learners' Emotional Responses to Virtual Pedagogical Agents' Tutoring Strategies , 2011, IVA.

[4]  Albert T. Corbett,et al.  A Bayes Net Toolkit for Student Modeling in Intelligent Tutoring Systems , 2006, Intelligent Tutoring Systems.

[5]  B. Tabachnick,et al.  Using multivariate statistics, 5th ed. , 2007 .

[6]  Qinghua Zheng,et al.  Research on e-learner personality grouping based on fuzzy clustering analysis , 2008, 2008 12th International Conference on Computer Supported Cooperative Work in Design.

[7]  Gahangir Hossain,et al.  The Effectiveness of Pedagogical Agents' Prompting and Feedback in Facilitating Co-adapted Learning with MetaTutor , 2012, ITS.

[8]  Gautam Biswas,et al.  Modeling and Measuring Self-Regulated Learning in Teachable Agent Environments , 2010, AAAI Fall Symposium: Cognitive and Metacognitive Educational Systems.

[9]  John C. Nesbit,et al.  Supporting Self-Regulated Learning with Cognitive Tools , 2009 .

[10]  Gautam Biswas,et al.  Measuring Self-Regulated Learning Skills through Social Interactions in a teachable Agent Environment , 2010, Res. Pract. Technol. Enhanc. Learn..

[11]  Daniel C. Moos,et al.  Measuring Cognitive and Metacognitive Regulatory Processes During Hypermedia Learning: Issues and Challenges , 2010 .

[12]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[13]  V. Shute,et al.  Adaptive Technologies for Training and Education: Adaptive Educational Systems , 2012 .

[14]  James C. Lester,et al.  Modelling affect expression and recognition in an interactive learning environment , 2009, Int. J. Learn. Technol..

[15]  A. Graesser,et al.  Dynamics of affective states during complex learning , 2012 .

[16]  Allan Collins,et al.  The Interplay of Scientific Inquiry and Metacognition , 2009 .

[17]  Roger Azevedo,et al.  Adaptive Content and Process Scaffolding: A key to facilitating students' self-regulated learning with hypermedia , 2011 .

[18]  S. Järvelä,et al.  Self-Regulated, Co-Regulated, and Socially Shared Regulation of Learning , 2011 .

[19]  Beverly Park Woolf,et al.  Building Intelligent Interactive Tutors: Student-centered Strategies for Revolutionizing E-learning , 2008 .

[20]  Jia-Sheng Heh,et al.  Analyzing User Behavior Distribution on E-Learning Platform with Techniques of Clustering , 2004 .

[21]  Gautam Biswas,et al.  Identifying Students' Characteristic Learning Behaviors in an Intelligent Tutoring System Fostering Self-Regulated Learning , 2012, EDM.

[22]  Cristina Conati,et al.  Unsupervised and supervised machine learning in user modeling for intelligent learning environments , 2007, IUI '07.

[23]  Beverly Park Woolf,et al.  Improving Intelligent Tutoring Systems: Using Expectation Maximization to Learn Student Skill Levels , 2006, Intelligent Tutoring Systems.

[24]  K. Koedinger,et al.  Automated, Unobtrusive, Action-by-Action Assessment of Self-Regulation During Learning With an Intelligent Tutoring System , 2010 .

[25]  Matthew Crosby,et al.  Association for the Advancement of Artificial Intelligence , 2014 .

[26]  Beverly Park Woolf,et al.  Inferring Unobservable Learning Variables from Students' Help Seeking Behavior , 2004, Intelligent Tutoring Systems.

[27]  Danuta Zakrzewska,et al.  Using Clustering Technique for Students' Grouping in Intelligent E-Learning Systems , 2008, USAB.

[28]  Susan M. Land,et al.  Metacognition and Self-Regulated Learning in Student-Centered Learning Environments , 2012 .

[29]  V. Aleven,et al.  International Handbook of Metacognition and Learning Technologies , 2013 .

[30]  Ryan S. Baker,et al.  The State of Educational Data Mining in 2009: A Review and Future Visions. , 2009, EDM 2009.

[31]  Castro Espinoza,et al.  Clustering Educational Data , 2010 .

[32]  Candice Burkett,et al.  The Role of Prompting and Feedback in Facilitating Students' Learning about Science with MetaTutor , 2010, AAAI Fall Symposium: Cognitive and Metacognitive Educational Systems.

[33]  Ma. Mercedes T. Rodrigoa,et al.  Use of Unsupervised Clustering to Characterize Learner Behaviors and Affective States while Using an Intelligent Tutoring System , 2008 .

[34]  Àngela Nebot,et al.  Characterization of atypical virtual campus usage behavior through robust generative relevance analysis , 2006 .

[35]  Gautam Biswas,et al.  Designing Learning by Teaching Agents: The Betty's Brain System , 2008, Int. J. Artif. Intell. Educ..

[36]  Philip H. Winne,et al.  The weave of motivation and self-regulated learning. , 2008 .

[37]  Elena Gaudioso,et al.  Mining Student Data To Characterize Similar Behavior Groups In Unstructured Collaboration Spaces , 2004 .

[38]  Neil T. Heffernan,et al.  Detecting Learning Moment-by-Moment , 2011, Int. J. Artif. Intell. Educ..

[39]  Philip H. Winne,et al.  Studying as self-regulated learning. , 1998 .

[40]  Arthur C. Graesser,et al.  Self-Regulated Learning in Learning Environments With Pedagogical Agents That Interact in Natural Language , 2010 .

[41]  K. VanLehn.  The Relative Effectiveness of Human Tutoring, Intelligent Tutoring Systems, and Other Tutoring Systems , 2011 .

[42]  Douglas J. Hacker,et al.  Handbook of Metacognition in Education , 2009 .