Activity sequence modelling and dynamic clustering for personalized e-learning

Monitoring and interpreting sequential learner activities has the potential to improve adaptivity and personalization within educational environments. We present an approach based on the modeling of learners’ problem solving activity sequences, and on the use of the models in targeted, and ultimately automated clustering, resulting in the discovery of new, semantically meaningful information about the learners. The approach is applicable at different levels: to detect pre-defined, well-established problem solving styles, to identify problem solving styles by analyzing learner behaviour along known learning dimensions, and to semi-automatically discover learning dimensions and concrete problem solving patterns. This article describes the approach itself, demonstrates the feasibility of applying it on real-world data, and discusses aspects of the approach that can be adjusted for different learning contexts. Finally, we address the incorporation of the proposed approach in the adaptation cycle, from data acquisition to adaptive system interventions in the interaction process.

[1]  Yoshua Bengio,et al.  Input-output HMMs for sequence processing , 1996, IEEE Trans. Neural Networks.

[2]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[3]  V. Günther Psychologie des Lernens , 1995 .

[4]  Thomas G. Dietterich Machine Learning for Sequential Data: A Review , 2002, SSPR/SPR.

[5]  K. Koedinger,et al.  Exploring the Assistance Dilemma in Experiments with Cognitive Tutors , 2007 .

[6]  Thomas G. Dietterich,et al.  Constructing High-Accuracy Letter-to-Phoneme Rules with Machine Learning , 2001 .

[7]  Sebastián Ventura,et al.  Data mining in course management systems: Moodle case study and tutorial , 2008, Comput. Educ..

[8]  Kenneth R. Koedinger,et al.  A Data Repository for the EDM Community: The PSLC DataShop , 2010 .

[9]  Kenneth R. Koedinger,et al.  CTRL: A research framework for providing adaptive collaborative learning support , 2009, User Modeling and User-Adapted Interaction.

[10]  Yuliang Liu,et al.  Cognitive Styles and Distance Education. , 1999 .

[11]  Ryan Shaun Joazeiro de Baker,et al.  Adapting to When Students Game an Intelligent Tutoring System , 2006, Intelligent Tutoring Systems.

[12]  C. Myers Educational Psychology , 1904, Nature.

[13]  T. Sejnowski,et al.  Predicting the secondary structure of globular proteins using neural network models. , 1988, Journal of molecular biology.

[14]  Charles F. Hockett,et al.  A mathematical theory of communication , 1948, MOCO.

[15]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[16]  César Hervás-Martínez,et al.  Data Mining Algorithms to Classify Students , 2008, EDM.

[17]  Genevieve Pinto-Zipp,et al.  Students' Learning Styles and Their Preferences for Online Instructional Methods , 2005 .

[18]  Cen Li,et al.  Modeling student online learning using clustering , 2006, ACM-SE 44.

[19]  Yann LeCun,et al.  Graph transformer networks for image recognition , 2005 .

[20]  S. Anderson,et al.  Social Competency in Young Children. , 1974 .

[21]  Dana E. Sims,et al.  Is there a “Big Five” in Teamwork? , 2005 .

[22]  R. Felder,et al.  Understanding Student Differences , 2005 .

[23]  Nathan Griffiths,et al.  Incorporating Learning Styles in a Computer-Supported Collaborative Learning Model , 2008 .

[24]  Tony Fisher,et al.  Real users, real results: examining the limitations of learning styles within AEH , 2007, SIGWEB Newsl..

[25]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[26]  Kasia Muldner,et al.  An Analysis of Gaming Behaviors in an Intelligent Tutoring System , 2010, Intelligent Tutoring Systems.

[27]  T. Dewar,et al.  Online Learners and Their Learning Strategies , 2000 .

[28]  Cristina Conati,et al.  Combining Unsupervised and Supervised Classification to Build User Models for Exploratory , 2009, EDM 2009.

[29]  S. J. Simon The Relationship of Learning Style and Training Method to End-User Computer Satisfaction and Computer Use: A Structural Equation Model. , 2000 .

[30]  Osmar R. Zaïane,et al.  Combining Usage, Content, and Structure Data to Improve Web Site Recommendation , 2004, EC-Web.

[31]  Bruce M. McLaren,et al.  How Much Assistance Is Helpful to Students in Discovery Learning? , 2009, EC-TEL.

[32]  R. Newman Adaptive help seeking: A strategy of self-regulated learning. , 1994 .

[33]  Charlene M. Czerniak,et al.  Teachers Beliefs About Accommodating Students Learning Styles In Science Classes , 2001 .

[34]  Gautam Biswas,et al.  Mining Student Behavior Models in Learning-by-Teaching Environments , 2008, EDM.

[35]  Johann H. Schlichter,et al.  Adaptive Collaborative Web-Based Courses , 2003, ICWE.

[36]  Steven R. Terrell,et al.  Supporting Different Learning Styles in an Online Learning Environment: Does it Really Matter in the Long Run? , 2005 .

[37]  Jesus Boticario,et al.  A Data Mining Approach to Reveal Representative Collaboration Indicators in Open Collaboration Frameworks , 2009, EDM.

[38]  Jesus Boticario,et al.  Clustering learners according to their collaboration , 2009, 2009 13th International Conference on Computer Supported Cooperative Work in Design.

[39]  P. Dillenbourg,et al.  The evolution of research on collaborative learning , 1996 .

[40]  Hyungshin Choi,et al.  Analyzing Learner Behaviors , Conflicting and Facilitating Factors of Online Collaborative Learning using Activity System , 2008 .

[41]  Kenneth R. Koedinger,et al.  An Open Repository and analysis tools for fine-grained, longitudinal learner data , 2008, EDM.

[42]  Lei Qu,et al.  Classifying Learner Engagement through Integration of Multiple Data Sources , 2006, AAAI.

[43]  Cen Li,et al.  Adaptive teaching strategy for online learning , 2005, IUI '05.

[44]  David T. Schaller,et al.  Paper: One Size Does Not Fit All: Learning Style, Play, and On-line Interactives , 2007 .

[45]  L. Turner Key Papers in the Development of Information Theory , 1975 .

[46]  D. Dunn,et al.  Experiential Learning , 2019, High Impact Teaching for Sport and Exercise Psychology Educators.

[47]  Judy Kay,et al.  Clustering and Sequential Pattern Mining of Online Collaborative Learning Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[48]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[49]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Mirjam Köck,et al.  Towards Intelligent Adaptative E-Learning Systems - Machine Learning for Learner Activity Classification , 2009, LWA.

[51]  Tom Fawcett,et al.  Adaptive Fraud Detection , 1997, Data Mining and Knowledge Discovery.

[52]  Michael J. Baker,et al.  Favouring modellable computer-mediated argumentative dialogue in collaborative problem-solving situations , 1999 .

[53]  S. Gall,et al.  Chapter 2: Help-Seeking Behavior in Learning , 1985 .

[54]  Alexandros Paramythis Adaptive Support for Collaborative Learning with IMS Learning Design : Are We There Yet ? , 2008 .

[55]  Jesus Boticario,et al.  Content-free collaborative learning modeling using data mining , 2011, User Modeling and User-Adapted Interaction.

[56]  Alan M. Lesgold,et al.  Modeling the process of collaborative learning , 2007 .

[57]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[58]  Jaideep Srivastava,et al.  Web usage mining: discovery and applications of usage patterns from Web data , 2000, SKDD.

[59]  A. Richmond,et al.  Implementing Kolb's Learning Styles into Online Distance Education , 2005 .

[60]  S. Gall Help-seeking: An understudied problem-solving skill in children☆ , 1981 .

[61]  Alejandra Martínez-Monés,et al.  From Mirroring to Guiding: A Review of State of the Art Technology for Supporting Collaborative Learning , 2005, Int. J. Artif. Intell. Educ..

[62]  Ian Witten,et al.  Data Mining , 2000 .

[63]  Kurt VanLehn,et al.  The Andes Physics Tutoring System: Lessons Learned , 2005, Int. J. Artif. Intell. Educ..

[64]  Nicole C. Krämer,et al.  Computer-Supported Instructional Communication: A Multidisciplinary Account of Relevant Factors , 2010 .

[65]  M. Jarvis,et al.  The Psychology of Effective Learning And Teaching , 2005 .

[66]  Vincent Aleven,et al.  Toward Meta-cognitive Tutoring: A Model of Help Seeking with a Cognitive Tutor , 2006, Int. J. Artif. Intell. Educ..

[67]  Guy R. Lefrancois,et al.  Psychologie des Lernens , 1986 .

[68]  Neil T. Heffernan,et al.  To Tutor or Not to Tutor: That is the Question , 2009, AIED.

[69]  Manuela M. Veloso,et al.  Conditional random fields for activity recognition , 2007, AAMAS '07.

[70]  Andrew McCallum,et al.  Maximum Entropy Markov Models for Information Extraction and Segmentation , 2000, ICML.

[71]  E. Sutinen,et al.  Data Mining In Personalizing DistanceEducation Courses , 2006 .

[72]  Rynson W. H. Lau,et al.  Knowledge and Data Engineering for e-Learning Special Issue of IEEE Transactions on Knowledge and Data Engineering , 2008 .

[73]  Peter Brusilovsky,et al.  Social Adaptive Navigation Support for Open Corpus Electronic Textbooks , 2004, AH.

[74]  S. Cassidy,et al.  Learning Styles: An overview of theories, models, and measures , 2004 .

[75]  Johann H. Schlichter,et al.  Dynamic Generation of Adaptive Web-Based Collaborative Courses , 2003, CRIWG.

[76]  Alvaro Ortigosa,et al.  Recommendation in Higher Education Using Data Mining Techniques , 2009, EDM.

[77]  Ryan Shaun Joazeiro de Baker,et al.  Developing a generalizable detector of when students game the system , 2008, User Modeling and User-Adapted Interaction.

[78]  Amy Soller,et al.  Adaptive Support for Distributed Collaboration , 2007, The Adaptive Web.

[79]  Roni Rosenfeld,et al.  Learning Hidden Markov Model Structure for Information Extraction , 1999 .

[80]  Sebastián Ventura,et al.  Educational Data Mining: A Review of the State of the Art , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[81]  Enrique Alfonseca,et al.  The impact of learning styles on student grouping for collaborative learning: a case study , 2006, User Modeling and User-Adapted Interaction.

[82]  S. Gall,et al.  Chapter 2 Help-Seeking Behavior in Learning , 2007 .

[83]  V. Aleven,et al.  Help Seeking and Help Design in Interactive Learning Environments , 2003 .

[84]  Yoshua Bengio,et al.  Global training of document processing systems using graph transformer networks , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[85]  Paul R. Cohen,et al.  Modeling learning patterns of students with a tutoring system using Hidden Markov Models , 2007, AIED.

[86]  Ryan S. Baker,et al.  The State of Educational Data Mining in 2009: A Review and Future Visions. , 2009, EDM 2009.

[87]  Mordechai Ben-Ari,et al.  Constructivism in computer science education , 1998, SIGCSE '98.

[88]  Nitesh V. Chawla,et al.  Applying Learning Algorithms to Music Generation , 2009, IICAI.

[89]  Carol Midgley,et al.  Avoiding Seeking Help in the Classroom: Who and Why? , 2001 .

[90]  J. Piaget The construction of reality in the child , 1954 .

[91]  Sebastián Ventura,et al.  Data Mining in E-learning , 2006 .

[92]  Shian-Shyong Tseng,et al.  A personalized learning content adaptation mechanism to meet diverse user needs in mobile learning environments , 2011, User Modeling and User-Adapted Interaction.

[93]  Terrence J. Sejnowski,et al.  Parallel Networks that Learn to Pronounce English Text , 1987, Complex Syst..

[94]  R. Felder,et al.  Learning and Teaching Styles in Engineering Education. , 1988 .

[95]  Cristina Conati,et al.  Automatic Recognition of Learner Groups in Exploratory Learning Environments , 2006, Intelligent Tutoring Systems.