A review of recent advances in learner and skill modeling in intelligent learning environments

In recent years, learner models have emerged from the research laboratory and research classrooms into the wider world. Learner models are now embedded in real world applications which can claim to have thousands, or even hundreds of thousands, of users. Probabilistic models for skill assessment are playing a key role in these advanced learning environments. In this paper, we review the learner models that have played the largest roles in the success of these learning environments, and also the latest advances in the modeling and assessment of learner skills. We conclude by discussing related advancements in modeling other key constructs such as learner motivation, emotional and attentional state, meta-cognition and self-regulated learning, group learning, and the recent movement towards open and shared learner models.

[1]  Jean-Claude Falmagne,et al.  Spaces for the Assessment of Knowledge , 1985, Int. J. Man Mach. Stud..

[2]  J. Templin,et al.  Skills Diagnosis Using IRT-Based Latent Class Models , 2007 .

[3]  Norm Friesen,et al.  Interoperability and Learning Objects: An Overview of E-Learning Standardization , 2005 .

[4]  Dietrich Albert,et al.  RATH - A Relational Adaptive Tutoring Hypertext WWW-Environment Based on Knowledge Space Theory , 1997 .

[5]  Peter Dolog,et al.  A Framework for Browsing, Manipulating and Maintaining Interoperable Learner Profiles , 2005, User Modeling.

[6]  Ingo Mierswa,et al.  YALE: rapid prototyping for complex data mining tasks , 2006, KDD '06.

[7]  Zachary A. Pardos,et al.  Modeling Individualization in a Bayesian Networks Implementation of Knowledge Tracing , 2010, UMAP.

[8]  Lars Schmidt-Thieme,et al.  Factorization Models for Forecasting Student Performance , 2011, EDM.

[9]  Albert T. Corbett,et al.  The Knowledge-Learning-Instruction Framework: Bridging the Science-Practice Chasm to Enhance Robust Student Learning , 2012, Cogn. Sci..

[10]  Joseph E. Beck,et al.  Engagement tracing: using response times to model student disengagement , 2005, AIED.

[11]  Chao-Lin Liu,et al.  A Simulation-Based Experience in Learning Structures of Bayesian Networks to Represent How Students Learn Composite Concepts , 2008, Int. J. Artif. Intell. Educ..

[12]  Kenneth R. Koedinger,et al.  User modeling: a notoriously black art , 2011, UMAP'11.

[13]  Cristina Conati,et al.  Empirically building and evaluating a probabilistic model of user affect , 2009, User Modeling and User-Adapted Interaction.

[14]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[15]  Vania Dimitrova,et al.  STyLE-OLM: Interactive Open Learner Modelling , 2003, Int. J. Artif. Intell. Educ..

[16]  Anthony Jameson,et al.  Numerical uncertainty management in user and student modeling: An overview of systems and issues , 2005, User Modeling and User-Adapted Interaction.

[17]  Ricardo Conejo,et al.  SIETTE: A Web-Based Tool for Adaptive Testing , 2004, Int. J. Artif. Intell. Educ..

[18]  Rosalind W. Picard,et al.  Automated Posture Analysis for Detecting Learner's Interest Level , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[19]  Mark D. Reckase,et al.  The Discriminating Power of Items That Measure More Than One Dimension , 1991 .

[20]  José-Luis Pérez-de-la-Cruz,et al.  A Bayesian Diagnostic Algorithm for Student Modeling and its Evaluation , 2002, User Modeling and User-Adapted Interaction.

[21]  Frank B. Baker,et al.  Item Response Theory : Parameter Estimation Techniques, Second Edition , 2004 .

[22]  Gord McCalla,et al.  The Ecological Approach to the Design of E-Learning Environments: Purpose-based Capture and Use of Information About Learners , 2004 .

[23]  B. Bloom The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring , 1984 .

[24]  Lora Aroyo,et al.  Interoperability in Personalized Adaptive Learning , 2006, J. Educ. Technol. Soc..

[25]  Beverly Park Woolf,et al.  A Dynamic Mixture Model to Detect Student Motivation and Proficiency , 2006, AAAI.

[26]  Colin Tattersall,et al.  A design model for lifelong learning networks , 2005, Interact. Learn. Environ..

[27]  Kenneth R. Koedinger,et al.  Learning Factors Transfer Analysis: Using Learning Curve Analysis to Automatically Generate Domain Models , 2009, EDM.

[28]  Anne McDougall,et al.  Mainstreaming AIED into Education , 2000 .

[29]  Claude Frasson,et al.  Exploring the Relationship between Learner EEG Mental Engagement and Affect , 2010, Intelligent Tutoring Systems.

[30]  Moffat Mathews,et al.  Detecting Gaming the System in Constraint-Based Tutors , 2010, UMAP.

[31]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[32]  Richard E. Neapolitan,et al.  Learning Bayesian networks , 2007, KDD '07.

[33]  D. Cole Utility of confirmatory factor analysis in test validation research. , 1987, Journal of consulting and clinical psychology.

[34]  Cristina Conati,et al.  Using Bayesian Networks to Manage Uncertainty in Student Modeling , 2002, User Modeling and User-Adapted Interaction.

[35]  Russell G. Almond,et al.  Graphical Models and Computerized Adaptive Testing , 1999 .

[36]  Zachary A. Pardos,et al.  KT-IDEM: introducing item difficulty to the knowledge tracing model , 2011, UMAP'11.

[37]  Jean-Claude Falmagne,et al.  The Assessment of Knowledge, in Theory and in Practice , 2006, ICFCA.

[38]  Beverly Park Woolf,et al.  Building Intelligent Interactive Tutors: Student-centered Strategies for Revolutionizing E-learning , 2008 .

[39]  Carolyn Penstein Rosé,et al.  Detecting and Understanding the Impact of Cognitive and Interpersonal Conflict in Computer Supported Collaborative Learning Environments , 2009, EDM.

[40]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[41]  Ryan Shaun Joazeiro de Baker,et al.  Identifying Students' Inquiry Planning Using Machine Learning , 2010, EDM.

[42]  Albert T. Corbett,et al.  The Knowledge-Learning-Instruction (KLI) Framework: Toward Bridging the Science-Practice Chasm to Enhance Robust Student Learning , 2010 .

[43]  Ryan Shaun Joazeiro de Baker,et al.  Modeling and understanding students' off-task behavior in intelligent tutoring systems , 2007, CHI.

[44]  Zachary A. Pardos,et al.  Navigating the parameter space of Bayesian Knowledge Tracing models: Visualizations of the convergence of the Expectation Maximization algorithm , 2010, EDM.

[45]  B. Efron,et al.  A Leisurely Look at the Bootstrap, the Jackknife, and , 1983 .

[46]  Kurt VanLehn,et al.  The Andes Physics Tutoring System: Lessons Learned , 2005, Int. J. Artif. Intell. Educ..

[47]  Jiming Liu,et al.  User-expertise modeling with empirically derived probabilistic implication networks , 2005, User Modeling and User-Adapted Interaction.

[48]  Kenneth R. Koedinger,et al.  Learning Factors Analysis - A General Method for Cognitive Model Evaluation and Improvement , 2006, Intelligent Tutoring Systems.

[49]  Peter Dolog,et al.  Learner profile management for collaborating adaptive eLearning applications , 2006, APS '06.

[50]  Lars Schmidt-Thieme,et al.  Personalized Forecasting Student Performance , 2011, 2011 IEEE 11th International Conference on Advanced Learning Technologies.

[51]  Vincent Aleven,et al.  Can Help Seeking Be Tutored? Searching for the Secret Sauce of Metacognitive Tutoring , 2007, AIED.

[52]  Antonija Mitrovic,et al.  A Comparative Analysis of Cognitive Tutoring and Constraint-Based Modeling , 2003, User Modeling.

[53]  Albert T. Corbett,et al.  Does Help Help? Introducing the Bayesian Evaluation and Assessment Methodology , 2008, Intelligent Tutoring Systems.

[54]  P. Ekman,et al.  DIFFERENCES Universals and Cultural Differences in the Judgments of Facial Expressions of Emotion , 2004 .

[55]  Barbara Di Eugenio,et al.  Squibs and Discussions: The Kappa Statistic: A Second Look , 2004, CL.

[56]  Kasia Muldner,et al.  An Analysis of Gaming Behaviors in an Intelligent Tutoring System , 2010, Intelligent Tutoring Systems.

[57]  Julita Vassileva Dynamic Courseware Generation: at the Cross Point of CAL, ITS and Authoring , 1995 .

[58]  Beverly Park Woolf,et al.  Repairing Disengagement With Non-Invasive Interventions , 2007, AIED.

[59]  Judy Kay,et al.  Student Models that Invite the Learner In: The SMILI: () Open Learner Modelling Framework , 2007, Int. J. Artif. Intell. Educ..

[60]  Judy Kay,et al.  Clustering and Sequential Pattern Mining of Online Collaborative Learning Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[61]  Marek Hatala,et al.  The interoperability of learning object repositories and services: standards, implementations and lessons learned , 2004, WWW Alt. '04.

[62]  K. Tatsuoka RULE SPACE: AN APPROACH FOR DEALING WITH MISCONCEPTIONS BASED ON ITEM RESPONSE THEORY , 1983 .

[63]  Ricardo Conejo,et al.  Introducing Prerequisite Relations in a Multi-layered Bayesian Student Model , 2005, User Modeling.

[64]  Douglas J. Hacker Definitions and Empirical Foundations , 1998 .

[65]  Kasia Muldner,et al.  Emotion Sensors Go To School , 2009, AIED.

[66]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[67]  Russell G. Almond,et al.  Modeling Diagnostic Assessments with Bayesian Networks , 2007 .

[68]  Dietrich Albert,et al.  Competence-based Knowledge Structures for Personalised Learning , 2005, ELeGI Conference.

[69]  Russell G. Almond,et al.  Bayes Nets in Educational Assessment: Where the Numbers Come From , 1999, UAI.

[70]  H. Pain,et al.  ' Did I say what I think I said , and do you agree with me ? ' : Inspecting and Questioning the Student Model , 1995 .

[71]  Neil T. Heffernan,et al.  Using multiple Dirichlet distributions to improve parameter plausibility , 2010, EDM.

[72]  Neil T. Heffernan,et al.  Addressing the testing challenge with a web-based e-assessment system that tutors as it assesses , 2006, WWW '06.

[73]  Julita Vassileva,et al.  Multi-Agent Multi-User Modeling in I-Help , 2003, User Modeling and User-Adapted Interaction.

[74]  Alfred Kobsa User Modeling and User-Adapted Interaction , 2005, User Modeling and User-Adapted Interaction.

[75]  Gordon I. McCalla,et al.  Using Planning Techniques in Intelligent Tutoring Systems , 1986, Int. J. Man Mach. Stud..

[76]  B. Junker,et al.  Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response Theory , 2001 .

[77]  Luo Si,et al.  Learning to Identify Students' Off-Task Behavior in Intelligent Tutoring Systems , 2009, AIED.

[78]  Jean-Claude Falmagne,et al.  Knowledge spaces , 1998 .

[79]  Julita Vassileva,et al.  Course sequencing techniques for large-scale web-based education , 2003 .

[80]  Yanbo Xu,et al.  Using Logistic Regression to Trace Multiple Sub-skills in a Dynamic Bayes Net , 2011, EDM.

[81]  Ryan Shaun Joazeiro de Baker,et al.  Developing a generalizable detector of when students game the system , 2008, User Modeling and User-Adapted Interaction.

[82]  Ricardo Conejo,et al.  Adaptive testing for hierarchical student models , 2007, User Modeling and User-Adapted Interaction.

[83]  M. Lepper,et al.  Motivational techniques of expert human tutors: Lessons for the design of computer-based tutors. , 1993 .

[84]  Arthur C. Graesser,et al.  Automatic detection of learner’s affect from conversational cues , 2008, User Modeling and User-Adapted Interaction.

[85]  Peter Brusilovsky,et al.  Ontology-based Framework for User Model Interoperability in Distributed Learning Environments , 2005 .

[86]  Jirí Vomlel,et al.  Bayesian Networks In Educational Testing , 2002, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[87]  Vincent Aleven,et al.  More Accurate Student Modeling through Contextual Estimation of Slip and Guess Probabilities in Bayesian Knowledge Tracing , 2008, Intelligent Tutoring Systems.

[88]  Michel C. Desmarais,et al.  Learned student models with item to item knowledge structures , 2006, User Modeling and User-Adapted Interaction.

[89]  Chao-Lin Liu,et al.  Selecting Baysian-Network Models Based on Simulated Expectation , 2009 .

[90]  F. Baker,et al.  Item response theory : parameter estimation techniques , 1993 .

[91]  Diane J. Litman,et al.  Predicting Emotion in Spoken Dialogue from Multiple Knowledge Sources , 2004, NAACL.

[92]  Lei Qu,et al.  Classifying Learner Engagement through Integration of Multiple Data Sources , 2006, AAAI.

[93]  Robert J. Mislevy,et al.  The Role of Probability-Based Inference in an Intelligent Tutoring System. , 1995 .

[94]  A. Raftery Bayesian Model Selection in Social Research , 1995 .

[95]  Vincent Aleven,et al.  Improving Contextual Models of Guessing and Slipping with a Trucated Training Set , 2008, EDM.

[96]  Gautam Biswas,et al.  Measuring Self-Regulated Learning Skills through Social Interactions in a teachable Agent Environment , 2010, Res. Pract. Technol. Enhanc. Learn..

[97]  Ryan Shaun Joazeiro de Baker,et al.  Off-task behavior in the cognitive tutor classroom: when students "game the system" , 2004, CHI.

[98]  Gordon I. McCalla,et al.  A Computational Framework for Granularity and its Application to Educational Diagnosis , 1989, IJCAI.

[99]  Russell G. Almond,et al.  Models for Conditional Probability Tables in Educational Assessment , 2001, AISTATS.

[100]  Antonija Mitrovic,et al.  Optimising ITS Behaviour with Bayesian Networks and Decision Theory , 2001 .

[101]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[102]  Susanne P. Lajoie Extending the Scaffolding Metaphor , 2005 .

[103]  Ivo Düntsch,et al.  Skills and knowledge structures , 1995 .

[104]  Derek C. Briggs,et al.  An introduction to multidimensional measurement using Rasch models. , 2003, Journal of applied measurement.

[105]  L. Vygotsky Mind in Society: The Development of Higher Psychological Processes: Harvard University Press , 1978 .

[106]  Tobias Ley,et al.  A methodology for eliciting, modelling, and evaluating expert knowledge for an adaptive work-integrated learning system , 2010, Int. J. Hum. Comput. Stud..

[107]  Cristina Conati,et al.  A Study on Using Biometric Sensors for Monitoring User Emotions in Educational Games , 2003 .

[108]  Dietrich Albert,et al.  Individualized Skill Assessment in Digital Learning Games: Basic Definitions and Mathematical Formalism , 2011, IEEE Transactions on Learning Technologies.

[109]  Kenneth R. Koedinger,et al.  Performance Factors Analysis - A New Alternative to Knowledge Tracing , 2009, AIED.

[110]  Ryan Shaun Joazeiro de Baker,et al.  Case studies in the use of ROC curve analysis for sensor-based estimates in human computer interaction , 2005, Graphics Interface.

[111]  Carolyn Penstein Rosé,et al.  Tutorial Dialogue as Adaptive Collaborative Learning Support , 2007, AIED.

[112]  Judy Kay,et al.  Open Learner Models , 2010, Advances in Intelligent Tutoring Systems.

[113]  Helen Pain,et al.  Informing the Detection of the Students' Motivational State: An Empirical Study , 2002, Intelligent Tutoring Systems.

[114]  Vincent Aleven,et al.  Toward Meta-cognitive Tutoring: A Model of Help Seeking with a Cognitive Tutor , 2006, Int. J. Artif. Intell. Educ..

[115]  Chen-Lin C. Kulik,et al.  Educational Outcomes of Tutoring: A Meta-analysis of Findings , 1982 .

[116]  Ryan Shaun Joazeiro de Baker,et al.  Adapting to When Students Game an Intelligent Tutoring System , 2006, Intelligent Tutoring Systems.

[117]  Peter Brusilovsky,et al.  Adaptive and Intelligent Web-based Educational Systems , 2003, Int. J. Artif. Intell. Educ..

[118]  Michel C. Desmarais Performance comparison of item-to-item skills models with the IRT single latent trait model , 2011, UMAP'11.

[119]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[120]  John Self Bypassing the intractable problem of student modelling , 1988 .

[121]  Muhammad Naveed Khalid IRT model fit from different perspectives , 2009 .

[122]  Neil T. Heffernan,et al.  Detection and Analysis of Off-Task Gaming Behavior in Intelligent Tutoring Systems , 2006, Intelligent Tutoring Systems.

[123]  Edward H. Haertel Using restricted latent class models to map the skill structure of achievement items , 1989 .

[124]  Michael Villano,et al.  Probabilistic Student Models: Bayesian Belief Networks and Knowledge Space Theory , 1992, Intelligent Tutoring Systems.

[125]  Antonija Mitrovic,et al.  Fifteen years of constraint-based tutors: what we have achieved and where we are going , 2011, User Modeling and User-Adapted Interaction.

[126]  Ryan Shaun Joazeiro de Baker,et al.  Labeling Student Behavior Faster and More Precisely with Text Replays , 2008, EDM.

[127]  Kenneth R. Koedinger,et al.  Using Problem-Solving Context to Assess Help Quality in Computer-Mediated Peer Tutoring , 2010, Intelligent Tutoring Systems.

[128]  Peter Brusilovsky,et al.  Adaptive Hypermedia , 2001, User Modeling and User-Adapted Interaction.

[129]  Jacqueline Bourdeau,et al.  Advances in Intelligent Tutoring Systems , 2010 .

[130]  R. Adams Proceedings , 1947 .

[131]  VanlehnKurt,et al.  The Andes Physics Tutoring System: Lessons Learned , 2005 .

[132]  Rosemary Luckin,et al.  Motivating the Learner: An Empirical Evaluation , 2006, Intelligent Tutoring Systems.

[133]  A. Graesser,et al.  Monitoring Affective Trajectories during Complex Learning , 2007 .

[134]  Jim Reye,et al.  Student Modelling Based on Belief Networks , 2004, Int. J. Artif. Intell. Educ..

[135]  J. Greer,et al.  Granularity Hierarchies , 1992 .

[136]  William Stout,et al.  Skills Diagnosis Using IRT‐Based Continuous Latent Trait Models , 2007 .

[137]  Kurt VanLehn,et al.  Student Modeling from Conversational Test Data: A Bayesian Approach Without Priors , 1998, Intelligent Tutoring Systems.

[138]  Jim E. Greer,et al.  Inspectable Bayesian student modelling servers in multi-agent tutoring systems , 2004, Int. J. Hum. Comput. Stud..

[139]  Judy Kay,et al.  The Big Five and Visualisations of Team Work Activity , 2006, Intelligent Tutoring Systems.

[140]  Susan Bull,et al.  Student Preferences for Editing, Persuading, and Negotiating the Open Learner Model , 2006, Intelligent Tutoring Systems.

[141]  Kenneth R. Koedinger,et al.  A Response Time Model For Bottom-Out Hints as Worked Examples , 2008, EDM.