Probabilistic Student Modelling to Improve Exploratory Behaviour

This paper presents the details of a student model that enables an open learning environment to provide tailored feedback on a learner's exploration. Open learning environments have been shown to be beneficial for learners with appropriate learning styles and characteristics, but problematic for those who are not able to explore effectively. To address this problem, we have built a student model capable of detecting when the learner is having difficulty exploring and of providing the types of assessments that the environment needs to guide and improve the learner's exploration of the available material. The model, which uses Bayesian Networks, was built using an iterative design and evaluation process. We describe the details of this process, as it was used to both define the structure of the model and to provide its initial validation.

[1]  Cristina Conati,et al.  Providing adaptive support to the understanding of instructional material , 2001, IUI '01.

[2]  Ton de Jong,et al.  Supporting hypothesis generation by learners exploring an interactive computer simulation , 1991 .

[3]  Aaron D'Souza,et al.  An Automated Lab Instructor for Simulated Science Experiments , 2001 .

[4]  Ton de Jong,et al.  Scientific Discovery Learning with Computer Simulations of Conceptual Domains , 1998 .

[5]  B. Reiser,et al.  Cognitive and Motivational Consequences of Tutoring and Discovery Learning , 1998 .

[6]  Andrea Bunt.  On creating a student model to assess effective exploratory behaviour in an open learning environment , 2001 .

[7]  Cristina Conati,et al.  Toward Computer-Based Support of Meta-Cognitive Skills: a Computational Framework to Coach Self-Explanation , 2000 .

[8]  Joel D. Martin,et al.  J. Evaluation on an assessment system based on Bayesian student modeling , 1997 .

[9]  Eric Horvitz,et al.  Harnessing Models of Users' Goals to Mediate Clarification Dialog in Spoken Language Systems , 2001, User Modeling.

[10]  Kasia Muldner,et al.  ON IMPROVING THE EFFECTIVENESS OF OPEN LEARNING ENVIRONMENTS THROUGH TAILORED SUPPORT FOR EXPLORATION , 2001 .

[11]  Kurt VanLehn,et al.  DT Tutor: A Decision-Theoretic, Dynamic Approach for Optimal Selection of Tutorial Actions , 2000, Intelligent Tutoring Systems.

[12]  Wouter R. van Joolingen,et al.  Using Induction to Generate Feedback in Simulation Based Discovery Learning Environments , 1998, Intelligent Tutoring Systems.

[13]  Antonija Mitrovic,et al.  Using a Probabilistic Student Model to Control Problem Difficulty , 2000, Intelligent Tutoring Systems.

[14]  Christian A. Müller,et al.  Recognizing Time Pressure and Cognitive Load on the Basis of Speech: An Experimental Study , 2001, User Modeling.

[15]  J. E. Ball,et al.  Modeling the Emotional State of Computer Users , 1999 .

[16]  Rul Gunzenhäuser,et al.  Hypadapter: An adaptive hypertext system for exploratory learning and programming , 1996, User Modeling and User-Adapted Interaction.

[17]  Cristina Conati,et al.  Assessing Effective Exploration in Open Learning Environments Using Bayesian Networks , 2002, Intelligent Tutoring Systems.

[18]  Vincent Aleven,et al.  Limitations of Student Control: Do Students Know When They Need Help? , 2000, Intelligent Tutoring Systems.

[19]  Mark K. Singley,et al.  Team tutoring systems: reifying roles in problem solving , 1999, CSCL.

[20]  Eric Horvitz,et al.  The Lumière Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users , 1998, UAI.

[21]  Anthony Jameson,et al.  When actions have consequences: empirically based decision making for intelligent user interfaces , 2001, Knowl. Based Syst..

[22]  Cristina Conati,et al.  Using Bayesian Networks to Manage Uncertainty in Student Modeling , 2002, User Modeling and User-Adapted Interaction.

[23]  Ingrid Zukerman,et al.  Bayesian Models for Keyhole Plan Recognition in an Adventure Game , 2004, User Modeling and User-Adapted Interaction.

[24]  José-Luis Pérez-de-la-Cruz,et al.  A Bayesian Diagnostic Algorithm for Student Modeling and its Evaluation , 2002, User Modeling and User-Adapted Interaction.

[25]  Anthony Jameson,et al.  Numerical uncertainty management in user and student modeling: An overview of systems and issues , 2005, User Modeling and User-Adapted Interaction.

[26]  Cristina Conati,et al.  Modeling Students' Emotions from Cognitive Appraisal in Educational Games , 2002, Intelligent Tutoring Systems.

[27]  Peter Brusilovsky,et al.  ELM-ART: An Adaptive Versatile System for Web-based Instruction , 2001 .

[28]  Valerie J. Shute,et al.  A Comparison of Learning Environments: All That Glitters , 1992 .

[29]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[30]  Kurt VanLehn,et al.  Conceptual and Meta Learning During Coached Problem Solving , 1996, Intelligent Tutoring Systems.

[31]  Wouter van Joolingen,et al.  Cognitive tools for discovery learning , 1999 .

[32]  Eric Horvitz,et al.  Attention-Sensitive Alerting , 1999, UAI.

[33]  Robert J. Mislevy,et al.  The Role of Probability-Based Inference in an Intelligent Tutoring System. , 1995 .

[34]  Edmund H. Durfee,et al.  The Automated Mapping of Plans for Plan Recognition , 1994, AAAI.

[35]  Ton de Jong,et al.  Promoting Self-Directed Learning in Simulation-Based Discovery Learning Environments Through Intelligent Support , 2000, Interact. Learn. Environ..

[36]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[37]  Valerie J. Shute,et al.  A Large-Scale Evaluation of an Intelligent Discovery World: Smithtown , 1990, Interact. Learn. Environ..

[38]  Robert P. Goldman,et al.  A Bayesian Model of Plan Recognition , 1993, Artif. Intell..

[39]  W. V. van Joolingen,et al.  Scientific Discovery Learning with Computer Simulations of Conceptual Domains , 1998 .

[40]  Antonija Mitrovic,et al.  Optimising ITS Behaviour with Bayesian Networks and Decision Theory , 2001 .

[41]  Cristina Conati,et al.  POLA: a student modeling framework for Probabilistic On-Line Assessment of problem solving performance , 2001 .

[42]  C. Conati.  Probabilistic Plan Recognition for Cognitive Apprenticeship , 2001 .

[43]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems , 1988 .

[44]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[45]  Mimi Recker,et al.  Student Strategies for Learning Programming from a Computational Environment , 1992, Intelligent Tutoring Systems.

[46]  Jim E. Greer,et al.  SMODEL Server: Student Modelling in Distributed Multi-Agent Tutoring Systems , 2001 .

[47]  Wouter R. van Joolingen.  Designing for Collaborative Discovery Learning , 2000, Intelligent Tutoring Systems.

[48]  T. Jong,et al.  Exploratory learning with a computer simulation for control theory: learning processes and instructional support , 1993 .