Plan Recognition and Visualization in Exploratory Learning Environments

Modern pedagogical software is open-ended and flexible, allowing students to solve problems through exploration and trial-and-error. Such exploratory settings provide for a rich educational environment for students, but they challenge teachers to keep track of students’ progress and to assess their performance. This article presents techniques for recognizing students’ activities in such pedagogical software and visualizing these activities to teachers. It describes a new plan recognition algorithm that uses a recursive grammar that takes into account repetition and interleaving of activities. This algorithm was evaluated empirically using an exploratory environment for teaching chemistry used by thousands of students in several countries. It was always able to correctly infer students’ plans when the appropriate grammar was available. We designed two methods for visualizing students’ activities for teachers: one that visualizes students’ inferred plans, and one that visualizes students’ interactions over a timeline. Both of these visualization methods were preferred to and found more helpful than a baseline method which showed a movie of students’ interactions. These results demonstrate the benefit of combining novel AI techniques and visualization methods for the purpose of designing collaborative systems that support students in their problem solving and teachers in their understanding of students’ performance.

[1]  Philip R. Cohen,et al.  Plans as Complex Mental Attitudes , 2003 .

[2]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[3]  Sandra Carberry,et al.  Plan Recognition in Natural Language Dialogue , 1990 .

[4]  Rina Dechter,et al.  Constraint Processing , 1995, Lecture Notes in Computer Science.

[5]  Albert T. Corbett,et al.  Modeling Student Knowledge: Cognitive Tutors in High School and College , 2000, User Modeling and User-Adapted Interaction.

[6]  Cristina Conati,et al.  Combining Unsupervised and Supervised Classification to Build User Models for Exploratory , 2009, EDM 2009.

[7]  Cristina Conati,et al.  Automatic Recognition of Learner Groups in Exploratory Learning Environments , 2006, Intelligent Tutoring Systems.

[8]  Karen E. Lochbaum,et al.  A Collaborative Planning Model of Intentional Structure , 1998, CL.

[9]  Robert Wilensky,et al.  Why John Married Mary: Understanding Stories Involving Recurring Goals , 1978, Cogn. Sci..

[10]  J. Greeno,et al.  The ChemCollective—Virtual Labs for Introductory Chemistry Courses , 2010, Science.

[11]  M-Helene Ng Cheong Vee Understanding novice errors and error paths in Object-oriented programming through log analysis , 2006 .

[12]  Joyojeet Pal,et al.  Multiple Mice for Computers in Education in Developing Countries , 2006, 2006 International Conference on Information and Communication Technologies and Development.

[13]  James Mayfield,et al.  Controlling inference in plan recognition , 1992, User Modeling and User-Adapted Interaction.

[14]  Nadine Mandran,et al.  Flexible Environment for Supervising Simulation-Based Learning Situations , 2009, AIED.

[15]  Cristina Conati,et al.  A Framework for Capturing Distinguishing User Interaction Behaviors in Novel Interfaces , 2011, EDM.

[16]  Kenneth R. Koedinger,et al.  A Data Repository for the EDM Community: The PSLC DataShop , 2010 .

[17]  Henry A. Kautz A formal theory of plan recognition , 1987 .

[18]  Aurora Vizcaíno A Simulated Student Can Improve Collaborative Learning , 2005, Int. J. Artif. Intell. Educ..

[19]  Cristina Conati,et al.  On-Line Student Modeling for Coached Problem Solving Using Bayesian Networks , 1997 .

[20]  Jana Koehler,et al.  PHI - A Logic-Based Tool for Intelligent Help Systems , 1993, IJCAI.

[21]  Claus Zinn,et al.  How did the e-learning session go? The Student Inspector , 2007, AIED.

[22]  Ya'akov Gal,et al.  Plan recognition in exploratory domains , 2012, Artif. Intell..

[23]  Nate Blaylock Recognizing Instantiated Goals using Statistical Methods , 2005 .

[24]  Neal Lesh Adaptive Goal Recognition , 1997, IJCAI.

[25]  Andee Rubin,et al.  STRATEGIES FOR MANAGING STATISTICAL COMPLEXITY WITH NEW SOFTWARE TOOLS , 2004 .

[26]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[27]  Cristina Conati,et al.  Using Bayesian Networks to Manage Uncertainty in Student Modeling , 2002, User Modeling and User-Adapted Interaction.

[28]  Ryan Shaun Joazeiro de Baker,et al.  Identifying Students' Inquiry Planning Using Machine Learning , 2010, EDM.

[29]  Philip R. Cohen,et al.  Intentions in Communication. , 1992 .

[30]  Alexandra Poulovassilis,et al.  The Design of Teacher Assistance Tools in an Exploratory Learning Environment for Mathematics Generalisation , 2010, EC-TEL.

[31]  Alexandra Poulovassilis,et al.  Design of Teacher Assistance Tools in an Exploratory Learning Environment for Algebraic Generalization , 2012, IEEE Transactions on Learning Technologies.

[32]  Jeffrey Heer,et al.  prefuse: a toolkit for interactive information visualization , 2005, CHI.

[33]  Ryan Shaun Joazeiro de Baker,et al.  Using Text Replay Tagging to Produce Detectors of Systematic Experimentation Behavior Patterns , 2010, EDM.

[34]  Ya'akov Gal,et al.  Plan Recognition in Virtual Laboratories , 2011, IJCAI.

[35]  Candace L. Sidner,et al.  Using plan recognition in human-computer collaboration , 1999 .

[36]  Neil T. Heffernan,et al.  Towards Live Informing and Automatic Analyzing of Student Learning: Reporting in ASSISTment System , 2007 .

[37]  Robert P. Goldman,et al.  A Bayesian Model of Plan Recognition , 1993, Artif. Intell..

[38]  Philip R. Cohen,et al.  Plans for Discourse , 2003 .

[39]  Robert P. Goldman,et al.  A probabilistic plan recognition algorithm based on plan tree grammars , 2009, Artif. Intell..

[40]  Mei Chen,et al.  A methodology for characterizing computer-based learning environments , 1995 .

[41]  Mathias Bauer Acquisition of User Preferences for Plan Recognition , 2007 .

[42]  Stuart M. Shieber,et al.  Recognition of Users' Activities Using Constraint Satisfaction , 2009, UMAP.

[43]  Elif Yamangil,et al.  Towards Collaborative Intelligent Tutors: Automated Recognition of Users' Strategies , 2008, Intelligent Tutoring Systems.

[44]  Kurt VanLehn,et al.  The Andes Physics Tutoring System: Lessons Learned , 2005, Int. J. Artif. Intell. Educ..