Noticing Relevant Feedback Improves Learning in an Intelligent Tutoring System for Peer Tutoring

Intelligent tutoring techniques can successfully improve student learning from collaborative activities, but little is known about why and under what contexts this support is effective. We have developed an intelligent tutor to improve the help that peer tutors give by encouraging them to explain tutee errors and provide more conceptual help. In previous work, we have shown that adaptive support from this "tutor" tutor improves student learning more than randomly selected support. In this paper, we examine this result, looking more closely at the feedback students received, and coding it for relevance to the current situation. Surprisingly, we find that the amount of relevant support students receive is not correlated with their learning; however, there is a positive correlation with learning and students noticing relevant support, and a negative correlation with learning and students ignoring relevant support. Designers of adaptive collaborative learning systems should focus not only on making support relevant, but also engaging.

[1]  Siriwan Suebnukarn,et al.  Modeling individual and collaborative problem-solving in medical problem-based learning , 2006, User Modeling and User-Adapted Interaction.

[2]  S. Sharan.  Cooperative Learning: Theory and Research , 1990 .

[3]  Pierre Dillenbourg,et al.  Over-scripting CSCL: The risks of blending collaborative learning with instructional design , 2002 .

[4]  Rosemary Luckin,et al.  Towards Systems That Care: A Conceptual Framework based on Motivation, Metacognition and Affect , 2010, Int. J. Artif. Intell. Educ..

[5]  Kenneth R. Koedinger,et al.  Adaptive support for CSCL: Is it feedback relevance or increased student accountability that matters? , 2011, CSCL.

[6]  K. Koedinger,et al.  Improving students’ help-seeking skills using metacognitive feedback in an intelligent tutoring system , 2011, Learning and Instruction.

[7]  Antonija Mitrovic,et al.  Supporting collaborative learning and problem-solving in a constraint-based CSCL environment for UML class diagrams , 2007, Int. J. Comput. Support. Collab. Learn..

[8]  Kurt VanLehn,et al.  The Behavior of Tutoring Systems , 2006, Int. J. Artif. Intell. Educ..

[9]  R. Ploetzner,et al.  Learning by explaining to oneself and to others. , 1999 .

[10]  Kasia Muldner,et al.  "Yes!": Using Tutor and Sensor Data to Predict Moments of Delight during Instructional Activities , 2010, UMAP.

[11]  Rod D. Roscoe,et al.  Understanding Tutor Learning: Knowledge-Building and Knowledge-Telling in Peer Tutors’ Explanations and Questions , 2007 .

[12]  Vincent Aleven,et al.  Persistent Effects of Social Instructional Dialog in a Virtual Learning Environment , 2011, AIED.

[13]  P. Dillenbourg,et al.  Three worlds of CSCL: Can we support CSCL? , 2002 .

[14]  Carolyn Penstein Rosé,et al.  Tutorial Dialogue as Adaptive Collaborative Learning Support , 2007, AIED.

[15]  J. Fantuzzo,et al.  Effects of reciprocal peer tutoring on academic achievement and psychological adjustment: A component analysis. , 1989 .

[16]  Pierre Dillenbourg,et al.  Collaborative Learning: Cognitive and Computational Approaches , 1999 .

[17]  David W. Johnson,et al.  Cooperative learning and achievement. , 1990 .

[18]  Francesco Ricci,et al.  User Modeling, Adaptation, and Personalization , 2014, Lecture Notes in Computer Science.

[19]  James D. Slotta,et al.  Internal and external collaboration scripts in web-based science learning at schools , 2005, CSCL.

[20]  Daniel D. Suthers,et al.  Coaching Web-based Collaborative Learning based on Problem Solution Differences and Participation , 2003, Int. J. Artif. Intell. Educ..