Promoting academically productive talk with conversational agent interventions in collaborative learning settings

Research on computer-supported collaborative learning (CSCL) and conversational pedagogical agents has strongly emphasized the value of providing dynamic dialogue support for learners working together to accomplish a certain task. Recently, on the basis of the classroom discourse framework of Academically Productive Talk (APT), a flexible form of conversational agent support has emerged employing APT-based intervention methods so as to stimulate pedagogically beneficial conversational interactions among learning partners. This paper investigates the impact of an APT-based Linking Contributions (LC) intervention mode implemented by a conversational agent in the context of a collaborative activity in higher education. This type of agent interventions encourages students to explicitly externalize their reasoning on important domain concepts building upon the contributions of their partners. Forty-three (43) students collaborated in small groups using a prototype CSCL system to accomplish three different tasks in the domain of Multimedia Learning. Groups were randomly assigned to the treatment or the control condition. In the treatment condition, a conversational agent participated in students' dialogues making LC mode interventions. In the control condition, students discussed without the agent intervening. The results of the study illustrated that the students in the treatment condition engaged in a more productive dialogue demonstrating increased explicit reasoning throughout the collaborative activity. Furthermore, it was shown that the students in the treatment condition outperformed the control students in various measures on knowledge acquisition. Evidence also suggests that students' enhanced learning performance was mediated by the positive effect of the agent intervention mode on students' argumentation. Overall, this study provides insights into how the use of a configurable conversational agent displaying unsolicited LC interventions during students' discourse can be beneficial to collaborative learning. We investigated the impact of a Linking Contributions (LC) intervention mode implemented by a conversational agent.Our results indicated that the LC agent intervention mode amplified student explicit reasoning.The LC agent interventions also improved domain-learning outcomes.The enhancement of student learning was mediated by the impact of agent interventions on student explicit argumentation.

[1]  Li Yujian,et al.  A Normalized Levenshtein Distance Metric , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Carolyn Penstein Rosé,et al.  Architecture for Building Conversational Agents that Support Collaborative Learning , 2011, IEEE Transactions on Learning Technologies.

[3]  Carolyn Penstein Rosé,et al.  Enhancing Scientific Reasoning and Discussion with Conversational Agents , 2013, IEEE Transactions on Learning Technologies.

[4]  Carolyn Penstein Rosé,et al.  Intensification of Group Knowledge Exchange with Academically Productive Talk Agents , 2013, CSCL.

[5]  A. L. Baylor Promoting motivation with virtual agents and avatars: role of visual presence and appearance , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[6]  F. Fischer,et al.  Knowledge convergence in collaborative learning: Concepts and assessment , 2007 .

[7]  Courtney B. Cazden,et al.  Classroom Discourse: The Language of Teaching and Learning. Second Edition. , 2001 .

[8]  F. Fischer,et al.  A framework to analyze argumentative knowledge construction in computer-supported collaborative learning , 2006, Comput. Educ..

[9]  Hans-Rüdiger Pfister,et al.  Explicit references in chat-based CSCL: do they facilitate global text processing? evidence from eye movement analyses , 2009, CSCL.

[10]  Arthur C. Graesser,et al.  Agent Technologies Designed to Facilitate Interactive Knowledge Construction , 2008 .

[11]  Annika Silvervarg,et al.  Building a Social Conversational Pedagogical Agent: Design Challenges and Methodological approaches , 2010 .

[12]  Patrick Jermann,et al.  Designing Integrative Scripts , 2007 .

[13]  Lauren B. Resnick,et al.  CLASSROOM TALK FOR RIGOROUS READING COMPREHENSION INSTRUCTION , 2005 .

[14]  R. Gillies Developments in classroom-based talk , 2014 .

[15]  Stavros N. Demetriadis,et al.  'Make it explicit!': Improving collaboration through increase of script coercion , 2013, J. Comput. Assist. Learn..

[16]  S. Erduran,et al.  Arguing to learn and learning to argue: Case studies of how students' argumentation relates to their scientific knowledge , 2008 .

[17]  Gerry Stahl Interaction Analysis of a Biology Chat , 2013 .

[18]  Fabrizio Morbini,et al.  Joint Identification and Segmentation of Domain-Specific Dialogue Acts for Conversational Dialogue Systems , 2011, ACL.

[19]  Chen-Chung Liu,et al.  An analysis of peer interaction patterns as discoursed by on-line small group problem-solving activity , 2008, Comput. Educ..

[20]  Carolyn Penstein Rosé,et al.  Supportive technologies for group discussion in MOOCs , 2015 .

[21]  Carolyn Penstein Rosé,et al.  Towards Academically Productive Talk Supported by Conversational Agents , 2012, ITS.

[22]  Carolyn Penstein Rosé,et al.  Towards an Agile Approach to Adapting Dynamic Collaboration Support to Student Needs , 2014, International Journal of Artificial Intelligence in Education.

[23]  Magnus Haake,et al.  A Look at the Roles of Look & Roles in Embodied Pedagogical Agents - A User Preference Perspective , 2009, Int. J. Artif. Intell. Educ..

[24]  S. Michaels,et al.  Deliberative Discourse Idealized and Realized: Accountable Talk in the Classroom and in Civic Life , 2008 .

[25]  Michelle K. Smith,et al.  Why Peer Discussion Improves Student Performance on In-Class Concept Questions , 2009, Science.

[26]  Ulrike Cress,et al.  The need for considering multilevel analysis in CSCL research—An appeal for the use of more advanced statistical methods , 2008, Int. J. Comput. Support. Collab. Learn..

[27]  Cindy E. Hmelo-Silver Multivocality as a Tool for Design-Based Research , 2013 .

[28]  A. Strauss,et al.  Grounded theory , 2017 .

[29]  Carolyn Penstein Rosé,et al.  Socially Capable Conversational Tutors Can Be Effective in Collaborative Learning Situations , 2010, Intelligent Tutoring Systems.

[30]  Carolyn Penstein Rosé,et al.  SUPPORTING GROUP MATH COGNITION IN VIRTUAL MATH TEAMS WITH SOFTWARE CONVERSATIONAL AGENTS , 2010 .

[31]  Sten R. Ludvigsen,et al.  Dialogic foundations of CSCL , 2014, Int. J. Comput. Support. Collab. Learn..

[32]  L. Resnick,et al.  A framework for analyzing development of argumentation through classroom discussions , 2012 .

[33]  A. Hayes Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach , 2013 .

[34]  Pierre Tchounikine,et al.  Flexibility in macro-scripts for computer-supported collaborative learning , 2007, J. Comput. Assist. Learn..

[35]  R. Alexander Speaking but not listening? Accountable talk in an unaccountable context , 2010 .

[36]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[37]  Kristopher J Preacher,et al.  Mediation Analysis in Social Psychology: Current Practices and New Recommendations , 2011 .

[38]  Carolyn Penstein Rosé,et al.  Engaging Collaborative Learners with Helping Agents , 2009, AIED.

[39]  Anastasios Karakostas,et al.  Adaptive vs. Fixed Domain Support in the Context of Scripted Collaborative Learning , 2014, J. Educ. Technol. Soc..

[40]  Kenneth R. Koedinger,et al.  Designing automated adaptive support to improve student helping behaviors in a peer tutoring activity , 2011, Int. J. Comput. Support. Collab. Learn..

[41]  Richard E. Mayer,et al.  Multimedia Learning: The Promise of Multimedia Learning , 2001 .

[42]  Thrasyvoulos Tsiatsos,et al.  A Configurable Conversational Agent to Trigger Students’ Productive Dialogue: A Pilot Study in the CALL Domain , 2013, International Journal of Artificial Intelligence in Education.