The politeness effect: Pedagogical agents and learning outcomes

Pedagogical agent research seeks to exploit Reeves and Nass's media equation theory, which holds that users respond to interactive media as if they were social actors. Investigations have tended to focus on the media used to realize the pedagogical agent, e.g., the use of animated talking heads and voices, and the results have been mixed. This paper focuses instead on the manner in which a pedagogical agent communicates with learners, i.e., on the extent to which it exhibits social intelligence. A model of socially intelligent tutorial dialog was developed based on politeness theory, and implemented in an agent interface within an online learning system called virtual factory teaching system. A series of Wizard-of-Oz studies was conducted in which subjects either received polite tutorial feedback that promotes learner face and mitigates face threat, or received direct feedback that disregards learner face. The polite version yielded better learning outcomes, and the effect was amplified in learners who expressed a preference for indirect feedback, who had less computer experience, and who lacked engineering backgrounds. These results confirm the hypothesis that learners tend to respond to pedagogical agents as social actors, and suggest that research should focus less on the media in which agents are realized, and place more emphasis on the agent's social intelligence.

[1]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[2]  A. Bandura,et al.  Differential engagement of self-reactive influences in cognitive motivation , 1986, Organizational Behavior and Human Decision Processes.

[3]  Patricia Charlton,et al.  Conference on Artificial Intelligence in Education , 2009 .

[4]  Helen Pain,et al.  Informing the Detection of the Students' Motivational State: An Empirical Study , 2002, Intelligent Tutoring Systems.

[5]  P. Pintrich,et al.  Motivational and self-regulated learning components of classroom academic performance. , 1990 .

[6]  B. Zimmerman,et al.  Self-regulated learning and academic achievement: Theory, research, and practice. , 1989 .

[7]  D. Schunk Self-Efficacy and Education and Instruction , 1995 .

[8]  Dale H. Schunk,et al.  Developing Children's Self-Efficacy and Skills: The Roles of Social Comparative Information and Goal Setting , 1983 .

[9]  Thomas Rist,et al.  Guiding the user through dynamically generated hypermedia presentations with a life-like character , 1998, IUI '98.

[10]  R. Ryan,et al.  Control and information in the intrapersonal sphere: An extension of cognitive evaluation theory. , 1982 .

[11]  Justine Cassell,et al.  Negotiated Collusion: Modeling Social Language and its Relationship Effects in Intelligent Agents , 2003, User Modeling and User-Adapted Interaction.

[12]  M. González Politeness: some universals in language usage , 1995 .

[13]  J. Brophy,et al.  Conceptualizing student motivation , 1983 .

[14]  C. Nass,et al.  Truth is beauty: researching embodied conversational agents , 2001 .

[15]  Dale H. Schunk,et al.  Effects of Effort Attributional Feedback on Children's Perceived Self-Efficacy and Achievement , 1982 .

[16]  Dale H. Schunk,et al.  Sequential Attributional Feedback and Children's Achievement Behaviors , 1984 .

[17]  James C. Lester,et al.  The Case for Social Agency in Computer-Based Teaching: Do Students Learn More Deeply When They Interact With Animated Pedagogical Agents? , 2001 .

[18]  Paul Brna,et al.  Effective Affective in Intelligent Systems - Building on Evidence of Empathy in Teaching and Learning , 1999, IWAI.

[19]  M. Lepper,et al.  Motivational techniques of expert human tutors: Lessons for the design of computer-based tutors. , 1993 .

[20]  Michael Pressley,et al.  Scaffolding student learning: Instructional approaches and issues. , 1997 .

[21]  Dirk Heylen,et al.  Socially Intelligent Tutor Agents , 2003, IVA.

[22]  Mark R. Lepper,et al.  The wisdom of practice: Lessons learned from the study of highly effective tutors. , 2002 .

[23]  W. Lewis Johnson,et al.  Serious Use of a Serious Game for Language Learning , 2007, AIED.

[24]  Richard E. Mayer,et al.  A Personalization Effect in Multimedia Learning: Students Learn Better When Words Are in Conversational Style Rather Than Formal Style. , 2004 .

[25]  T. Bickmore,et al.  Etiquette for Human-Computer Work , 2002 .

[26]  Scotty D. Craig,et al.  Affect and learning: An exploratory look into the role of affect in learning with AutoTutor , 2004 .

[27]  Shrikanth S. Narayanan,et al.  Modeling and automating detection of errors in Arabic language learner speech , 2005, INTERSPEECH.

[28]  J. Stanley,et al.  Book Review: Taxonomy of Educational Objectives, The Classification of Educational Goals, Handbook I: Cognitive Domain , 1957 .

[29]  Charles B. Callaway,et al.  Cosmo: A Life-like Animated Pedagogical Agent with Deictic Believability (cid:3) , 1997 .

[30]  Cristina Conati,et al.  Inferring user goals from personality and behavior in a causal model of user affect , 2003, IUI '03.

[31]  R. Mayer,et al.  Personalized messages that promote science learning in virtual environments , 2004 .

[32]  Cynthia D. Fisher,et al.  The effects of personal control, competence, and extrinsic reward systems on intrinsic motivation , 1978 .

[33]  J. Meece,et al.  Student Perceptions in the Classroom , 1992 .

[34]  L. Steels,et al.  Grounding adaptive language games in robotic agents , 2006, AAAI 2012.

[35]  W. Lewis Johnson,et al.  STEVE: A Pedagogical Agent for Virtual Reality. , 1998 .

[36]  Bridget Cooper,et al.  Care - Making the Affective Leap: More Than a Concerned Interest in a Learner's Cognitive Abilities , 2003, Int. J. Artif. Intell. Educ..

[37]  Michael Drake,et al.  Scaffolding techniques of expert human tutors. , 1997 .

[38]  T. Bickmore Relational agents : effecting change through human-computer relationships , 2003 .

[39]  M. Rey,et al.  Pedagogical Agents that Interact with Learners , 2004 .

[40]  Susanne P. Lajoie,et al.  Computers As Cognitive Tools , 2020 .

[41]  Kaska Porayska-Pomsta,et al.  Influence of situational context on language production : modelling teachers' corrective responses , 2004 .

[42]  R. Mayer,et al.  Fostering social agency in multimedia learning: Examining the impact of an animated agent’s voice ☆ , 2005 .

[43]  Rolf A. Zwaan,et al.  Pragmatics and Pedagogy: Conversational Rules and Politeness Strategies May Inhibit Effective Tutoring , 1995 .

[44]  Jack Mostow,et al.  Adding Human-Provided Emotional Scaffolding to an Automated Reading Tutor That Listens Increases Student Persistence , 2002, Intelligent Tutoring Systems.

[45]  D. Schunk,et al.  Risk Taking: Theoretical, Empirical, and Educational Considerations , 1991 .

[46]  J. E. Maddux Self-efficacy, adaptation, and adjustment: Theory, research, and application. , 1995 .

[47]  R. Decharms Personal causation : the internal affective determinants of behavior , 1968 .

[48]  S. Marsella,et al.  Interactive Pedagogical Drama for Health Interventions , 2003 .

[49]  Dale H. Schunk,et al.  Goal and Self-Evaluative Influences During Children’s Cognitive Skill Learning , 1996 .

[50]  Ning Wang,et al.  Experimental evaluation of polite interaction tactics for pedagogical agents , 2005, IUI.

[51]  B. Zimmerman Self-efficacy and educational development , 1995 .

[52]  D. Schunk Ability Versus Effort Attributional Feedback: Differential Effects on Self-Efficacy and Achievement , 1983 .

[53]  C. Sansone,et al.  Intrinsic and extrinsic motivation : the search for optimal motivation and performance , 2000 .

[54]  W. Lewis Johnson,et al.  Animating 2D Digital Puppets with Limited Autonomy , 2004, Smart Graphics.

[55]  R. Azevedo,et al.  Does training on self-regulated learning facilitate students' learning with hypermedia? , 2004 .

[56]  Dale H. Schunk,et al.  Goal difficulty and attainment information: Effects on children's achievement behaviours. , 1983 .

[57]  Mattijs Ghijsen,et al.  Generating Socially Appropriate Tutorial Dialog , 2004, ADS.

[58]  W. Lambert,et al.  Attitudes and Motivation in Second-Language Learning , 1972 .

[59]  P. Pintrich,et al.  Motivation in Education: Theory, Research, and Applications , 1995 .

[60]  K. Connor,et al.  Sex and Age Differences in Response to Informational and Controlling Feedback , 1988 .

[61]  P. Pintrich,et al.  Students' motivational beliefs and their cognitive engagement in classroom academic tasks. , 1992 .

[62]  James C. Lester,et al.  Animated pedagogical agents and problem-solving effectiveness: a large-scale empirical evaluation , 1997 .

[63]  Richard E. Lucas,et al.  The mini-IPIP scales: tiny-yet-effective measures of the Big Five factors of personality. , 2006, Psychological assessment.

[64]  A. Bandura,et al.  Self-Efficacy in Changing Societies , 1996, Journal of Cognitive Psychotherapy.

[65]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[66]  Albert T. Corbett,et al.  Cognitive Tutor: Applied research in mathematics education , 2007, Psychonomic bulletin & review.

[67]  Amy L. Baylor,et al.  The Impact of Pedagogical Agent Image on Affective Outcomes , 2004 .

[68]  Maged Dessouky,et al.  A methodology for developing a web-based factory simulator for manufacturing education , 2001 .

[69]  W. Lewis Johnson,et al.  A Pedagogical Agent for Psychosocial Intervention on a Handheld Computer , 2004, AAAI Technical Report.

[70]  Christopher Miller Etiquette for human-computer work : papers from the 2002 AAAI Fall Symposium, November 15-17, North Falmouth, Massachusetts , 2002 .

[71]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[72]  E. Deci Effects of Externally Mediated Rewards on Intrinsic Motivation. , 1971 .

[73]  V. Folkes,et al.  Attribution theory: Applications to achievement, mental health, and interpersonal conflict. , 1991 .

[74]  Vincent Aleven,et al.  Toward Tutoring Help Seeking: Applying Cognitive Modeling to Meta-cognitive Skills , 2004, Intelligent Tutoring Systems.

[75]  A. Bandura,et al.  Self-evaluative and self-efficacy mechanisms governing the motivational effects of goal systems. , 1983 .

[76]  Kurt VanLehn,et al.  The Andes Physics Tutoring System: Lessons Learned , 2005, Int. J. Artif. Intell. Educ..

[77]  R. Vallerand,et al.  On the causal effects of perceived competence on intrinsic motivation: A test of cognitive evaluation theory. , 1984 .

[78]  A. Bandura Social Foundations of Thought and Action: A Social Cognitive Theory , 1985 .

[79]  Anita Woolfolk Hoy,et al.  Self-Efficacy and Self-Regulated Learning , 2002 .

[80]  B. Zimmerman,et al.  Self-regulated learning and academic achievement : theoretical perspectives , 2001 .

[81]  Joshua Aronson Improving academic achievement: Impact of psychological factors on education , 2002 .

[82]  Anita Woolfolk Hoy,et al.  Chapter 9 – Self-Efficacy and Self-Regulated Learning: The Dynamic Duo in School Performance , 2002 .

[83]  James C. Lester,et al.  Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments , 2000 .

[84]  Patricia D. Mautone,et al.  Social cues in multimedia learning: Role of speaker's voice. , 2003 .

[85]  Benedict du Boulay,et al.  Implementation of motivational tactics in tutoring systems , 1995 .

[86]  Richard E. Mayer,et al.  Constructing computer-based tutors that are socially sensitive: Politeness in educational software , 2006, Int. J. Hum. Comput. Stud..

[87]  Rosalind W. Picard,et al.  An affective model of interplay between emotions and learning: reengineering educational pedagogy-building a learning companion , 2001, Proceedings IEEE International Conference on Advanced Learning Technologies.

[88]  Penelope Brown,et al.  Politeness: Some Universals in Language Usage , 1989 .

[89]  Dale H. Schunk,et al.  Reward contingencies and the development of children's skills and self-efficacy. , 1983 .

[90]  Richard E. Mayer,et al.  Meaningful Design for Meaningful Learning: Applying Cognitive Theory to Multimedia Explanations , 2000 .

[91]  S. M. Arnsten Intrinsic motivation. , 1990, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[92]  Andrew Marshall,et al.  Evolution of user interaction: the case of agent adele , 2003, IUI '03.

[93]  H. J. Lam What Is a Taxon , 1957 .

[94]  S. Parker,et al.  Origins of Intelligence , 1983, Springer US.

[95]  James C. Lester,et al.  The persona effect: affective impact of animated pedagogical agents , 1997, CHI.

[96]  Kristen N. Moreno,et al.  AutoTutor Improves Deep Learning of Computer Literacy : Is it the Dialog or the Talking Head ? , 2004 .

[97]  Anderson Michael,et al.  AAAI Fall Symposium , 2005 .