Exploring the affective, motivational and cognitive effects of pedagogical agent enthusiasm in a multimedia learning environment

In a traditional classroom environment, instructor enthusiasm has been shown to enhance student’s emotion, affective perceptions, intrinsic motivation, and cognitive outcome. Additionally, emotional response theory argues that enthusiastic verbal and nonverbal cues of an instructor will induce positive emotional states in learners, which in turn, enact learners’ approach behaviours in the learning process. Therefore, should a pedagogical agent convey enthusiastic behaviours in a multimedia learning environment? Literature and theoretical reviews offer two competing views. The first view, based on emotional response theory, predicts that enthusiastic verbal and nonverbal cues of a pedagogical agent can induce higher positive emotions in learners, which in turn, enhance affective perceptions, intrinsic motivation, and cognitive outcome. However, the second view, based on cognitive load theory, suggests that pedagogical agent enthusiasm may increase extraneous cognitive load (additional processing in the mind), which negatively impact emotion, affective perceptions, intrinsic motivation, and cognitive outcome. To investigate the effects of agent enthusiasm, seventy-two university freshmen interacted with either an enthusiastic agent or a neutral agent (operationalized through vocal tones, facial expression, gestures, and remarks) that simulates the instructional role of a virtual tutor that delivers narrative demonstrations on how to predict the outputs of C-Programming algorithms. The results of our study showed that pedagogical agent enthusiasm significantly enhanced emotion, intrinsic motivation, affective perceptions, and cognitive outcome. Moreover, mediation analyses revealed that the facilitating effects of agent enthusiasm on intrinsic motivation, affective perceptions of the learning environment, and affective perceptions of the pedagogical agent were fully mediated by a learner’s positive emotion, thus demonstrating that the framework of emotional response theory can be applied to learner-agent interaction in a multimedia learning environment. Implications and suggestions for future research related to pedagogical agent enthusiasm are discussed in this paper.

[1]  Julia Müller,et al.  Emotional design in multimedia learning: Differentiation on relevant design features and their effects on emotions and learning , 2015, Comput. Hum. Behav..

[2]  Donald A. Norman,et al.  Emotional design , 2004, UBIQ.

[3]  Nor Azan Mat Zin,et al.  Exploring Suitable Emotion-Focused Strategies in Helping Students to Regulate Their Emotional State in a Tutoring System: Malaysian Case Study , 2013 .

[4]  L. Pessoa,et al.  Positive emotions broaden the scope of attention and thought‐action repertoires , 2005, Cognition & emotion.

[5]  H. Chad Lane,et al.  The Effects of a Pedagogical Agent for Informal Science Education on Learner Behaviors and Self-efficacy , 2013, AIED.

[6]  Angelica Moè,et al.  Does displayed enthusiasm favour recall, intrinsic motivation and time estimation? , 2016, Cognition & emotion.

[7]  James C. Lester,et al.  Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments , 2000 .

[8]  Rachel Coulston,et al.  The Impact of Auditory Embodiment on Animated Character Design , 2002 .

[9]  Susanne van Mulken,et al.  The impact of animated interface agents: a review of empirical research , 2000, Int. J. Hum. Comput. Stud..

[10]  Elizabeth O. Hayward,et al.  Emotional design in multimedia learning: Effects of shape and color on affect and learning , 2014 .

[11]  L. Cohen,et al.  Research Methods in Education , 1980 .

[12]  Roxana Moreno,et al.  The Roles of Animated Pedagogical Agents' Presence and Nonverbal Communication in Multimedia Learning Environments , 2010, J. Media Psychol. Theor. Methods Appl..

[13]  Slava Kalyuga,et al.  Incorporating Learner Experience into the Design of Multimedia Instruction. , 2000 .

[14]  Keith Weber,et al.  Understanding Emotional Response Theory: The Role of Instructor Power and Justice Messages , 2012 .

[15]  George Veletsianos,et al.  How do learners respond to pedagogical agents that deliver social-oriented non-task messages? Impact on student learning, perceptions, and experiences , 2012, Comput. Hum. Behav..

[16]  Karl F. MacDorman,et al.  The Uncanny Valley [From the Field] , 2012, IEEE Robotics Autom. Mag..

[17]  Nor Azan Mat Zin,et al.  The Effects of a Pedagogical Agent's Smiling Expression on the Learner's Emotions and Motivation in a Virtual Learning Environment. , 2016 .

[18]  Lanette L. Pogue,et al.  The Effect of Teacher Nonverbal Immediacy and Credibility on Student Motivation and Affective Learning , 2006 .

[19]  Yanghee Kim,et al.  Research-Based Design of Pedagogical Agent Roles: a Review, Progress, and Recommendations , 2016, International Journal of Artificial Intelligence in Education.

[20]  Nicole C. Krämer,et al.  Psychological Research on Embodied Conversational Agents: The Case of Pedagogical Agents , 2010, J. Media Psychol. Theor. Methods Appl..

[21]  Timothy P. Mottet,et al.  Relationships between teacher nonverbal immediacy, student emotional response, and perceived student learning , 2002 .

[22]  Kristopher J Preacher,et al.  Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models , 2008, Behavior research methods.

[23]  Pertti Saariluoma,et al.  Emotional Dimensions of User Experience: A User Psychological Analysis , 2014, Int. J. Hum. Comput. Interact..

[24]  C. Midgley,et al.  How Teachers Establish Psychological Environments During the First Days of School: Associations With Avoidance in Mathematics. , 2003 .

[25]  R. Mayer,et al.  Fostering social agency in multimedia learning: Examining the impact of an animated agent’s voice ☆ , 2005 .

[26]  George A. Miller,et al.  Human memory and the storage of information , 1956, IRE Trans. Inf. Theory.

[27]  J. Sweller.  COGNITIVE LOAD THEORY, LEARNING DIFFICULTY, AND INSTRUCTIONAL DESIGN , 1994 .

[28]  Patricia D. Mautone,et al.  Social cues in multimedia learning: Role of speaker's voice. , 2003 .

[29]  Huay Lit Woo,et al.  Designing multimedia learning environments using animated pedagogical agents: factors and issues , 2009, J. Comput. Assist. Learn..

[30]  Toni M. Kempler,et al.  “What's Everybody So Excited About?”: The Effects of Teacher Enthusiasm on Student Intrinsic Motivation and Vitality , 2000 .

[31]  V. Aleven,et al.  Triggering situational interest by decorative illustrations both fosters and hinders learning in computer-based learning environments , 2014 .

[32]  Jürgen Baumert,et al.  Professional Competence of Teachers: Effects on Instructional Quality and Student Development , 2013 .

[33]  J. Gorham,et al.  Effects of immediacy on recall of information , 1988 .

[34]  Qingwen Dong,et al.  The Effects of Emotional Arousal and Valence on Television Viewers' Cognitive Capacity and Memory. , 1995 .

[35]  Tze Wei Liew,et al.  The Effects of Positive and Negative Mood on Cognition and Motivation in Multimedia Learning Environment , 2016, J. Educ. Technol. Soc..

[36]  A. Isen,et al.  The Influence of Positive Affect on Intrinsic and Extrinsic Motivation: Facilitating Enjoyment of Play, Responsible Work Behavior, and Self-Control , 2005 .

[37]  J. Mccroskey,et al.  Development of the nonverbal immediacy scale (NIS): Measures of self‐and other‐perceived nonverbal immediacy , 2003 .

[38]  Xiang Yu,et al.  Comparison of different approaches on example-based learning for novice and proficient learners , 2015, Human-centric Computing and Information Sciences.

[39]  Noah L. Schroeder,et al.  How Effective are Pedagogical Agents for Learning? A Meta-Analytic Review , 2013 .

[40]  Katerina Theodoridou.  Learning Spanish with Laura: the effects of a pedagogical agent , 2011 .

[41]  Anne C. Frenzel,et al.  Teacher Enthusiasm: Reviewing and Redefining a Complex Construct , 2015, Educational Psychology Review.

[42]  Jürgen Baumert,et al.  Students' and mathematics teachers' perceptions of teacher enthusiasm and instruction , 2008 .

[43]  Yanghee Kim,et al.  Simulating Instructional Roles through Pedagogical Agents , 2005, Int. J. Artif. Intell. Educ..

[44]  Mark Grimshaw,et al.  Facial expression of emotion and perception of the Uncanny Valley in virtual characters , 2011, Comput. Hum. Behav..

[45]  Russell Beale,et al.  Affective interaction: How emotional agents affect users , 2009, Int. J. Hum. Comput. Stud..

[46]  K. Yamanaka,et al.  A Methodology for Computer Programming Teaching Based on Bloom's Taxonomy of Educational Objectives and Apllied Through the Pair Programming , 2012, IEEE Latin America Transactions.

[47]  D. Leutner.  Motivation and emotion as mediators in multimedia learning , 2014 .

[48]  Richard E. Clark,et al.  Five Design Principles for Experiments on the Effects of Animated Pedagogical Agents , 2005 .

[49]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[50]  Reinhard Pekrun,et al.  Teacher enthusiasm: Dimensionality and context specificity , 2011 .

[51]  Eunjoon Rachel Um,et al.  Emotional design in multimedia learning. , 2012 .

[52]  Yun Ling,et al.  Conversations with a virtual human: Synthetic emotions and human responses , 2014, Comput. Hum. Behav..

[53]  R. Moreno,et al.  Students' choice of animated pedagogical agents in science learning: A test of the similarity-attraction hypothesis on gender and ethnicity , 2006 .

[54]  Dion Hoe-Lian Goh,et al.  Affect in Embodied Pedagogical Agents , 2015 .