Pedagogical Agents in Educational VR: An in the Wild Study

Pedagogical agents are theorized to increase humans’ effort to understand computerized instructions. Despite the pedagogical promises of VR, the usefulness of pedagogical agents in VR remains uncertain. Based on this gap, and inspired by global efforts to advance remote learning during the COVID-19 pandemic, we conducted an educational VR study in-the-wild (N = 161). With a 2 × 2 + 1 between subjects design, we manipulated the appearance and behavior of a virtual museum guide in an exhibition about viruses. Factual and conceptual learning outcomes as well as subjective learning experience measures were collected. In general, participants reported high enjoyment and had significant knowledge acquisition. We found that the agent’s appearance and behavior impacted factual knowledge gain. We also report an interaction effect between behavioral and visual realism for conceptual knowledge gain. Our findings nuance classical multimedia learning theories and provide directions for employing agents in immersive learning environments.

[1]  S. Kakade,et al.  Learning and selective attention , 2000, Nature Neuroscience.

[2]  R. Mayer,et al.  Learning Science in Immersive Virtual Reality , 2018, Journal of Educational Psychology.

[3]  Paul A. Kirschner,et al.  Cognitive load theory: implications of cognitive load theory on the design of learning , 2002 .

[4]  Guido Makransky,et al.  The validation and further development of a multidimensional cognitive load scale for virtual environments , 2020, J. Comput. Assist. Learn..

[5]  Richard E. Mayer,et al.  A gender matching effect in learning with pedagogical agents in an immersive virtual reality science simulation , 2019, J. Comput. Assist. Learn..

[6]  Sara Klingenberg,et al.  Can an immersive virtual reality simulation increase students' interest and career aspirations in science? , 2020, Br. J. Educ. Technol..

[7]  J. Hedberg.  The Cambridge handbook of multimedia learning , 2007 .

[8]  Richard E. Mayer,et al.  Thirty years of research on online learning , 2018, Applied Cognitive Psychology.

[9]  Jeremy N. Bailenson,et al.  Immersive Virtual Reality Field Trips Facilitate Learning About Climate Change , 2018, Front. Psychol..

[10]  Niels Henze,et al.  The Effect of Presence and Appearance of Guides in Virtual Reality Exhibitions , 2019, MuC.

[11]  Xiao Ma,et al.  Web-Based VR Experiments Powered by the Crowd , 2018, WWW.

[12]  Karl F. MacDorman,et al.  The Uncanny Valley [From the Field] , 2012, IEEE Robotics Autom. Mag..

[13]  Aske Mottelson,et al.  Investigating Representation of Text and Audio in Educational VR using Learning Outcomes and EEG , 2020, CHI.

[14]  Gavriel Salomon,et al.  T RANSFER OF LEARNING , 1992 .

[15]  Richard E. Clark,et al.  Research and Theory on Multi-Media Learning Effects , 1992 .

[16]  Harry Budi Santoso,et al.  The Design and Impact of the Pedagogical Agent: A Systematic Literature Review , 2019, The Journal of Educators Online.

[17]  Kerryn Butler-Henderson,et al.  COVID-19: 20 countries’ higher education intra-period digital pedagogy responses , 2020, 1.

[18]  Richard E. Mayer,et al.  Motivational and cognitive benefits of training in immersive virtual reality based on multiple assessments , 2019, J. Comput. Assist. Learn..

[19]  Greg Welch,et al.  A Systematic Review of Social Presence: Definition, Antecedents, and Implications , 2018, Front. Robot. AI.

[20]  G. Makransky,et al.  A structural equation modeling investigation of the emotional value of immersive virtual reality in education , 2018, Educational Technology Research and Development.

[21]  Richard E. Mayer,et al.  Adding immersive virtual reality to a science lab simulation causes more presence but less learning , 2017, Learning and Instruction.

[22]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[23]  Guido Makransky,et al.  Development and validation of the Multimodal Presence Scale for virtual reality environments: A confirmatory factor analysis and item response theory approach , 2017, Comput. Hum. Behav..

[24]  Noah L. Schroeder,et al.  How Effective are Pedagogical Agents for Learning? A Meta-Analytic Review , 2013 .

[25]  Manolya Kavakli,et al.  Learning science in a virtual reality application: The impacts of animated-virtual actors' visual complexity , 2010, Comput. Educ..

[26]  Heloir,et al.  The Uncanny Valley , 2019, The Animation Studies Reader.

[27]  Mel Slater,et al.  Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[28]  Guido Makransky,et al.  Investigating the effect of pre-training when learning through immersive virtual reality and video: A media and methods experiment , 2019, Comput. Educ..

[29]  Yanghee Kim,et al.  Pedagogical Agent Design: The Impact of Agent Realism, Gender, Ethnicity, and Instructional Role , 2004, Intelligent Tutoring Systems.

[30]  Richard E. Mayer,et al.  The virtual field trip: Investigating how to optimize immersive virtual learning in climate change education , 2020, Br. J. Educ. Technol..

[31]  Curtis J. Bonk,et al.  The Handbook of Blended Learning: Global Perspectives, Local Designs , 2005 .

[32]  Isaac Wang,et al.  Exploring Virtual Agents for Augmented Reality , 2019, CHI.

[33]  Aaron Doering,et al.  Enali: A Research and Design Framework for Virtual Characters and Pedagogical Agents , 2009 .

[34]  Sara Klingenberg,et al.  Investigating the effect of teaching as a generative learning strategy when learning through desktop and immersive VR: A media and methods experiment , 2020, Br. J. Educ. Technol..

[35]  René F. Kizilcec,et al.  The instructor’s face in video instruction: Evidence from two large-scale field studies. , 2015, Journal of Educational Psychology.

[36]  Katharina Scheiter,et al.  Explaining the split-attention effect: Is the reduction of extraneous cognitive load accompanied by an increase in germane cognitive load? , 2009, Comput. Hum. Behav..

[37]  Karl F. MacDorman,et al.  Refinements to Indices for Perceived Humanness, Attractiveness, and Eeriness , 2016 .

[38]  George Veletsianos,et al.  Pedagogical Agents , 2013 .

[39]  Kangsoo Kim,et al.  Does a Digital Assistant Need a Body? The Influence of Visual Embodiment and Social Behavior on the Perception of Intelligent Virtual Agents in AR , 2018, 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[40]  Clifford Nass,et al.  Evaluating the effects of behavioral realism in embodied agents , 2009, Int. J. Hum. Comput. Stud..

[41]  David Swapp,et al.  An ‘In the Wild’ Experiment on Presence and Embodiment using Consumer Virtual Reality Equipment , 2016, IEEE Transactions on Visualization and Computer Graphics.

[42]  Richard E. Mayer,et al.  Cognitive and affective processes for learning science in immersive virtual reality , 2020, J. Comput. Assist. Learn..

[43]  Jaziar Radianti,et al.  A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda , 2020, Comput. Educ..

[44]  Michael Koch,et al.  The Novelty Effect in Large Display Deployments - Experiences and Lessons-Learned for Evaluating Prototypes , 2018, ECSCW Exploratory Papers.

[45]  Charles R. Graham.  BLENDED LEARNING SYSTEMS: DEFINITION, CURRENT TRENDS, AND FUTURE DIRECTIONS , 2005 .

[46]  Karl F. MacDorman,et al.  Measuring the Uncanny Valley Effect , 2017, Int. J. Soc. Robotics.

[47]  Flemming Konradsen,et al.  A review of the use of virtual reality head-mounted displays in education and training , 2017, Education and Information Technologies.

[48]  Kasper Hornbæk,et al.  Virtual reality studies outside the laboratory , 2017, VRST.

[49]  R. Mayer,et al.  Immersive virtual reality increases liking but not learning with a science simulation and generative learning strategies promote learning in immersive virtual reality. , 2020 .

[50]  R. Mayer.  The Cambridge Handbook of Multimedia Learning: Principles Based on Social Cues in Multimedia Learning: Personalization, Voice, Image, and Embodiment Principles , 2014 .

[51]  Jeremy N. Bailenson,et al.  Avatars Versus Agents: A Meta-Analysis Quantifying the Effect of Agency on Social Influence , 2015, Hum. Comput. Interact..

[52]  G. Clarebout,et al.  Do pedagogical agents make a difference to student motivation and learning , 2011 .