Comparing virtual and location-based augmented reality mobile learning: emotions and learning outcomes

Research on the effectiveness of augmented reality (AR) on learning exists, but there is a paucity of empirical work that explores the role that positive emotions play in supporting learning in such settings. To address this gap, this study compared undergraduate students’ emotions and learning outcomes during a guided historical tour using mobile AR applications. Data was collected in a laboratory (Study 1; N = 13) and outdoors (Study 2; N = 18) from thirty-one undergraduate students at a large North American university. Our findings demonstrated that learners were able to effectively and enjoyably learn about historical differences between past and present historical locations by contextualizing their visual representations, and that the two mobile AR apps were effective both in and outside of the laboratory. Learners were virtually situated in the historical location in Study 1 and physically visited the location in Study 2. In comparing results between studies, findings revealed that learners were able to identify more differences outdoors and required less scaffolding to identify differences. Learners reported high levels of enjoyment throughout both studies, but more enjoyment and less boredom in the outdoor study. Eye tracking results from Study 1 indicated that learners frequently compared historical information by switching their gaze between mobile devices and a Smart Board, which virtually situated them at the historical location. Results enhance our understanding of AR applications’ effectiveness in different contexts (virtual and location-based). Design recommendations for mobile AR apps are discussed.

[1]  Sidney K. D'Mello,et al.  Monitoring Affect States During Effortful Problem Solving Activities , 2010, Int. J. Artif. Intell. Educ..

[2]  C. Boxtel,et al.  Historical Reasoning: Towards a Framework for Analyzing Students’ Reasoning about the Past , 2008 .

[3]  Fumio Kishino,et al.  Augmented reality: a class of displays on the reality-virtuality continuum , 1995, Other Conferences.

[4]  T. Gog The signaling (or cueing) principle in multimedia learning , 2014 .

[5]  T. Goetz,et al.  Academic Emotions in Students' Self-Regulated Learning and Achievement: A Program of Qualitative and Quantitative Research , 2002 .

[6]  Jason M. Harley,et al.  Examining the predictive relationship between personality and emotion traits and students’ agent-directed emotions: towards emotionally-adaptive agent-based learning environments , 2016, User Modeling and User-Adapted Interaction.

[7]  Debbie L. Rabina,et al.  Uncovering lost histories through GeoStoryteller: A digital GeoHumanities project , 2012, DH.

[8]  M. Simon,et al.  What's still wrong with rubrics: Focusing on the consistency of performance criteria across scale levels , 2004 .

[9]  Reinhard Pekrun,et al.  International handbook of emotions in education. , 2014 .

[10]  Wolfgang Broll,et al.  Toward Next-Gen Mobile AR Games , 2008, IEEE Computer Graphics and Applications.

[11]  Jason M. Harley,et al.  A multi-componential analysis of emotions during complex learning with an intelligent multi-agent system , 2014, Comput. Hum. Behav..

[12]  Eric Rosenbaum,et al.  On Location Learning: Authentic Applied Science with Networked Augmented Realities , 2007 .

[13]  M. A. Britt,et al.  Using multiple sources of evidence to reason about history. , 1996 .

[14]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[15]  Richard E. Mayer,et al.  The Cambridge Handbook of Multimedia Learning: Cognitive Theory of Multimedia Learning , 2005 .

[16]  Manuel Castro,et al.  New technology trends in education: Seven years of forecasts and convergence , 2011, Comput. Educ..

[17]  S. Vodanovich,et al.  Boredom proneness and psychosocial development. , 1999, The Journal of psychology.

[18]  Kasia Muldner,et al.  Gender Differences in the Use and Benefit of Advanced Learning Technologies for Mathematics. , 2013 .

[19]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[20]  Maria Roussou,et al.  A digital look at physical museum exhibits: Designing personalized stories with handheld Augmented Reality in museums , 2013, 2013 Digital Heritage International Congress (DigitalHeritage).

[21]  Jason M. Harley,et al.  An Integrated Emotion-Aware Framework for Intelligent Tutoring Systems , 2015, AIED.

[22]  Jason W. Osborne,et al.  The power of outliers (and why researchers should ALWAYS check for them) , 2004 .

[23]  Akrivi Katifori,et al.  Profiling Attitudes for Personalized Information Provision , 2011, IEEE Data Eng. Bull..

[24]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[25]  Eric Klopfer,et al.  Augmented Learning: Research and Design of Mobile Educational Games , 2008 .

[26]  Richard E. Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[27]  R. Pekrun The Control-Value Theory of Achievement Emotions: Assumptions, Corollaries, and Implications for Educational Research and Practice , 2006 .

[28]  Henry Been-Lirn Duh,et al.  Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[29]  Maria Roussou,et al.  CHESS: Personalized Storytelling Experiences in Museums , 2014, ICIDS.

[30]  Maria Roussou,et al.  From personalization to adaptivity - Creating immersive visits through interactive digital storytelling at the Acropolis Museum , 2013, Intelligent Environments.

[31]  Kurt Squire,et al.  Environmental Detectives—the development of an augmented reality platform for environmental simulations , 2008 .

[32]  Debbie L. Rabina,et al.  Does place affect user engagement and understanding?: Mobile learner perceptions on the streets of New York , 2013, J. Documentation.

[33]  Maria Roussou,et al.  Authoring Personalized Interactive Museum Stories , 2014, ICIDS.

[34]  B. Tabachnick,et al.  Using multivariate statistics, 5th ed. , 2007 .

[35]  Timo Engelke,et al.  The House of Olbrich — An Augmented Reality tour through architectural history , 2011, 2011 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities.

[36]  Maria Roussou,et al.  Indoors and outdoors: designing mobile experiences for Cité de l’espace , 2013 .

[37]  Reinhard Pekrun,et al.  Boredom and academic achievement: Testing a model of reciprocal causation , 2014 .

[38]  Zane L. Berge,et al.  Museums: Gateways to Mobile Learning , 2013 .

[39]  Jyh-Chong Liang,et al.  Current status, opportunities and challenges of augmented reality in education , 2013, Comput. Educ..

[40]  Anne C. Frenzel,et al.  Measuring emotions in students learning and performance: The Achievement Emotions Questionnaire (AE , 2011 .

[41]  R. Mayer Incorporating motivation into multimedia learning , 2014 .

[42]  Genny Tortora,et al.  A Collaborative Augmented Campus Based on Location-Aware Mobile Technology , 2012, Int. J. Distance Educ. Technol..

[43]  R. Mayer,et al.  Multimedia Learning: Frontmatter , 2001 .

[44]  Stephen C. Bronack The Role of Immersive Media in Online Education , 2011 .

[45]  S. Mann,et al.  Boredom in the lecture theatre: An investigation into the contributors, moderators and outcomes of boredom amongst university students , 2009 .

[46]  Reinhard Pekrun,et al.  Boredom in achievement settings: Exploring control–value antecedents and performance outcomes of a neglected emotion. , 2010 .

[47]  Anne C. Frenzel,et al.  The Control-Value Theory of Achievement Emotions: An Integrative Approach to Emotions in Education , 2007 .

[48]  Jason M. Harley Measuring Emotions: A Survey of Cutting Edge Methodologies Used in Computer-Based Learning Environment Research , 2016 .

[49]  Cristina Conati,et al.  Inferring Learning from Gaze Data during Interaction with an Environment to Support Self-Regulated Learning , 2013, AIED.

[50]  Michael Lewis,et al.  Shame and Pride and their Effects on Student Achievement , 2014 .

[51]  W. Schreiber Historisches Denken. Ein Kompetenz-Strukturmodell , 2006 .