How do pedagogical approaches affect the impact of augmented reality on education? A meta-analysis and research synthesis

Abstract Augmented Reality (AR) is gaining popularity in educational processes due to its recognized efficacy for teaching and learning. Many studies have identified the trends, advantages, opportunities, challenges, and impact of this technology on education. However, most of the previous studies failed to analyze the pedagogical approaches, somehow ignoring that the success of an intervention depends not only on the technical characteristics of the technology but also on the pedagogical strategies to implement them. This study presents a quantitative meta-analysis of 46 empirical studies to identify, in the light of the learning theories, how pedagogical approaches affect the impact of AR on education. In addition, we analyzed the impact of moderating variables on students' learning outcomes in AR interventions. The results indicate that the highest impact was obtained when interventions employed the collaborative pedagogical approach. Based on the findings of this study, we provide insights for researchers and practitioners on what characteristics of AR interventions seem to benefit students’ learning outcomes and how pedagogical approaches can be applied in various educational contexts, to guide the design of future AR interventions.

[1]  P. Dillenbourg.  What do you mean by collaborative learning , 1999 .

[2]  Jamie L. Sickel.  The Great Media Debate and TPACK: A Multidisciplinary Examination of the Role of Technology in Teaching and Learning , 2019, Journal of Research on Technology in Education.

[3]  Robert M. Bernard,et al.  How Does Distance Education Compare With Classroom Instruction? A Meta-Analysis of the Empirical Literature , 2004 .

[4]  Richard E. Mayer,et al.  Using multimedia for e-learning , 2017, J. Comput. Assist. Learn..

[5]  Gwo-Jen Hwang,et al.  An Augmented Reality-based Mobile Learning System to Improve Students' Learning Achievements and Motivations in Natural Science Inquiry Activities , 2014, J. Educ. Technol. Soc..

[6]  Scientific.  International Standard Classification of Education, ISCED 1997 , 2003 .

[7]  Ellen T. Kamp,et al.  Phases of inquiry-based learning: Definitions and the inquiry cycle , 2015 .

[8]  R. Rosenthal.  Meta-analytic procedures for social research , 1984 .

[9]  Chih-Ming Chen,et al.  Interactive augmented reality system for enhancing library instruction in elementary schools , 2013, Comput. Educ..

[10]  Jorge Bacca,et al.  Augmented Reality Trends in Education: A Systematic Review of Research and Applications , 2014, J. Educ. Technol. Soc..

[11]  Rabia Yilmaz,et al.  Using augmented reality technology in storytelling activities: examining elementary students’ narrative skill and creativity , 2016, Virtual Reality.

[12]  Juan Garzón,et al.  Meta-analysis of the impact of Augmented Reality on students’ learning gains , 2019, Educational Research Review.

[13]  Carlos Delgado Kloos,et al.  Impact of an augmented reality system on students' motivation for a visual art course , 2013, Comput. Educ..

[14]  Gwo-Jen Hwang,et al.  Influences of an inquiry-based ubiquitous gaming design on students' learning achievements, motivation, behavioral patterns, and tendency towards critical thinking and problem solving , 2017, Br. J. Educ. Technol..

[15]  Annemarie S. Palincsar,et al.  Motivating Project-Based Learning: Sustaining the Doing, Supporting the Learning , 1991 .

[16]  Nassir Navab,et al.  Enhancement of Anatomical Education Using Augmented Reality: An Empirical Study of Body Painting , 2019, Anatomical sciences education.

[17]  Dirk Basten,et al.  Benefits of Augmented Reality in Educational Environments - A Systematic Literature Review , 2015, Wirtschaftsinformatik.

[18]  Hilary McLellan,et al.  Situated Learning: Continuing the Conversation. , 1994 .

[19]  J. Sweller,et al.  Cognitive Load Theory and Complex Learning: Recent Developments and Future Directions , 2005 .

[20]  Silvia Baldiris,et al.  Systematic review and meta-analysis of augmented reality in educational settings , 2019, Virtual Reality.

[21]  Michail N. Giannakos,et al.  Project-Based Learning in IT Education: Definitions and Qualities , 2018 .

[22]  R. Clark.  Media will never influence learning , 1994 .

[23]  Chih-Hung Chen,et al.  An augmented reality-based learning approach to enhancing students' science reading performances from the perspective of the cognitive load theory , 2018, Br. J. Educ. Technol..

[24]  Chin-Chung Tsai,et al.  Affordances of Augmented Reality in Science Learning: Suggestions for Future Research , 2012, Journal of Science Education and Technology.

[25]  Jyh-Chong Liang,et al.  Current status, opportunities and challenges of augmented reality in education , 2013, Comput. Educ..

[26]  R. DeShon,et al.  Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. , 2002 .

[27]  Eleni A. Kyza,et al.  An inquiry-based augmented reality mobile learning approach to fostering primary school students’ historical reasoning in non-formal settings , 2018, Interact. Learn. Environ..

[28]  Murat Akçayır,et al.  Advantages and challenges associated with augmented reality for education: A systematic review of the literature , 2017 .

[29]  Stephanie Bell.  Project-Based Learning for the 21st Century: Skills for the Future , 2010 .

[30]  J. Piaget,et al.  The Origins of Intelligence in Children , 1971 .

[31]  Robert Levine,et al.  Interactive Anatomy-Augmented Virtual Simulation Training. , 2018, Clinical simulation in nursing.

[32]  Manuel Contero,et al.  Using an Augmented Reality Enhanced Tabletop System to Promote Learning of Mathematics: A Case Study with Students with Special Educational Needs. , 2017 .

[33]  Farah L. Vallera.  Durkheim Said What?: Creating Talking Textbooks With Augmented Reality and Project-Based Activities , 2019, Journal of Research on Technology in Education.

[34]  Betsy Jane Becker,et al.  Synthesizing standardized mean‐change measures , 1988 .

[35]  Kaya Yılmaz,et al.  Constructivism: Its Theoretical Underpinnings, Variations, and Implications for Classroom Instruction. , 2008 .

[36]  John A. Shewell.  Petroleum Technology: From Refinery To Home, Business, and Industry. , 1997 .

[37]  Kathy Cabe Trundle,et al.  Conducting guided inquiry in science classes using authentic, archived, web-based data , 2011, Comput. Educ..

[38]  Chris Dede,et al.  EcoMOBILE: Integrating augmented reality and probeware with environmental education field trips , 2013, Comput. Educ..

[39]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[40]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[41]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[42]  Ruth Harmsen,et al.  Meta-Analysis of Inquiry-Based Learning , 2016 .

[43]  Mai Neo,et al.  Engaging Students in Multimedia-mediated Constructivist Learning - Students' Perceptions , 2009, J. Educ. Technol. Soc..

[44]  Zeynep Turan,et al.  The impact of mobile augmented reality in geography education: achievements, cognitive loads and views of university students , 2018 .

[45]  Mehmet Akif Ocak,et al.  Augmented reality in science laboratories: The effects of augmented reality on university students' laboratory skills and attitudes toward science laboratories , 2016, Comput. Hum. Behav..

[46]  T. Anderson.  Theories for Learning with Emerging Technologies , 2010 .

[47]  M. Özdemir,et al.  The Effect of Augmented Reality Applications in the Learning Process: A Meta-Analysis Study , 2018 .

[48]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[49]  Yao-Ting Sung,et al.  Apply an Augmented Reality in a Mobile Guidance to Increase Sense of Place for Heritage Places , 2015, J. Educ. Technol. Soc..

[50]  R. Kozma.  Will media influence learning? Reframing the debate , 1994 .

[51]  Roland Klemke,et al.  Attuning a mobile simulation game for school children using a design-based research approach , 2015, Comput. Educ..

[52]  Tsung-Yu Liu,et al.  Using ubiquitous games in an English listening and speaking course: Impact on learning outcomes and motivation , 2010, Comput. Educ..

[53]  Gwo-Jen Hwang,et al.  Impacts of an augmented reality-based flipped learning guiding approach on students' scientific project performance and perceptions , 2018, Comput. Educ..

[54]  D. Schunk.  Learning Theories: An Educational Perspective , 1991 .

[55]  Iulian Radu,et al.  Why should my students use AR? A comparative review of the educational impacts of augmented-reality , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[56]  L. Hedges.  Estimation of effect size from a series of independent experiments. , 1982 .

[57]  D. Lewis,et al.  Quantitative methods in psychology , 1950 .

[58]  Feng-Kuang Chiang,et al.  Applications of augmented reality-based natural interactive learning in magnetic field instruction , 2017, Interact. Learn. Environ..

[59]  Sevda Küçük,et al.  Learning anatomy via mobile augmented reality: Effects on achievement and cognitive load , 2016, Anatomical sciences education.

[60]  Yu-Hui Ching,et al.  Trends of educational technology research: more than a decade of international research in six SSCI-indexed refereed journals , 2013, Educational Technology Research and Development.

[61]  Richard Fox.  Constructivism Examined , 2001 .

[62]  Chee-Kit Looi,et al.  Review of Augmented Reality in Education: Situated Learning with Digital and Non-digital Resources , 2019, Learning in a Digital World.

[63]  Yi Hsing Chang,et al.  APPLYING AN AR TECHNIQUE TO ENHANCE SITUATED HERITAGE LEARNING IN A UBIQUITOUS LEARNING ENVIRONMENT , 2013 .

[64]  L. Nadolny,et al.  The Effect of an Augmented Reality Enhanced Mathematics Lesson on Student Achievement and Motivation. , 2015 .

[65]  Zeynel Abidin Yılmaz,et al.  Artırılmış Gerçeklik Uygulamalarının Eğitimle Bütünleştirilmesinin Meta-Analitik ve Tematik Karşılaştırmalı Analizi , 2016 .

[66]  Wernhuar Tarng,et al.  Development of a Lunar-Phase Observation System Based on Augmented Reality and Mobile Learning Technologies , 2016, Mob. Inf. Syst..

[67]  Chris Dede,et al.  Immersive Interfaces for Engagement and Learning , 2009, Science.

[68]  L. Hedges,et al.  Statistical Methods for Meta-Analysis , 1987 .

[69]  Fatih Saltan,et al.  The Use of Augmented Reality in Formal Education: A Scoping Review. , 2017 .

[70]  Henry Been-Lirn Duh,et al.  An investigation of learners' collaborative knowledge construction performances and behavior patterns in an augmented reality simulation system , 2013, Comput. Educ..

[71]  Rabia Yilmaz,et al.  Effect of augmented reality applications on secondary school students' reading comprehension and learning permanency , 2019, Comput. Hum. Behav..

[72]  L. Steffe,et al.  Piaget and the radical constructivist epistemology , 2007 .

[73]  Ernesto Redondo Domínguez,et al.  Assessment of augmented visualization methods in multimedia engineering education , 2015 .

[74]  eynel Abidin Yılmaz,et al.  A Meta-Analytic and Thematic Comparative Analysis of the Integration of Augmented Reality Applications into Education , 2016 .

[75]  G. Glass.  Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[76]  Ting-Chia Hsu,et al.  Learning English with Augmented Reality: Do learning styles matter? , 2017, Comput. Educ..

[77]  Noel Enyedy,et al.  Learning physics through play in an augmented reality environment , 2012, Int. J. Comput. Support. Collab. Learn..

[78]  Johannes Holvitie,et al.  Co-creative engineering curriculum design — Case East Africa , 2018, 2018 IEEE Frontiers in Education Conference (FIE).

[79]  Xu Wang,et al.  A case study of Augmented Reality simulation system application in a chemistry course , 2014, Comput. Hum. Behav..

[80]  Henry Been-Lirn Duh,et al.  An Investigation of University Students’ Collaborative Inquiry Learning Behaviors in an Augmented Reality Simulation and a Traditional Simulation , 2014, Journal of Science Education and Technology.

[81]  David H. Jonassen,et al.  Constructivism and the Technology of Instruction : A Conversation , 2013 .

[82]  P. Schulte,et al.  A Definition of Constructivism. , 1996 .

[83]  Alfred Bork,et al.  Multimedia in Learning , 2001 .

[84]  Mustafa Fidan,et al.  Integrating augmented reality into problem based learning: The effects on learning achievement and attitude in physics education , 2019, Comput. Educ..

[85]  H. Pashler,et al.  Distributed practice in verbal recall tasks: A review and quantitative synthesis. , 2006, Psychological bulletin.

[86]  I. Widiaty,et al.  MOBILE-BASED AUGMENTED REALITY FOR LEARNING 3-DIMENSIONAL SPATIAL BATIK-BASED OBJECTS , 2017 .

[87]  Anne-Wil Harzing,et al.  Google Scholar, Scopus and the Web of Science: a longitudinal and cross-disciplinary comparison , 2015, Scientometrics.

[88]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[89]  Ting-Kwei Wang,et al.  Does Augmented Reality Effectively Foster Visual Learning Process in Construction? An Eye-Tracking Study in Steel Installation , 2018, Advances in Civil Engineering.

[90]  Hsiao-Ching She,et al.  Learning through playing Virtual Age: Exploring the interactions among student concept learning, gaming performance, in-game behaviors, and the use of in-game characters , 2015, Comput. Educ..

[91]  Conducting Research on Topics of Student Interest. , 2000 .

[92]  S. Morris.  Estimating Effect Sizes From Pretest-Posttest-Control Group Designs , 2008 .

[93]  Angel Chi-Poot,et al.  Usability evaluation of an augmented reality system for teaching Euclidean vectors , 2016 .

[94]  Wernhuar Tarng,et al.  Development of a virtual butterfly ecological system based on augmented reality and mobile learning technologies , 2013, 2013 9th International Wireless Communications and Mobile Computing Conference (IWCMC).

[95]  Wen-Hung Chao,et al.  Using Augmented Reality to Enhance and Engage Students in Learning Mathematics , 2018, Advances in Social Sciences Research Journal.

[96]  Hirokazu Kato,et al.  Augmented Reality Learning Experiences: Survey of Prototype Design and Evaluation , 2014, IEEE Transactions on Learning Technologies.

[97]  Chia-Chen Chen,et al.  Animating eco-education: To see, feel, and discover in an augmented reality-based experiential learning environment , 2016, Comput. Educ..

[98]  Paul A. Kirschner,et al.  Cognitive load theory: implications of cognitive load theory on the design of learning , 2002 .

[99]  Carlos Delgado Kloos,et al.  Support for Augmented Reality Simulation Systems: The Effects of Scaffolding on Learning Outcomes and Behavior Patterns , 2016, IEEE Transactions on Learning Technologies.

[100]  Chris Dede,et al.  Affordances and Limitations of Immersive Participatory Augmented Reality Simulations for Teaching and Learning , 2009 .

[101]  Fengfeng Ke,et al.  Mobile augmented-reality artifact creation as a component of mobile computer-supported collaborative learning , 2015, Internet High. Educ..

[102]  Roy D. Pea,et al.  Addressing the Challenges of Inquiry-Based Learning Through Technology and Curriculum Design , 1999 .

[103]  Annemarie S. Palincsar,et al.  Social constructivist perspectives on teaching and learning. , 1998, Annual review of psychology.

[104]  Francisco J. García-Peñalvo,et al.  Augmented reality and pedestrian navigation through its implementation in m-learning and e-learning: Evaluation of an educational program in Chile , 2017, Comput. Educ..

[105]  Hsin-Yi Chang,et al.  Integrating a mobile augmented reality activity to contextualize student learning of a socioscientific issue , 2013, Br. J. Educ. Technol..

[106]  S Duval,et al.  Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis , 2000, Biometrics.

[107]  Wernhuar Tarng,et al.  A Sun Path Observation System Based on Augment Reality and Mobile Learning , 2018, Mob. Inf. Syst..

[108]  Jia Zhang,et al.  The development and evaluation of an augmented reality-based armillary sphere for astronomical observation instruction , 2014, Comput. Educ..

[109]  Gwo-Jen Hwang,et al.  Impacts of integrating the repertory grid into an augmented reality-based learning design on students’ learning achievements, cognitive load and degree of satisfaction , 2018, Interact. Learn. Environ..

[110]  Hakan Tekedere,et al.  Examining the Effectiveness of Augmented Reality Applications in Education: A Meta-Analysis. , 2016 .

[111]  Ebru Kiliç Çakmak,et al.  Effects of augmented reality on student achievement and self-efficacy in vocational education and training , 2018 .

[112]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement , 2009, BMJ : British Medical Journal.

[113]  Hsien-Sheng Hsiao,et al.  Weather observers: a manipulative augmented reality system for weather simulations at home, in the classroom, and at a museum , 2016, Interact. Learn. Environ..

[114]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[115]  Sumedha Chauhan,et al.  A meta-analysis of the impact of technology on learning effectiveness of elementary students , 2017, Comput. Educ..

[116]  Oliver Müller,et al.  Augmented reality in informal learning environments: A field experiment in a mathematics exhibition , 2014, Comput. Educ..

[117]  Alan C. K. Cheung,et al.  The Effectiveness of Educational Technology Applications for Enhancing Mathematics Achievement in K-12 Classrooms: A Meta-Analysis. Best Evidence Encyclopedia (BEE). , 2011 .

[118]  J. Sweller,et al.  Cognitive load theory in health professional education: design principles and strategies , 2010, Medical education.