Using Augmented Reality in programming learning: A systematic mapping study

Coding skills have become the new language of communication for the tech world. At an educational level, applying the concepts and logic of programming is a complex task for the student. The investigation of this problem was carried out with the intention of knowing if there are tools that could help the student understand programming by using augmented reality technology. For this purpose, a systematic mapping study was carried out to identify, filter and classify the information through a query applied in different ways of research. As a result, 34 articles were selected and classified. The main results show that: a) programming learning is not limited in terms of the student’s age; b) Augmented reality has potential advantages in programming learning; c) Due to the extensive content of the programming, applications focused on specific topics were found according to the level of studies; d) The software used in the development of AR applications, mostly uses Unity with Vuforia; and, e) Augmented reality contributes to different learning techniques and styles that improve the way information is perceived and visualized. In conclusion, augmented reality technology has proven to have positive consequences in the programming learning process, providing a starting point for the development of a tool that contributes to the programming learning based on the characteristics found and analyzed in this document.

[1]  Manfred Tscheligi,et al.  Augmented reality for industrial robot programmers: Workload analysis for task-based, augmented reality-supported robot control , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[2]  Sefa Aras,et al.  A Framework Based on Compiler Design Techniques for Programming Learning Environments , 2018, 2018 International Conference on Artificial Intelligence and Data Processing (IDAP).

[3]  Greg Kipper,et al.  Augmented Reality: An Emerging Technologies Guide to AR , 2012 .

[4]  Duen Horng Chau,et al.  Mixed Reality for Learning Programming , 2019, IDC.

[5]  César A. Collazos,et al.  Collaborative Strategy with Augmented Reality for the Development of Algorithmic Thinking , 2018 .

[6]  Eva Brooks,et al.  Interactivity, Game Creation, Design, Learning, and Innovation , 2017, Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.

[7]  Karthik Ramani,et al.  StoryMakAR: Bringing Stories to Life With An Augmented Reality & Physical Prototyping Toolkit for Youth , 2020, CHI.

[8]  Mordechai Ben-Ari,et al.  Enhancing Robot Programming with Visual Feedback and Augmented Reality , 2015, ITiCSE.

[9]  Danli Wang,et al.  ARCat: A Tangible Programming Tool for DFS Algorithm Teaching , 2019, IDC.

[10]  Uwe Zdun,et al.  Software metrics for measuring the understandability of architectural structures: a systematic mapping study , 2015, EASE.

[11]  Jon Peddie,et al.  Augmented Reality: Where We Will All Live , 2017 .

[12]  Lorenz Cuno Klopfenstein,et al.  BRINGING AN UNPLUGGED CODING CARD GAME TO AUGMENTED REALITY , 2017 .

[13]  Danli Wang,et al.  AR-maze: a tangible programming tool for children based on AR technology , 2018, IDC.

[14]  Youzou Miyadera,et al.  Machine Learning Model for Analyzing Learning Situations in Programming Learning , 2018, 2018 IEEE Conference on Big Data and Analytics (ICBDA).

[15]  Spyros Vosinakis,et al.  ARQuest: A Tangible Augmented Reality Approach to Developing Computational Thinking Skills , 2019, 2019 11th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games).

[16]  Poonpong Boonbrahm,et al.  Teaching Fundamental Programming Using Augmented Reality , 2019, Int. J. Interact. Mob. Technol..

[17]  Edward F. Melcer.  Moving to Learn: Exploring the Impact of Physical Embodiment in Educational Programming Games , 2017, CHI Extended Abstracts.

[18]  Tilbe Göksun,et al.  Code notes: designing a low-cost tangible coding tool for/with children , 2018, IDC.

[19]  Sameer M. AlNajdi,et al.  The effectiveness of using augmented reality (AR) on assembling and exploring educational mobile robot in pedagogical virtual machine (PVM) , 2018, Interact. Learn. Environ..

[20]  Stuart Garner.  The use of a code restructuring tool in the learning of programming , 2004, ITiCSE '04.

[21]  Mauro Figueiredo,et al.  Learning Programming and Electronics with Augmented Reality , 2016, HCI.

[22]  Nurdin Ibrahim,et al.  Influence of Blended Learning on Learning Result of Algorithm and Programming , 2018, 2018 Third International Conference on Informatics and Computing (ICIC).

[23]  David Vallejo,et al.  RoboTIC: A serious game based on augmented reality for learning programming , 2020, Multimedia Tools and Applications.

[24]  J. Ángel Velázquez-Iturbide,et al.  Analysis of the Emotions Experienced by Learning Greedy Algorithms with Augmented Reality , 2020, SIIE.

[25]  Wafa Johal,et al.  Augmented Robotics for Learners: A Case Study on Optics , 2019, 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).

[26]  Francisco J. Domínguez-Mota,et al.  Use of augmented reality to teach basic computing concepts , 2019, CLIHC.

[27]  Laura Del Bosque,et al.  Decreasing Failure in Programming Subject with Augmented Reality Tool , 2015 .

[28]  Ioannis Kazanidis,et al.  Teaching Mobile Programming Using Augmented Reality and Collaborative Game Based Learning , 2017, IMCL.

[29]  Carlos Delgado Kloos,et al.  Using an Augmented Reality Geolocalized Quiz Game as an Incentive to Overcome Academic Procrastination , 2018, IMCL.

[30]  Pedro Rangel Henriques,et al.  An Ontology based approach to teach Computational Thinking , 2019, 2019 International Symposium on Computers in Education (SIIE).

[31]  Gladys Gorga,et al.  Augmented Reality for Programming Teaching. Student Satisfaction Analysis , 2016, 2016 International Conference on Collaboration Technologies and Systems (CTS).

[32]  Chin-Hung Teng,et al.  An Augmented Reality Environment for Learning OpenGL Programming , 2012, 2012 9th International Conference on Ubiquitous Intelligence and Computing and 9th International Conference on Autonomic and Trusted Computing.

[33]  Carmen Ramos,et al.  Program with Ixquic: Educative Games and Learning in Augmented and Virtual Environments , 2016, 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES).

[34]  André Luiz Maciel Santana,et al.  Use of Augmented Reality for Computational Thinking Stimulation through Virtual , 2019, 2019 21st Symposium on Virtual and Augmented Reality (SVR).

[35]  Yunli Lee,et al.  An Augmented Reality Learning System for Programming Concepts , 2017, ICISA.

[36]  H. Gardner,et al.  Frames of Mind: The Theory of Multiple Intelligences , 1983 .

[37]  Cristina Sylla,et al.  CodeCubes - Playing with Cubes and Learning to Code , 2018, ArtsIT/DLI.

[38]  Javier García-Zubía,et al.  Serious Games, Remote Laboratories and Augmented Reality to Develop and Assess Programming Skills , 2013, ISAGA.

[39]  Joel Adams,et al.  ParallelAR: An Augmented Reality App and Instructional Approach for Learning Parallel Programming Scheduling Concepts , 2018, 2018 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW).

[40]  Ana I. Molina,et al.  A modern approach to supporting program visualization: from a 2D notation to 3D representations using augmented reality , 2020, Multim. Tools Appl..

[41]  Carlos J. Costa,et al.  A virtual robot solution to support programming learning an open source approach , 2018, 2018 13th Iberian Conference on Information Systems and Technologies (CISTI).

[42]  Zhi Hong Chen,et al.  Impact of Augmented Reality on Programming Language Learning: Efficiency and Perception , 2018 .

[43]  Miguel A. Redondo,et al.  An Intelligent Tutoring System to Facilitate the Learning of Programming through the Usage of Dynamic Graphic Visualizations , 2020, Applied Sciences.

[44]  Joonyoung Kim,et al.  Augmenting Coding: Augmented Reality for Learning Programming , 2018, CCHI.

[45]  Spyros Vosinakis,et al.  The Effect of Tangible Augmented Reality Interfaces on Teaching Computational Thinking: A Preliminary Study , 2018 .