Augmented Reality and Serious Games: A Systematic Literature Mapping

Augmented Reality (AR) has become a popular technology for both the public and industries. Serious Games (SG) incorporating pedagogical elements for learning, training, or inform. The creation of SG can use AR techniques for their development, with the prospect of new possibilities due to this integration. A Systematic Literature Mapping (SLM) allows a synthesized view of research carried out in the area. The objective of this paper is to present a SLM to identify the state of the art regarding SG with the use of AR, identification of techniques, tools, devices, results, application areas, publication vehicles and main research objectives. It was found that the use of AR in SG is growing in publications, especially at conferences. The SG with AR are mainly puzzles for a player using markers, have been used in curricular education, evaluated the learning and obtained positive results. However, the lack of variety in SG types, areas of application, tools and forms of evaluation was evident.

[1]  Roger E. Pedersen.  Game Design Foundations , 2003 .

[2]  Leif Oppermann,et al.  Playing on AREEF: evaluation of an underwater augmented reality game for kids , 2016, MobileHCI.

[3]  Alfred Kobsa,et al.  ABC3D — Using an augmented reality mobile game to enhance literacy in early childhood , 2016, 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[4]  Hiroyuki Mitsuhara,et al.  Game-Based Evacuation Drills Using Simple Augmented Reality , 2016, 2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT).

[5]  Diego Buchinger,et al.  Mecanismos de busca acadêmica: uma análise quantitativa , 2014 .

[6]  Michael Zyda,et al.  From visual simulation to virtual reality to games , 2005, Computer.

[7]  Sébastien Thon,et al.  Flying a drone in a museum: An augmented-reality cultural serious game in Provence , 2013, 2013 Digital Heritage International Congress (DigitalHeritage).

[8]  Chia-Huei Ho,et al.  The Development of an Augmented Reality Game-based Learning Environment☆ , 2015 .

[9]  Yu-Mei Huang,et al.  Augmented reality in educational activities for children with disabilities , 2016, Displays.

[10]  Dominique Leclet-Groux,et al.  A Serious Game for 3D cultural heritage , 2013, 2013 Digital Heritage International Congress (DigitalHeritage).

[11]  Chang Hwa Wang,et al.  Exploring the Effects of Discovery Learning Strategy for Location-Based Historic Retrospection Mobile Game , 2016, 2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT).

[12]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[13]  Alvaro Uribe-Quevedo,et al.  Detection of central venous access anatomic regions of interest using augmented reality game-based learning , 2015, 2015 IEEE Games Entertainment Media Conference (GEM).

[14]  Veronica Teichrieb,et al.  Voxar Puzzle: An Innovative Hardware/Software Computer Vision Game for Children Development , 2015, 2015 XVII Symposium on Virtual and Augmented Reality.

[15]  Maribeth Gandy Coleman,et al.  Participatory Design of STEM Education AR Experiences for Heterogeneous Student Groups: Exploring Dimensions of Tangibility, Simulation, and Interaction , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[16]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[17]  Alvaro Uribe-Quevedo,et al.  Location-based augmented reality game to engage students in discovering institutional landmarks , 2016, 2016 7th International Conference on Information, Intelligence, Systems & Applications (IISA).

[18]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[19]  Fabiano Amorim Vaz,et al.  KinardCar: Auxiliary Game in Formation of Young Drivers, Utilizing Kinect and Arduino Integration , 2014, SVR.

[20]  Deborah I. Fels,et al.  Powered to play: A mixed reality game for people driving powered chairs , 2014, 2014 IEEE Games Media Entertainment.

[21]  Alena Mesarosova,et al.  ARecycle NOID ARt Game: The Augmented Reality Game in Public Space , 2014, 2014 International Conference on Cyberworlds.

[22]  Miguel Nussbaum,et al.  Exploring different technological platforms for supporting co-located collaborative games in the classroom , 2012, Comput. Hum. Behav..

[23]  Darryl Charles,et al.  Augmented Reality Games for Upper-Limb Stroke Rehabilitation , 2009, 2010 Second International Conference on Games and Virtual Worlds for Serious Applications.

[24]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[25]  Maeve Serino,et al.  Pokémon Go and augmented virtual reality games: a cautionary commentary for parents and pediatricians , 2016, Current opinion in pediatrics.

[26]  Hiroyuki Mitsuhara,et al.  Evacuation instruction training system using augmented reality and a smartphone-based head mounted display , 2016, 2016 3rd International Conference on Information and Communication Technologies for Disaster Management (ICT-DM).

[27]  Yu-Ming Chang,et al.  Interactive augmented reality using Scratch 2.0 to improve physical activities for children with developmental disabilities. , 2015, Research in developmental disabilities.

[28]  Christos Sintoris,et al.  Do you remember that building? Exploring old Zakynthos through an augmented reality mobile game , 2014, 2014 International Conference on Interactive Mobile Communication Technologies and Learning (IMCL2014).

[29]  M. Bessa,et al.  MOW: Augmented Reality game to learn words in different languages: Case study: Learning English names of animals in elementary school , 2012, 7th Iberian Conference on Information Systems and Technologies (CISTI 2012).

[30]  Nicole C. Krämer,et al.  Let's do the Time Warp again: subjective and behavioral presence measurement and interactivity in the collaborative augmented reality game TimeWarp , 2011 .

[31]  Abdulmotaleb El-Saddik,et al.  Cloud-based rehabilitation exergames system , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[32]  -. YeeMonAung.  A Novel Upper Limb Rehabilitation System with Self-Driven Virtual Arm Illusion , 2015 .

[33]  Roseli de Deus Lopes,et al.  Augmented Reality in Occupacional Therapy , 2013, 2013 8th Iberian Conference on Information Systems and Technologies (CISTI).

[34]  Peter E.D. Love,et al.  Augmented Reality in built environment: Classification and implications for future research , 2013 .

[35]  Carlos Laorden,et al.  Enhancing cybersecurity learning through an augmented reality-based serious game , 2013, 2013 IEEE Global Engineering Education Conference (EDUCON).

[36]  Maria del Carmen Juan Lizandra,et al.  Evaluation of learning outcomes using an educational iPhone game vs. traditional game , 2013, Comput. Educ..

[37]  Selan Rodrigues dos Santos,et al.  Handcopter Game: A Video-Tracking Based Serious Game for the Treatment of Patients Suffering from Body Paralysis Caused by a Stroke , 2012, 2012 14th Symposium on Virtual and Augmented Reality.

[38]  Marcelo da Silva Hounsell,et al.  A Brief History of Virtual Reality in Brazil: A survey over the publications in the “Symposium on Virtual and Augmented Reality” , 2014 .

[39]  Chih-Ming Chen,et al.  Interactive Augmented Reality Game for Enhancing Library Instruction in Elementary Schools , 2013, 2013 IEEE 37th Annual Computer Software and Applications Conference Workshops.

[40]  David R. Michael,et al.  Serious Games: Games That Educate, Train, and Inform , 2005 .

[41]  Kai Petersen,et al.  Guidelines for conducting systematic mapping studies in software engineering: An update , 2015, Inf. Softw. Technol..

[42]  Mark Billinghurst,et al.  A Survey of Augmented Reality , 2015, Found. Trends Hum. Comput. Interact..

[43]  Luciano Vieira de Araújo,et al.  MoVEROffice: Virtual Reality for Upper Limbs Rehabilitation , 2016, 2016 XVIII Symposium on Virtual and Augmented Reality (SVR).

[44]  Rincon M. Nubia,et al.  Development of a mobile application in augmented reality to improve the communication field of autistic children at a Neurorehabilitar Clinic , 2015, 2015 Workshop on Engineering Applications - International Congress on Engineering (WEA).

[45]  Francisco Javier Díaz Pernas,et al.  Mobile Serious Game Using Augmented Reality for Supporting Children's Learning About Animals , 2013, VARE.

[46]  Alessandro Diogo Bruckheimer,et al.  Dance2Rehab3D: A 3D Virtual Rehabilitation Game , 2012, 2012 14th Symposium on Virtual and Augmented Reality.

[47]  Georgios D. Styliaras,et al.  "The buildings speak about our city": A location based augmented reality game , 2015, 2015 6th International Conference on Information, Intelligence, Systems and Applications (IISA).