Using nature elements in mobile AR for education with children

We present a concept, prototype and in-the-wild evaluation of a mobile augmented reality (AR) application in which physical items from nature are used as AR markers. By blending the physical and digital, AR technology has the potential to create an enhanced learning experience compared to paper-based solutions and conventional mobile applications. Our prototype, an application running on a tablet computer, uses natural markers such as leaves and pinecones in a game-like nature quiz. The system was evaluated using interviews with and observations of 6- to 12-year-old children (n=11) who played the game as well as focus group discussions with play club counsellors (n=4) and primary school teachers (n=7). Our salient findings suggest that the concept has sound potential in its mixture of physical activity and educational elements in an outdoor context. In particular, teachers found the use of natural objects to be an appealing approach and a factor contributing to the learning experience.

[1]  Maria Meletiou-Mavrotheris,et al.  Mobile technologies in the service of students’ learning of mathematics: the example of game application A.L.E.X. in the context of a primary school in Cyprus , 2015, Mathematics Education Research Journal.

[2]  W. John Kress,et al.  Leafsnap: A Computer Vision System for Automatic Plant Species Identification , 2012, ECCV.

[3]  Marta Gómez Domingo,et al.  Exploring the use of educational technology in primary education: Teachers' perception of mobile technology learning impacts and applications' use in the classroom , 2016, Comput. Hum. Behav..

[4]  Mitchel Resnick,et al.  Extending tangible interfaces for education: digital montessori-inspired manipulatives , 2005, CHI.

[5]  Johannes Schöning,et al.  Map torchlight: a mobile augmented reality camera projector unit , 2009, CHI Extended Abstracts.

[6]  Rabia Yilmaz,et al.  Educational magic toys developed with augmented reality technology for early childhood education , 2016, Comput. Hum. Behav..

[7]  Alfred Kobsa,et al.  ABC3D — Using an augmented reality mobile game to enhance literacy in early childhood , 2016, 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[8]  Sakiko Nishi,et al.  ARTTag: aesthetic fiducial markers based on circle pairs , 2016, SIGGRAPH Posters.

[9]  R. Yin.  Case Study Research: Design and Methods , 1984 .

[10]  Paul Marshall,et al.  Do tangible interfaces enhance learning? , 2007, TEI.

[11]  Robert W. Lindeman,et al.  GeoBoids: mobile AR for exergaming , 2012, CHINZ '12.

[12]  Wan-Tzu Lo,et al.  Students' use of mobile technology to collect data in guided inquiry on field trips , 2013, IDC.

[13]  Emilia Biffi,et al.  NFC-based application with educational purposes , 2014, PervasiveHealth.

[14]  Chris Dede,et al.  Augmented Reality Teaching and Learning , 2014 .

[15]  Tony P. Pridmore,et al.  From codes to patterns: designing interactive decoration for tableware , 2013, CHI.

[16]  Sean White,et al.  Searching the World's Herbaria: A System for Visual Identification of Plant Species , 2008, ECCV.

[17]  Sang Hyun Kim,et al.  Mobile wireless technology use and implementation: Opening a dialogue on the new technologies in education , 2005 .

[18]  Michael Rohs,et al.  Target acquisition with camera phones when used as magic lenses , 2008, CHI.

[19]  Carlos Delgado Kloos,et al.  Impact of an augmented reality system on students' motivation for a visual art course , 2013, Comput. Educ..

[20]  Jorge Bacca,et al.  Mobile Augmented Reality in Vocational Education and Training , 2015 .

[21]  Leena Ventä-Olkkonen,et al.  User evaluation of mobile augmented reality scenarios , 2012, J. Ambient Intell. Smart Environ..

[22]  Jyh-Chong Liang,et al.  Current status, opportunities and challenges of augmented reality in education , 2013, Comput. Educ..

[23]  Young Yim Doh,et al.  iSpy: RFID-driven language learning toy integrating living environment , 2013, CHI Extended Abstracts.

[24]  Leila Alem,et al.  ARGreenet and BasicGreenet: Two mobile games for learning how to recycle , 2011, WSCG 2011.

[25]  Pattie Maes,et al.  Smarter objects: using AR technology to program physical objects and their interactions , 2013, CHI Extended Abstracts.

[26]  José Rouillard,et al.  PerZoovasive: contextual pervasive QR codes as tool to provide an adaptive learning support , 2008, CSTST.

[27]  Johannes Schöning,et al.  The Geography of Pokémon GO: Beneficial and Problematic Effects on Places and Movement , 2017, CHI.

[28]  Asier Marzo.  Largibles: Large Tangible Interaction in Mobile Augmented Reality , 2015, CHI Extended Abstracts.

[29]  Johannes Schöning,et al.  Map navigation with mobile devices: virtual versus physical movement with and without visual context , 2007, ICMI '07.

[30]  Marko Jurmu,et al.  Activity pad: teaching tool combining tangible interaction and affordance of paper , 2013, ITS.

[31]  Allison Woodruff,et al.  Revisiting the visit:: understanding how technology can shape the museum visit , 2002, CSCW '02.

[32]  Yvonne Rogers,et al.  Ambient wood: designing new forms of digital augmentation for learning outdoors , 2004, IDC '04.

[33]  Pan Hui,et al.  CloudRidAR: a cloud-based architecture for mobile augmented reality , 2014, MARS@MobiSys.

[34]  Ivan Poupyrev,et al.  Virtual object manipulation on a table-top AR environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[35]  D. Morgan.  Focus groups for qualitative research. , 1988, Hospital guest relations report.

[36]  Gwo-Jen Hwang,et al.  An Augmented Reality-based Mobile Learning System to Improve Students' Learning Achievements and Motivations in Natural Science Inquiry Activities , 2014, J. Educ. Technol. Soc..

[37]  Chris Dede,et al.  EcoMOBILE: Integrating augmented reality and probeware with environmental education field trips , 2013, Comput. Educ..

[38]  Paul Coulton,et al.  Exploring the Evolution of Mobile Augmented Reality for Future Entertainment Systems , 2015, CIE.

[39]  Dimitrios Markouzis,et al.  Interactive Storytelling and Mobile Augmented Reality applications for Learning and Entertainment — A rapid prototyping perspective , 2015, 2015 International Conference on Interactive Mobile Communication Technologies and Learning (IMCL).

[40]  Jonna Häkkilä,et al.  Mobile interaction with visual and RFID tags: a field study on user perceptions , 2007, CHI.

[41]  Jukka Riekki,et al.  NFC-based interactive learning environments for children , 2011, IDC.

[42]  Simon Robinson,et al.  Performative technologies for heritage site regeneration , 2014, Personal and Ubiquitous Computing.

[43]  Lia Litosseliti,et al.  Using focus groups in research , 2003 .

[44]  Tim Hauke Heibel,et al.  A mobile markerless AR system for maintenance and repair , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[45]  Tomáš Jeřábek,et al.  Specifics of Visual Perception of the Augmented Reality in the Context of Education , 2014 .

[46]  Yu-Mei Huang,et al.  Augmented reality in educational activities for children with disabilities , 2016, Displays.

[47]  Ann Morrison,et al.  Like bees around the hive: a comparative study of a mobile augmented reality map , 2009, CHI.

[48]  Matthias Lampe,et al.  Interactive Educational Play with Augmented Toy Environments , 2007, ERCIM News.

[49]  Jorge Bacca,et al.  Augmented Reality Trends in Education: A Systematic Review of Research and Applications , 2014, J. Educ. Technol. Soc..

[50]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[51]  Jeffrey Huang,et al.  Designable visual markers , 2009, CHI.

[52]  M. Lorentzon.  Doing Qualitative Research , 1993 .

[53]  Jared Keengwe,et al.  Mobile learning and integration of mobile technologies in education , 2013, Education and Information Technologies.

[54]  Panos E. Kourouthanassis,et al.  Demystifying the design of mobile augmented reality applications , 2015, Multimedia Tools and Applications.

[55]  Chia-Wen Tsai.  The use of mobile technology and ubiquitous computing for universal access in online education , 2014, Universal Access in the Information Society.

[56]  Chia-Chen Chen,et al.  Animating eco-education: To see, feel, and discover in an augmented reality-based experiential learning environment , 2016, Comput. Educ..

[57]  Yung-Cheol Byun,et al.  The Design and Implementation of Augmented Reality Learning Systems , 2012, 2012 IEEE/ACIS 11th International Conference on Computer and Information Science.

[58]  Vincent Dutot,et al.  Factors influencing Near Field Communication (NFC) adoption: An extended TAM approach , 2015 .

[59]  N. A. A. Aziz,et al.  Providing augmented reality based education for students with attention deficit hyperactive disorder via cloud computing: Its advantages , 2012, 2012 14th International Conference on Advanced Communication Technology (ICACT).

[60]  Chien-Hsu Chen,et al.  Augmented reality-based video-modeling storybook of nonverbal facial cues for children with autism spectrum disorder to improve their perceptions and judgments of facial expressions and emotions , 2016, Comput. Hum. Behav..

[61]  Fengfeng Ke,et al.  Mobile augmented-reality artifact creation as a component of mobile computer-supported collaborative learning , 2015, Internet High. Educ..

[62]  Jonna Häkkilä,et al.  Clothes integrated visual markers as self-expression tool , 2016, MobileHCI Adjunct.