Setting up Virtual Reality and Augmented Reality Learning Environment in Unity

We propose a framework and a setup for presenting complex models for curriculum contents in both augmented reality and virtual reality environment. After constructing some three-dimensional models representing real world objects such as trees, stones, rivers, dams, and buildings, our workflow uses the Unity engine in combination with Virtual Reality headset devices to create interactive applications for both Virtual Reality and Augmented Reality environments to support students understanding the curriculum contents through their surrounding. Typical challenges are addressed when creating 3D curriculum contents, integrating these models into Unity and solutions are proposed where possible. The overall structure of the project is described with some functionalities added to Unity for visualization and interaction with the models.

[1]  Barbara Rangel Carvalho,et al.  Virtual and augmented reality game-based applications to civil engineering education , 2017, 2017 IEEE Global Engineering Education Conference (EDUCON).

[2]  Matthew Berland,et al.  Computational Thinking in the Wild: Uncovering Complex Collaborative Thinking through Gameplay. , 2016 .

[3]  Carlos Santos,et al.  Design for Collaboration in Mixed Reality: Technical Challenges and Solutions , 2016, 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES).

[4]  Zhongning Guo,et al.  Application of Augmented Reality in Engineering Graphics Education , 2011, 2011 IEEE International Symposium on IT in Medicine and Education.

[5]  E. Kokkelenberg,et al.  Who succeeds in STEM studies? An analysis of Binghamton University undergraduate students , 2010 .

[6]  Ken Perlin,et al.  [Computer Graphics]: Three-Dimensional Graphics and Realism , 2022 .

[7]  Jeff Dodick,et al.  High School Students’ Understanding of the Human Body System , 2013 .

[8]  N. Orion,et al.  System Thinking Skills at the Elementary School Level. , 2009 .

[9]  Danielle Oprean,et al.  iVR for the geosciences , 2017, 2017 IEEE Virtual Reality Workshop on K-12 Embodied Learning through Virtual & Augmented Reality (KELVAR).

[10]  Kazunori Miyata,et al.  An educational framework for creating VR application through groupwork , 2010, Comput. Graph..

[11]  David G. Moursund,et al.  Computational Thinking and Math Maturity: Improving Math Education in K-8 Schools , 2006 .

[12]  Stefania Serafin,et al.  Considerations on the use of virtual and augmented reality technologies in music education , 2017, 2017 IEEE Virtual Reality Workshop on K-12 Embodied Learning through Virtual & Augmented Reality (KELVAR).

[13]  Benjamin B. Bederson,et al.  CTArcade: Computational thinking with games in school age children , 2014, Int. J. Child Comput. Interact..

[14]  F. Raia.  Causality in Complex Dynamic Systems: A Challenge in Earth Systems Science Education , 2008 .

[15]  Michael S. Horn,et al.  Bringing Computational Thinking Into High School Mathematics and Science Classrooms , 2016, ICLS.

[16]  Rafael Bidarra,et al.  A Survey of Procedural Methods for Terrain Modelling , 2009 .

[17]  David C. Webb,et al.  Scalable game design and the development of a checklist for getting computational thinking into public schools , 2010, SIGCSE.

[18]  Florica Moldoveanu,et al.  3D Model Generation of Human Musculoskeletal System Based on Image Processing: An Intermediary Step while Developing a Learning Solution Using Virtual and Augmented Reality , 2017, 2017 21st International Conference on Control Systems and Computer Science (CSCS).

[19]  HeintzFredrik,et al.  Computational thinking for all , 2018 .

[20]  Jeannette M. Wing.  An introduction to computer science for non-majors using principles of computation , 2007, SIGCSE.

[21]  John Messner,et al.  Using Virtual Reality to Improve Construction Engineering Education , 2003 .

[22]  Sabarish V. Babu,et al.  Programming moves: Design and evaluation of applying embodied interaction in virtual environments to enhance computational thinking in middle school students , 2016, 2016 IEEE Virtual Reality (VR).

[23]  Robert M. Panoff.  Computational thinking for all: the power and the peril , 2014, SIGCSE '14.