Interactive and Immersive Learning Using 360° Virtual Reality Contents on Mobile Platforms

Recent advances in mobile virtual reality (VR) devices have paved the way for various VR applications in education. This paper presents a novel authoring framework for mobile VR contents and a play-based learning model for marine biology education. For interactive and immersive mobile VR contents, we develop a multilayer 360° VR representation with image-based interactions such as mesh deformation and water simulation, which enable users to realistically interact with 360° panoramic contents without consuming excessive computational resources. On the basis of this representation, we design and implement play-based learning scenarios to increase the interactivity and immersion of users. Then, we verify the effectiveness of our educational scenarios using a user study in terms of user-created VR contents, interactivity, and immersion. The results show that more experienced elements in VR contents improve the immersion of users and make them more actively involved.

[1]  Zhichao Dong,et al.  Smooth assembled mappings for large-scale real walking , 2017, ACM Trans. Graph..

[2]  M. Ott,et al.  ON IMMERSIVE VIRTUAL REALITY IN EDUCATION : STATE OF THE ART AND PERSPECTIVES , 2015 .

[3]  Li-Yi Wei,et al.  Mapping virtual and physical reality , 2016, ACM Trans. Graph..

[4]  Thorsten Grosch,et al.  Natural Environment Illumination: Coherent Interactive Augmented Reality for Mobile and Non-Mobile Devices , 2017, IEEE Transactions on Visualization and Computer Graphics.

[5]  Paul A. Cairns,et al.  Measuring and defining the experience of immersion in games , 2008, Int. J. Hum. Comput. Stud..

[6]  Mel Slater,et al.  A note on presence terminology , 2003 .

[7]  Thomas Cochrane,et al.  Mobile VR in Education: From the Fringe to the Mainstream , 2016, Int. J. Mob. Blended Learn..

[8]  Eelke Folmer,et al.  VR-STEP: Walking-in-Place using Inertial Sensing for Hands Free Navigation in Mobile VR Environments , 2016, CHI.

[9]  Markus H. Gross,et al.  Panoramic Video from Unstructured Camera Arrays , 2015, Comput. Graph. Forum.

[10]  Doug A. Bowman,et al.  Virtual Reality: How Much Immersion Is Enough? , 2007, Computer.

[11]  Taehyun Rhee,et al.  Perceptually Optimised Illumination for Seamless Composites , 2014, PG.

[12]  Jorge Martín-Gutiérrez,et al.  Virtual Technologies Trends in Education , 2017 .

[13]  Bing-Yu Chen,et al.  High‐resolution 360 Video Foveated Stitching for Real‐time VR , 2017, Comput. Graph. Forum.

[14]  Chris Dede,et al.  Immersive Interfaces for Engagement and Learning , 2009, Science.

[15]  Jorge Martín-Gutiérrez,et al.  Editorial: Learning Strategies in Engineering Education Using Virtual and Augmented Reality Technologies , 2017 .

[16]  Jeanne H. Brockmyer,et al.  The Development of the Game Engagement Questionnaire: A Measure of Engagement in Video Game Playing: Response to Reviews , 2009, Interacting with computers.

[17]  Taehyun Rhee,et al.  MR360: Mixed Reality Rendering for 360° Panoramic Videos , 2017, IEEE Transactions on Visualization and Computer Graphics.

[18]  Younghui Kim,et al.  Rich360 , 2016, ACM Trans. Graph..

[19]  Andrew Gardner,et al.  Photorealistic rendering of mixed reality scenes , 2015, Comput. Graph. Forum.

[20]  Simon Richir,et al.  Proposition and Validation of a Questionnaire to Measure the User Experience in Immersive Virtual Environments , 2016, Int. J. Virtual Real..

[21]  Teresa Chambel,et al.  Get around 360° hypervideo , 2010, MindTrek.