Eyestrain impacts on learning job interview with a serious game in virtual reality: a randomized double-blinded study

Purpose: This study explores eyestrain and its possible impacts on learning performances and quality of experience using different apparatuses and imaging. Materials and Methods: 69 participants played a serious game simulating a job interview with a Samsung Gear VR Head Mounted Display (HMD) or a computer screen. The study was conducted according to a double-blinded protocol. Participants were randomly assigned to 3 groups: PC, HMD biocular and HMD stereoscopy (S3D). Participants played the game twice, allowing between group analyses. Eyestrain was assessed pre- and post-exposure on a chin-head rest with optometric measures. Learning traces were obtained in-game by registering response time and scores. Quality of experience was measured with questionnaires assessing Presence, Flow and Visual Comfort. Results: eyestrain was significantly higher with HMDs than PC based on Punctum Proximum of accommodation and visual acuity variables and tends to be higher with S3D. Learning was more efficient in HMDs conditions based on time for answering but the group with stereoscopy performed lower than the binocular imaging one. Quality of Experience was better based on visual discomfort with the PC condition than with HMDs. Conclusion: learning expected answers from a job interview is more efficient while using HMDs than a computer screen. However, eyestrain tends to be higher while using HMDs and S3D. The quality of experience was also negatively impacted with HMDs compared to computer screen. Not using S3D or lowering its impact should be explored to provide comfortable learning experience.1

[1]  Claudia Schrader,et al.  The influence of virtual presence: Effects on experienced cognitive load and learning outcomes in educational computer games , 2012, Comput. Hum. Behav..

[2]  Wijnand A. IJsselsteijn,et al.  Effects of Sensory Information and Prior Experience on Direct Subjective Ratings of Presence , 1999, Presence: Teleoperators & Virtual Environments.

[3]  Peter A. Howarth,et al.  Visual fatigue caused by viewing stereoscopic motion images: Background, theories, and observations , 2008, Displays.

[4]  F. Okano,et al.  Repeated vergence adaptation causes the decline of visual functions in watching stereoscopic television , 2005, Journal of Display Technology.

[5]  S E Morse,et al.  Oculomotor function after virtual reality use differentiates symptomatic from asymptomatic individuals. , 1999, Optometry and vision science : official publication of the American Academy of Optometry.

[6]  Timothy D Wilson,et al.  Application of stereoscopic visualization on surgical skill acquisition in novices , 2013, Journal of surgical education.

[7]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[8]  D'nardo Colucci,et al.  Perception in HMDs: what is it in head-mounted displays (HMDs) that really make them all so terrible? , 1998, Defense, Security, and Sensing.

[9]  Mark Mon-Williams,et al.  Binocular Virtual Reality Displays: When Problems Do and Don't Occur , 1998, Hum. Factors.

[10]  岩崎 常人.  Effects of a visual task with cognitive demand on dynamic and steady-state accommodation , 1993 .

[11]  Venceslas Biri,et al.  Cross-benefits between virtual reality and games , 2008 .

[12]  Joseph R Keebler,et al.  Effects Of 3d Stereoscopy, Visuo-spatial Working Memory, And Perceptions Of Simulation Experience On The Memorization Of Confusable Objects , 2011 .

[13]  Ji-Soo Kim.  Research on Efficient Usage of 3D Stereoscopic Technology , 2010 .

[14]  Isabelle Hupont,et al.  How do new visual immersive systems influence gaming QoE? A use case of serious gaming with Oculus Rift , 2015, 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX).

[15]  M. Csíkszentmihályi.  Flow: The Psychology of Optimal Experience , 1990 .

[16]  Guido Makransky,et al.  Development and validation of the Multimodal Presence Scale for virtual reality environments: A confirmatory factor analysis and item response theory approach , 2017, Comput. Hum. Behav..

[17]  Evelyne Berger.  3 Apprentissage et interactions en classe de langue , 2016 .

[18]  HamariJuho,et al.  Challenging games help students learn , 2016 .

[19]  Mark Mon-Williams,et al.  Natural problems for stereoscopic depth perception in virtual environments , 1995, Vision Research.

[20]  Yoshio Yamagishi,et al.  Effects of Stereoscopic 3D Contents on the Process of Learning to Build a Handmade PC , 2011 .

[21]  T. Franklin Waddell,et al.  Psychological and Physiological Responses to Stereoscopic 3D Presentation in Handheld Digital Gaming: Comparing the Experiences of Frequent and Infrequent Game Players , 2014, PRESENCE: Teleoperators and Virtual Environments.

[22]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[23]  Jacob Rosenberg,et al.  Three-dimensional laparoscopy vs 2-dimensional laparoscopy with high-definition technology for abdominal surgery: a systematic review. , 2017, American journal of surgery.

[24]  E. Salas,et al.  Human Factors : The Journal of the Human Factors and Ergonomics Society , 2012 .

[25]  D. Hoang.  FLOW: The Psychology of Optimal Experience , 2018 .

[26]  Eduardo Salas,et al.  Game-based Learning: The Impact of Flow State and Videogame Self-efficacy , 2010 .

[27]  Mahmoud Maqableh,et al.  A Review on Stereoscopic 3D: Home Entertainment for the Twenty First Century , 2014 .

[28]  Hee-Sun Lee,et al.  The Effect of Two-dimensional and Stereoscopic Presentation on Middle School Students’ Performance of Spatial Cognition Tasks , 2010 .

[29]  Shawn A. Weil,et al.  From Gaming to Training: A Review of Studies on Fidelity, Immersion, Presence, and Buy-in and Their Effects on Transfer in PC-Based Simulations and Games , 2005 .

[30]  Yongtian Wang,et al.  Effects of using HMDs on visual fatigue in virtual environments , 2017, 2017 IEEE Virtual Reality (VR).

[31]  Jodi Asbell-Clarke,et al.  Challenging games help students learn: An empirical study on engagement, flow and immersion in game-based learning , 2016, Comput. Hum. Behav..

[32]  Maria V. Sanchez-Vives,et al.  From presence to consciousness through virtual reality , 2005, Nature Reviews Neuroscience.

[33]  S K Rushton,et al.  Developing visual systems and exposure to virtual reality and stereo displays: some concerns and speculations about the demands on accommodation and vergence. , 1999, Applied ergonomics.

[34]  Mary L. Broad.  Overview of Transfer of Training: From Learning to Performance , 2008 .

[35]  N. Mcbrien,et al.  Effects of a Head-Mounted Display on the Oculomotor System of Children , 2009, Optometry and vision science : official publication of the American Academy of Optometry.

[36]  John P. McIntire,et al.  What is 3D good for? A review of human performance on stereoscopic 3D displays , 2012, Defense + Commercial Sensing.

[37]  Rustin Webster,et al.  Declarative knowledge acquisition in immersive virtual learning environments , 2016, Interact. Learn. Environ..

[38]  Hee-Sun Lee,et al.  Comparing Short- and Long-Term Learning Effects between Stereoscopic and Two-Dimensional Film at a Planetarium. , 2015 .

[39]  Eric Jamet,et al.  Effects of Stereoscopic Display on Learning and User Experience in an Educational Virtual Environment , 2017, Int. J. Hum. Comput. Interact..

[40]  Hiroshi Watanabe,et al.  3D visual fatigue: Interaction between ranges of binocular disparity and interocular crosstalk , 2015, 2015 IEEE 4th Global Conference on Consumer Electronics (GCCE).

[41]  Robert J. Stone,et al.  Evolution of aerospace simulation: From immersive Virtual Reality to serious games , 2011, Proceedings of 5th International Conference on Recent Advances in Space Technologies - RAST2011.

[42]  Daniel Thalmann,et al.  An evaluation of spatial presence, social presence, and interactions with various 3D displays , 2016, CASA.

[43]  Jeremy N. Bailenson,et al.  How Immersive Is Enough? A Meta-Analysis of the Effect of Immersive Technology on User Presence , 2016 .

[44]  Byron J. Pierce,et al.  Perceptual Issues in the Use of Head-Mounted Visual Displays , 2006, Hum. Factors.

[45]  Stefano Livi,et al.  Visual discomfort while watching stereoscopic three‐dimensional movies at the cinema , 2015, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[46]  C. Schor,et al.  A dynamic model of cross-coupling between accommodation and convergence: simulations of step and frequency responses. , 1992, Optometry and vision science : official publication of the American Academy of Optometry.

[47]  Joseph J. LaViola,et al.  Evaluating user performance in 3D stereo and motion enabled video games , 2012, FDG.

[48]  Jari Takatalo,et al.  User Experience in 3D Stereoscopic Games , 2011 .

[49]  M. Mon-Williams,et al.  Binocular vision in a virtual world: visual deficits following the wearing of a head‐mounted display , 1993, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[50]  T Iwasaki,et al.  Effects of a visual task with cognitive demand on dynamic and steady‐state accommodation , 1993, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[51]  Samuel S. Silva,et al.  Head-mounted display versus desktop for 3D navigation in virtual reality: a user study , 2008, Multimedia Tools and Applications.

[52]  Robert S Allison,et al.  Stereoscopy and the Human Visual System. , 2011, SMPTE motion imaging journal.

[53]  Eric D. Ragan,et al.  Higher Levels of Immersion Improve Procedure Memorization Performance , 2009, EGVE/ICAT/EuroVR.

[54]  S. Engeser,et al.  Flow, performance and moderators of challenge-skill balance , 2008 .