Physical discomfort and eye movements during arbitrary and optical flow-like motions in stereo 3D contents

Users of stereo 3D technology commonly report physical discomfort during or after exposure of stereo 3D contents. The discomfort has been associated with sensation of arbitrary and optical flow-like self-motion. However, there is no information on whether arbitrary motion induces stronger physical discomfort compared with optical flow-like motion. To address this research gap, we investigate physical discomfort among players and spectators of stereo 3D contents using eye tracking and Simulator Sickness Questionnaire. Thirty participants ( $$N=30$$ N = 30 ) acted as players and spectators of a first-person shooter (FPS) and a car racing game. The FPS and the car racing game produce a sensation of arbitrary and optical flow-like self-motion, respectively. Experimental results show that the FPS game induces more severe physical discomfort than its racing counterpart ( $$p<0.0083$$ p < 0.0083 , with a Bonferroni correction to the p value). We also found that severeness of oculomotor symptoms can be predicted using two eye movements metrics: the amount of fixational eye movements and viewing duration at the center of the screen. Our study implies that one should pay particular attention to different types of self-motion in stereo 3D contents regardless of whether the user controls or solely watches the contents. Our study also suggests that physical discomfort can be reduced by decreasing the frequency of fixational eye movements while prolonging the duration of each fixation at the center of screen.

[1]  Joseph J. LaViola,et al.  Evaluating the benefits of 3d stereo in modern video games , 2011, CHI.

[2]  Julia Treleaven,et al.  Simulator sickness incidence and susceptibility during neck motion-controlled virtual reality tasks , 2015, Virtual Reality.

[3]  Christine Fernandez-Maloigne,et al.  Investigation and modeling of visual fatigue caused by S3D content using eye-tracking , 2015, Displays.

[4]  Nancy J. Currie,et al.  A Comparison of Virtual Reality-Based Psychomotor Task Training with Visual and Haptic Aiding , 2017 .

[5]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[6]  R. Hertle,et al.  Vergence nystagmus induced by motion in the ground plane: Normal response characteristics , 2007, Vision Research.

[7]  Heiko Hecht,et al.  Vection is the main contributor to motion sickness induced by visual yaw rotation: Implications for conflict and eye movement theories , 2017, PloS one.

[8]  Mitsuho Yamada,et al.  The Influence on Humans of Long Hours of Viewing 3D Movies , 2012, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[9]  Joseph J. LaViola,et al.  Simultaneous Usage of Several 3DUI Technologies , 2018 .

[10]  R. So,et al.  Effects of Eye Fixation on Visually Induced Motion Sickness , 2011 .

[11]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[12]  Supan Tungjitkusolmun,et al.  Dual‐camera acquisition for accurate measurement of three‐dimensional eye movements , 2013 .

[13]  Kazuhiko Hamamoto,et al.  Design and implementation of gaze tracking headgear for Nvidia 3D Vision® , 2013, 2013 International Conference on Information Technology and Electrical Engineering (ICITEE).

[14]  Joseph J. LaViola,et al.  Stereoscopic 3D for Video Games , 2018 .

[15]  Sunu Wibirama,et al.  Quantifying visual attention and visually induced motion sickness during day-night driving and sleep deprivation , 2015, 2015 International Conference on Data and Software Engineering (ICoDSE).

[16]  R. Hertle,et al.  Version and vergence eye movements in optokinetic nystagmus induced by optic flow , 2010 .

[17]  Marc Erich Latoschik,et al.  Evaluation of Binocular Eye Trackers and Algorithms for 3D Gaze Interaction in Virtual Reality Environments , 2008, J. Virtual Real. Broadcast..

[18]  Vinod Kumar Gupta,et al.  Motion sickness is linked to nystagmus-related trigeminal brain stem input: a new hypothesis. , 2005, Medical hypotheses.

[19]  Terrence L. Chambers,et al.  Real-time simulation for a virtual reality-based MIG welding training system , 2012, Virtual Reality.

[20]  Peter D. Lawrence,et al.  Fixation Precision in High-Speed Noncontact Eye-Gaze Tracking , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Bernard D. Adelstein,et al.  Demand Characteristics in Assessing Motion Sickness in a Virtual Environment: Or Does Taking a Motion Sickness Questionnaire Make You Sick? , 2007, IEEE Transactions on Visualization and Computer Graphics.

[22]  Hiroshi Watanabe,et al.  Effects of stereoscopic presentation on visually induced motion sickness , 2011, Electronic Imaging.

[23]  R. Lubow,et al.  Why is the driver rarely motion sick? The role of controllability in motion sickness. , 1991, Ergonomics.

[24]  J. Golding Motion sickness susceptibility , 2006, Autonomic Neuroscience.

[25]  K. Hoffmann,et al.  Ocular responses to radial optic flow and single accelerated targets in humans , 1999, Vision Research.

[26]  Julie M. Drexler,et al.  Cybersickness is Not Simulator Sickness , 1997 .

[27]  Min Cheol Whang,et al.  Autonomic Nervous System Responses Can Reveal Visual Fatigue Induced by 3D Displays , 2013, Sensors.

[28]  Philip J. Corriveau,et al.  Stereoscopic Viewing and Reported Perceived Immersion and Symptoms , 2012, Optometry and vision science : official publication of the American Academy of Optometry.

[29]  R. Hertle,et al.  Relationships between versional and vergent quick phases of the involuntary version-vergence nystagmus. , 2008, Journal of vision.

[30]  Trevor J. Dodds,et al.  Cultural differences in room size perception , 2017, PloS one.

[31]  Richard J Krauzlis,et al.  Spatial integration by MT pattern neurons: a closer look at pattern-to-component effects and the role of speed tuning. , 2008, Journal of vision.

[32]  Xin Pan,et al.  Enjoy driving from thought in a virtual city , 2017, 2017 36th Chinese Control Conference (CCC).

[33]  P. Howarth,et al.  Heterophoria adaptation during the viewing of 3D stereoscopic stimuli , 2013, Ophthalmic & physiological optics.

[34]  Charles B. Owen,et al.  Review on cybersickness in applications and visual displays , 2016, Virtual Reality.

[35]  Ruzena Bajcsy,et al.  3D teleimmersion for collaboration and interaction of geographically distributed users , 2012, Virtual Reality.

[36]  Marcus Nyström,et al.  Eye tracker data quality: what it is and how to measure it , 2012, ETRA.

[37]  Stephen Palmisano,et al.  Vertical display oscillation effects on forward vection and simulator sickness. , 2007, Aviation, space, and environmental medicine.

[38]  Hiroki Takada,et al.  Comparison in Degree of the Motion Sickness Induced by a 3-D Movie on an LCD and an HMD , 2011, HCI.

[39]  Andrew T. Duchowski,et al.  Eye tracking methodology - theory and practice, 2nd Edition , 2007 .

[40]  Behrang Keshavarz,et al.  Stereoscopic Viewing Enhances Visually Induced Motion Sickness but Sound Does Not , 2012, PRESENCE: Teleoperators and Virtual Environments.

[41]  Kazuhiko Hamamoto,et al.  3D Gaze Tracking on Stereoscopic Display Using Optimized Geometric Method (特集 情報環境と人間の調和に向けた工学技術) , 2014 .

[42]  Alan Kennedy,et al.  Book Review: Eye Tracking: A Comprehensive Guide to Methods and Measures , 2016, Quarterly journal of experimental psychology.

[43]  Eyal Ofek,et al.  IllumiRoom: peripheral projected illusions for interactive experiences , 2013, SIGGRAPH '13.

[44]  Faouzi Alaya Cheikh,et al.  Evaluation of Geometric Depth Estimation Model for Virtual Environment , 2010 .

[45]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[46]  Manfred Tscheligi,et al.  Viewing experience of 3DTV: An exploration of the feeling of sickness and presence in a shopping mall , 2013, Entertain. Comput..

[47]  Kazuhiko Hamamoto,et al.  Investigation of visually induced motion sickness in dynamic 3D contents based on subjective judgment, heart rate variability, and depth gaze behavior , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[48]  Joseph J. LaViola,et al.  A discussion of cybersickness in virtual environments , 2000, SGCH.

[49]  Kazuhiko Hamamoto,et al.  Evaluating 3D gaze tracking in virtual space: A computer graphics approach , 2017, Entertain. Comput..

[50]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[51]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[52]  Hiroki Takada,et al.  Form in Potential Functions While Maintaining an Upright Posture during Exposure to Stereoscopic Video Clips , 2013, HCI.

[53]  Kazuhiko Hamamoto,et al.  Depth gaze and ECG based frequency dynamics during motion sickness in stereoscopic 3D movie , 2018, Entertain. Comput..

[54]  Carmen R. Wilson VanVoorhis,et al.  Understanding Power and Rules of Thumb for Determining Sample Sizes , 2007 .

[55]  Makoto Oki,et al.  Colorful patterns reveal the structures in fluids , 2003, J. Vis..

[56]  H. L. Horne-Moyer,et al.  The Use of Electronic Games in Therapy: a Review with Clinical Implications , 2014, Current Psychiatry Reports.

[57]  Donald H. House,et al.  Online 3D Gaze Localization on Stereoscopic Displays , 2014, TAP.

[58]  Frank Biocca,et al.  Will Simulation Sickness Slow Down the Diffusion of Virtual Environment Technology? , 1992, Presence: Teleoperators & Virtual Environments.

[59]  Sumio Yano,et al.  Visual fatigue caused by stereoscopic images and the search for the requirement to prevent them: A review , 2012, Displays.

[60]  Hiroshi Watanabe,et al.  Visual-vestibular conflict induced by virtual reality in humans , 2003, Neuroscience Letters.