[POSTER] Prevention of Visually Induced Motion Sickness Based on Dynamic Real-Time Content-Aware Non-salient Area Blurring

This paper proposes an innovative method for reducing the visually induced motion sickness (MS) occurred in a 3D immersive virtual environment (VE) by utilizing a flexible dynamic scene smoothing approach based on saliency analysis. A saliency model based on fully convolutional network (FCN) is first trained to establish the saliency map, then the probability maps representing the salient information and the non-salient information are combined to alter the field of view (FOV) by smoothing the non-salient area. An experiment is conducted to evaluate the performance of the proposed approach. The experimental data demonstrate that participants experiencing dynamic blurring VE reports a 50% reduction of the severity of MS symptom on average during the VR experience than the participants experiencing the control condition, which show that the proposed approach can be used to effectively prevent the visually induced MS in VR and support longer duration of users in VE.

[1]  C. Oman,et al.  Motion sickness: a synthesis and evaluation of the sensory conflict theory. , 1990, Canadian journal of physiology and pharmacology.

[2]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[3]  James R. Lackner,et al.  Circumventing Side Effects of Immersive Virtual Environments , 1997, HCI.

[4]  Randy J. Pagulayan,et al.  Postural stabilization of looking. , 1999 .

[5]  Henry Been-Lirn Duh,et al.  Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment , 2002, Proceedings IEEE Virtual Reality 2002.

[6]  C. Jerome,et al.  The Effects of Presence and Time of Exposure on Simulator Sickness , 2005 .

[7]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[8]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[9]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, SIGGRAPH 2008.

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  J. Golding,et al.  Motion sickness and disorientation in vehicles , 2013 .

[14]  A. Bronstein,et al.  Vertigo and Dizziness from Environmental Motion: Visual Vertigo, Motion Sickness, and Drivers' Disorientation , 2013, Seminars in Neurology.

[15]  E. Ressiot,et al.  Prospective study on the efficacy of optokinetic training in the treatment of seasickness. , 2013, European annals of otorhinolaryngology, head and neck diseases.

[16]  Trevor Darrell,et al.  Fully convolutional networks for semantic segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Gerd Bruder,et al.  Visual blur in immersive virtual environments: does depth of field or motion blur affect distance and speed estimation? , 2016, VRST.

[18]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[19]  Huchuan Lu,et al.  Kernelized Subspace Ranking for Saliency Detection , 2016, ECCV.

[20]  Jeremy N. Bailenson,et al.  How Immersive Is Enough? A Meta-Analysis of the Effect of Immersive Technology on User Presence , 2016 .

[21]  Steven K. Feiner,et al.  Combating VR sickness through subtle dynamic field-of-view modification , 2016, 2016 IEEE Symposium on 3D User Interfaces (3DUI).