Sick Moves! Motion Parameters as Indicators of Simulator Sickness

We explore motion parameters, more specifically gait parameters, as an objective indicator to assess simulator sickness in Virtual Reality (VR). We discuss the potential relationships between simulator sickness, immersion, and presence. We used two different camera pose (position and orientation) estimation methods for the evaluation of motion tasks in a large-scale VR environment: a simple model and an optimized model that allows for a more accurate and natural mapping of human senses. Participants performed multiple motion tasks (walking, balancing, running) in three conditions: a physical reality baseline condition, a VR condition with the simple model, and a VR condition with the optimized model. We compared these conditions with regard to the resulting sickness and gait, as well as the perceived presence in the VR conditions. The subjective measures confirmed that the optimized pose estimation model reduces simulator sickness and increases the perceived presence. The results further show that both models affect the gait parameters and simulator sickness, which is why we further investigated a classification approach that deals with non-linear correlation dependencies between gait parameters and simulator sickness. We argue that our approach could be used to assess and predict simulator sickness based on human gait parameters and we provide implications for future research.

[1]  David Moore,et al.  Rapid, Continuous Movement Between Nodes as an Accessible Virtual Reality Locomotion Technique , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[2]  Robert S. Bolia,et al.  ASSESSING SIMULATOR SICKNESS IN A SEE-THROUGH HMD: EFFECTS OF TIME DELAY, TIME ON TASK, AND TASK COMPLEXITY , 2000 .

[3]  Michael Philippsen,et al.  Human Compensation Strategies for Orientation Drifts , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[4]  Richard H. Bartels,et al.  Interpolating splines with local tension, continuity, and bias control , 1984, SIGGRAPH.

[5]  Eric R. Muth,et al.  The effects of display delay on simulator sickness , 2011, Displays.

[6]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[7]  K Postema,et al.  Effects of interventions on normalizing step width during self-paced dual-belt treadmill walking with virtual reality, a randomised controlled trial. , 2017, Gait & posture.

[8]  Hrishikesh M. Rao,et al.  Exploring the effects of image persistence in low frame rate virtual environments , 2015, 2015 IEEE Virtual Reality (VR).

[9]  J. Thayer,et al.  The continuing problem of false positives in repeated measures ANOVA in psychophysiology: a multivariate solution. , 1987, Psychophysiology.

[10]  Andy T. K. Ho,et al.  A Metric to Quantify Virtual Scene Movement for the Study of Cybersickness: Definition, Implementation, and Verification , 2001, Presence: Teleoperators & Virtual Environments.

[11]  Björn Eskofier,et al.  Stride Segmentation during Free Walk Movements Using Multi-Dimensional Subsequence Dynamic Time Warping on Inertial Sensor Data , 2015, Sensors.

[12]  Mel Slater,et al.  Taking steps: the influence of a walking technique on presence in virtual reality , 1995, TCHI.

[13]  Clare Regan,et al.  An investigation into nausea and other side-effects of head-coupled immersive virtual reality , 1995, Virtual Reality.

[14]  Frank Steinicke,et al.  Human Walking in Virtual Environments: Perception, Technology, and Applications , 2013 .

[15]  E. Goffman The Presentation of Self in Everyday Life , 1959 .

[16]  Mel Slater,et al.  How Colorful Was Your Day? Why Questionnaires Cannot Assess Presence in Virtual Environments , 2004, Presence: Teleoperators & Virtual Environments.

[17]  Marc Erich Latoschik,et al.  Towards comparable evaluation methods and measures for timing behavior of virtual reality systems , 2016, VRST.

[18]  Mel Slater,et al.  A note on presence terminology , 2003 .

[19]  Carrie Heater,et al.  Being There: The Subjective Experience of Presence , 1992, Presence: Teleoperators & Virtual Environments.

[20]  J. Rieser,et al.  Sensitivity to Perspective Structure While Walking without Vision , 1986, Perception.

[21]  Michael Philippsen,et al.  Head-to-Body-Pose Classification in No-Pose VR Tracking Systems , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[22]  Mel Slater,et al.  Measuring Presence: A Response to the Witmer and Singer Presence Questionnaire , 1999, Presence.

[23]  Jeffrey M. Hausdorff,et al.  Virtual reality for gait training: can it induce motor learning to enhance complex walking and reduce fall risk in patients with Parkinson's disease? , 2011, The journals of gerontology. Series A, Biological sciences and medical sciences.

[24]  Daniel Roth,et al.  Simulator Sick but Still Immersed: A Comparison of Head-Object Collision Handling and Their Impact on Fun, Immersion, and Simulator Sickness , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[25]  K. E. Thomley,et al.  Development of Postural Equilibrium Tests for Examining Environmental Effects , 1986 .

[26]  Kenton R Kaufman,et al.  Spatiotemporal gait deviations in a virtual reality environment. , 2006, Gait & posture.

[27]  R S Kennedy,et al.  Use of a motion sickness history questionnaire for prediction of simulator sickness. , 1992, Aviation, space, and environmental medicine.

[28]  N. Stergiou,et al.  Human movement variability, nonlinear dynamics, and pathology: is there a connection? , 2011, Human movement science.

[29]  Michael Meehan,et al.  Physiological measures of presence in stressful virtual environments , 2002, SIGGRAPH.

[30]  Gerd Bruder,et al.  Walking in Virtual Reality , 2017, ACM Trans. Appl. Percept..

[31]  Christopher Curry,et al.  Real-time visual feedback about postural activity increases postural instability and visually induced motion sickness. , 2018, Gait & posture.

[32]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[33]  Albert A. Rizzo,et al.  Is clinical virtual reality ready for primetime? , 2017, Neuropsychology.

[34]  Mark S. Dennison,et al.  Use of physiological signals to predict cybersickness , 2016, Displays.

[35]  E. Noé,et al.  Feasibility of a walking virtual reality system for rehabilitation: objective and subjective parameters , 2016, Journal of NeuroEngineering and Rehabilitation.

[36]  R. So,et al.  Cybersickness in the presence of scene rotational movements along different axes. , 2001, Applied ergonomics.

[37]  D Mickelson Manual for Eye Examination and Diagnosis , 2001, The American orthoptic journal.

[38]  Behrang Keshavarz,et al.  Validating an Efficient Method to Quantify Motion Sickness , 2011, Hum. Factors.

[39]  M. Whitton,et al.  Effect of latency on presence in stressful virtual environments , 2003, IEEE Virtual Reality, 2003. Proceedings..

[40]  Frank Biocca,et al.  Immersive virtual reality technology , 1995 .

[41]  K Uyama,et al.  Locomotion and motion sickness during horizontally and vertically reversed vision. , 1991, Aviation, space, and environmental medicine.

[42]  Samuel J. Reinfelder,et al.  Wearable sensors objectively measure gait parameters in Parkinson’s disease , 2017, PloS one.

[43]  Alessandro De Luca,et al.  CyberWalk: Enabling unconstrained omnidirectional walking through virtual environments , 2008, ACM Trans. Appl. Percept..

[44]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[45]  James M. Shine,et al.  Investigating motor initiation and inhibition deficits in patients with Parkinson’s disease and freezing of gait using a virtual reality paradigm , 2016, Neuroscience.

[46]  Jason R Franz,et al.  Do kinematic metrics of walking balance adapt to perturbed optical flow? , 2017, Human movement science.

[47]  Enrico Rukzio,et al.  Demo of the Matrix Has You: Realizing Slow Motion in Full-Body Virtual Reality , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[48]  Mel Slater,et al.  Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[49]  Wenlong Zhang,et al.  Classification of Neurological Gait Disorders Using Multi-task Feature Learning , 2016, 2017 IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE).

[50]  Jennifer L. Campos,et al.  Vection and visually induced motion sickness: how are they related? , 2015, Front. Psychol..

[51]  Mel Slater,et al.  Simulating virtual environments within virtual environments as the basis for a psychophysics of presence , 2010, ACM Trans. Graph..

[52]  M. Whitton,et al.  Review of Four Studies on the Use of Physiological Reaction as a Measure of Presence in StressfulVirtual Environments , 2005, Applied psychophysiology and biofeedback.

[53]  Kay M. Stanney,et al.  Postural instability induced by virtual reality exposure: Development of a certification protocol , 1996, Int. J. Hum. Comput. Interact..

[54]  Eugenia M. Kolasinski,et al.  Simulator Sickness in Virtual Environments. , 1995 .

[55]  K. Hamilton,et al.  Limitations of postural equilibrium tests for examining simulator sickness. , 1989, Aviation, space, and environmental medicine.

[56]  John G Nutt,et al.  Higher‐level gait disorders: An open frontier , 2013, Movement disorders : official journal of the Movement Disorder Society.

[57]  Marc Erich Latoschik,et al.  Beyond Replication: Augmenting Social Behaviors in Multi-User Virtual Realities , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[58]  Angelo M. Sabatini,et al.  A Machine Learning Framework for Gait Classification Using Inertial Sensors: Application to Elderly, Post-Stroke and Huntington’s Disease Patients , 2016, Sensors.

[59]  Carl Machover,et al.  Virtual reality , 1994, IEEE Computer Graphics and Applications.

[60]  Kenton R Kaufman,et al.  Does walking in a virtual environment induce unstable gait? An examination of vertical ground reaction forces. , 2007, Gait & posture.

[61]  Gerd Bruder,et al.  Biomechanical analysis of (non-)isometric virtual walking of older adults , 2017, 2017 IEEE Virtual Reality (VR).

[62]  Frédéric Merienne,et al.  New VR Navigation Techniques to Reduce Cybersickness , 2017, ERVR.

[63]  Kay M. Stanney,et al.  Gender Differences in Visually Induced Motion Sickness , 2002 .

[64]  Julie M. Drexler,et al.  Cybersickness is Not Simulator Sickness , 1997 .

[65]  Jack R Engsberg,et al.  Development of a novel virtual reality gait intervention. , 2017, Gait & posture.

[66]  Julia Kastner,et al.  Introduction to Robust Estimation and Hypothesis Testing , 2005 .

[67]  Christian Wietfeld,et al.  ATLAS - an open-source TDOA-based Ultra-wideband localization system , 2016, 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[68]  Bjoern M. Eskofier,et al.  Mobile Stride Length Estimation With Deep Convolutional Neural Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[69]  Dave Pape,et al.  Video-Based Measurement of System Latency , 2000 .

[70]  Joseph J. LaViola,et al.  A discussion of cybersickness in virtual environments , 2000, SGCH.

[71]  Rjv Bertin,et al.  Objective Measurement of Simulator Sickness and the Role of Visual-Vestibular Conflict Situations , 2004 .

[72]  Mary C. Whitton,et al.  Walking > walking-in-place > flying, in virtual environments , 1999, SIGGRAPH.

[73]  Gerd Bruder,et al.  Analyses of Gait Parameters of Younger and Older Adults During (Non-)Isometric Virtual Walking , 2018, IEEE Transactions on Visualization and Computer Graphics.

[74]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[75]  Charles B. Owen,et al.  Review on cybersickness in applications and visual displays , 2016, Virtual Reality.

[76]  Yang-Sheng Chen,et al.  Estimating the simulator sickness in immersive virtual reality with optical flow analysis , 2017, SIGGRAPH ASIA.

[77]  Daniel Wolf,et al.  A Real-Time Tracking System for Football Match and Training Analysis , 2011 .

[78]  Anselmo Lastra,et al.  From Motion to Photons in 80 Microseconds: Towards Minimal Latency for Virtual and Augmented Reality , 2016, IEEE Transactions on Visualization and Computer Graphics.

[79]  Yong Man Ro,et al.  Measurement of exceptional motion in VR video contents for VR sickness assessment using deep convolutional autoencoder , 2017, VRST.

[80]  Heinrich H. Bülthoff,et al.  Gait Parameters while Walking in a Head-mounted Display Virtual Environment and the Real World , 2007, EGVE.

[81]  Edward D. Lemaire,et al.  Temporal-spatial gait parameter models of very slow walking. , 2018, Gait & posture.

[82]  Michael J. Singer,et al.  The Factor Structure of the Presence Questionnaire , 2005, Presence: Teleoperators & Virtual Environments.

[83]  Mary C. Whitton,et al.  A Survey of Presence and Related Concepts , 2017, ACM Comput. Surv..

[84]  Richard Baker,et al.  The history of gait analysis before the advent of modern computers. , 2007, Gait & posture.