Predicting vection and visually induced motion sickness based on spontaneous postural activity

Evidence is mounting that differences in postural instability can be used to predict who will experience strong illusory self-motions (vection) and become sick when exposed to global patterns of optical flow (e.g., Apthorp et al., PLoS One 9(12):e113897, 2014; Stoffregen and Smart, Brain Res Bull 47:437–448, 1998). This study compared the predictive ability of traditional and recurrence quantification analysis (RQA) based measures of postural activity. We initially measured spontaneous fluctuations in the centre of foot pressure (CoP) of our subjects as they stood quietly with their eyes open and closed. They were then repeatedly exposed to two different types of self-motion display. As expected, the oscillating self-motion displays were found to induce stronger vection and greater sickness than the smooth self-motion displays. RQA based measures of spontaneous postural activity proved to be superior predictors of both vection strength and visually induced motion sickness (VIMS). Participants who had displayed lower CoP recurrence rates when standing quietly were more likely to later report stronger vection and VIMS when exposed to both types of optical flow. Vection strength (but not VIMS) was also found to correlate significantly with three other RQA based measures of postural activity (determinism, entropy, and average diagonal line length). We propose that these RQA based measures of spontaneous postural activity could serve as useful diagnostic tools for evaluating who will benefit the most/least from exposure to virtual environments.

[1]  T. Stoffregen,et al.  Sex differences in visual performance and postural sway precede sex differences in visually induced motion sickness , 2015, Experimental Brain Research.

[2]  Thomas A. Stoffregen,et al.  The virtual reality head-mounted display Oculus Rift induces motion sickness and is sexist in its effects , 2017, Experimental Brain Research.

[3]  F H Previc,et al.  A comparison of the latencies of visually induced postural change and self-motion perception. , 1990, Journal of vestibular research : equilibrium & orientation.

[4]  Karl M. Newell,et al.  Short-term non-stationarity and the development of postural control , 1997 .

[5]  Thomas A. Stoffregen,et al.  Motion sickness considered as a movement disorder , 2011 .

[6]  T. Stoffregen,et al.  Console video games, postural activity, and motion sickness during passive restraint , 2013, Experimental Brain Research.

[7]  Thomas A. Stoffregen,et al.  Motion control, motion sickness, and the postural dynamics of mobile devices , 2014, Experimental Brain Research.

[8]  Reza Fazel-Rezai,et al.  Changes in dynamical characteristics of epileptic EEG in rats using recurrence quantification analysis , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  F. Tjernström,et al.  Romberg ratio in quiet stance posturography--Test to retest reliability. , 2015, Gait & posture.

[10]  Heiko Hecht,et al.  Vection is the main contributor to motion sickness induced by visual yaw rotation: Implications for conflict and eye movement theories , 2017, PloS one.

[11]  Stephen Palmisano,et al.  Spontaneous postural sway predicts the strength of smooth vection , 2014, Experimental Brain Research.

[12]  T. Stoffregen,et al.  An ecological Theory of Motion Sickness and Postural Instability , 1991 .

[13]  Eric R Muth,et al.  Nausea induced by vection drum: contributions of body position, visual pattern, and gender. , 2008, Aviation, space, and environmental medicine.

[14]  Jennifer L. Campos,et al.  Demonstrating the Potential for Dynamic Auditory Stimulation to Contribute to Motion Sickness , 2014, PloS one.

[15]  M. Riley,et al.  Motion sickness, body movement, and claustrophobia during passive restraint , 2007, Experimental Brain Research.

[16]  Stephen A. Palmisano,et al.  Vection Change Exacerbates Simulator Sickness in Virtual Environments , 2008, PRESENCE: Teleoperators and Virtual Environments.

[17]  Jürgen Kurths,et al.  Recurrence plots for the analysis of complex systems , 2009 .

[18]  L. Yardley,et al.  Relationship between postural control and motion sickness in healthy subjects , 1998, Brain Research Bulletin.

[19]  A. Bronstein,et al.  Vection increases the magnitude and accuracy of visually evoked postural responses , 2002, Experimental Brain Research.

[20]  J. Westfall,et al.  Effects of spatial frequency of a vertically striped rotating drum on vection-induced motion sickness. , 1997, Aviation, space, and environmental medicine.

[21]  M. Griffin,et al.  Optokinetic stimuli: motion sickness, visual acuity, and eye movements. , 2002, Aviation, space, and environmental medicine.

[22]  Juno Kim,et al.  Horizontal fixation point oscillation and simulated viewpoint oscillation both increase vection in depth. , 2012, Journal of vision.

[23]  Behrang Keshavarz,et al.  Validating an Efficient Method to Quantify Motion Sickness , 2011, Hum. Factors.

[24]  Masahiro Takei,et al.  Human resource development and visualization , 2009, J. Vis..

[25]  Moira B. Flanagan,et al.  The role of vection, eye movements and postural instability in the etiology of motion sickness. , 2004, Journal of vestibular research : equilibrium & orientation.

[26]  J. Dichgans,et al.  Visual-Vestibular Interaction: Effects on Self-Motion Perception and Postural Control , 1978 .

[27]  Benoît G. Bardy,et al.  Stance Width Influences Postural Stability and Motion Sickness , 2010 .

[28]  Timothy P. McNamara,et al.  Self-motion illusions (vection) in VR — Are they good for anything? , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[29]  Richard H. Y. So,et al.  The Relationship between Spatial Velocity, Vection, and Visually Induced Motion Sickness: An Experimental Study , 2011, i-Perception.

[30]  David N. Lee.  Visual proprioceptive control of stance , 1975 .

[31]  Richard H. Y. So,et al.  Isolating the Effects of Vection and Optokinetic Nystagmus on Optokinetic Rotation-Induced Motion Sickness , 2009, Hum. Factors.

[32]  Stephen A. Palmisano,et al.  Vection and cybersickness generated by head-and-display motion in the Oculus Rift , 2017, Displays.

[33]  R. Barry,et al.  Future challenges for vection research: definitions, functional significance, measures, and neural bases , 2015, Front. Psychol..

[34]  Stephen Palmisano,et al.  Vertical display oscillation effects on forward vection and simulator sickness. , 2007, Aviation, space, and environmental medicine.

[35]  Bernhard E. Riecke,et al.  Comparing the effectiveness of different displays in enhancing illusions of self-movement (vection) , 2015, Front. Psychol..

[36]  Stephen Palmisano,et al.  The Role of Perceived Speed in Vection: Does Perceived Speed Modulate the Jitter and Oscillation Advantages? , 2014, PloS one.

[37]  Moira B. Flanagan,et al.  Motion Sickness, Console Video Games, and Head-Mounted Displays , 2007, Hum. Factors.

[38]  F. Bonato,et al.  Simulated viewpoint jitter shakes sensory conflict accounts of vection. , 2011, Seeing and perceiving.

[39]  Michael D'Zmura,et al.  Cybersickness without the wobble: Experimental results speak against postural instability theory. , 2017, Applied ergonomics.

[40]  Benoît G. Bardy,et al.  Getting Your Sea Legs , 2013, PloS one.

[41]  M. Turvey,et al.  Recurrence quantification analysis of postural fluctuations. , 1999, Gait & posture.

[42]  T. Stoffregen,et al.  Postural activity and motion sickness during video game play in children and adults , 2011, Experimental Brain Research.

[43]  Moira B. Flanagan,et al.  Postural Instability and Motion Sickness in a Virtual Moving Room , 2008, Hum. Factors.

[44]  J. Dichgans,et al.  Some methods and parameters of body sway quantification and their neurological applications , 2004, Archiv für Psychiatrie und Nervenkrankheiten.

[45]  K. Shockley,et al.  Application of Recurrence Quantification Analysis : Influence of Cognitive Activity on Postural Fluctuations , 2004 .

[46]  Benoît G. Bardy,et al.  Visually Induced Motion Sickness Predicted by Postural Instability , 2002, Hum. Factors.

[47]  R. Riener,et al.  Journal of Neuroengineering and Rehabilitation Open Access Biofeedback for Robotic Gait Rehabilitation , 2022 .

[48]  Gary E. Riccio,et al.  Visually Induced Motion Sickness in Virtual Environments , 1992, Presence: Teleoperators & Virtual Environments.

[49]  G. H. Crampton,et al.  The differential effect of a rotary visual field on susceptibles and nonsusceptibles to motion sickness. , 1953, Journal of comparative and physiological psychology.

[50]  Bernard D. Adelstein,et al.  Demand Characteristics of a Questionnaire Used to Assess Motion Sickness in a Virtual Environment , 2006, IEEE Virtual Reality Conference (VR 2006).

[51]  Bernhard E. Riecke,et al.  Compelling Self-Motion Through Virtual Environments Without Actual Self-Motion – Using Self-Motion Illusions ('Vection') to Improve VR User Experience , 2010 .

[52]  Stephen Palmisano,et al.  Expanding and Contracting Optic-Flow Patterns and Vection , 2008, Perception.

[53]  Jennifer L. Campos,et al.  Vection and visually induced motion sickness: how are they related? , 2015, Front. Psychol..

[54]  Jason D. Moss,et al.  Characteristics of Head-Mounted Displays and Their Effects on Simulator Sickness , 2011, Hum. Factors.

[55]  K. Ukai,et al.  Visually induced motion sickness with radial displays: effects of gaze angle and fixation. , 2007, Aviation, space, and environmental medicine.

[56]  J. Golding.  Predicting individual differences in motion sickness susceptibility by questionnaire , 2006 .

[57]  Juno Kim,et al.  Simulated Angular Head Oscillation Enhances Vection in Depth , 2012, Perception.

[58]  Kay M. Stanney,et al.  Handbook of Virtual Environments - Design, Implementation, and Applications, Second Edition , 2014, Handbook of Virtual Environments, 2nd ed..

[59]  Thomas A Stoffregen,et al.  Body load and the postural precursors of motion sickness. , 2014, Gait & posture.

[60]  Margaret D. Nolan,et al.  Vection and simulator sickness. , 1990, Military psychology : the official journal of the Division of Military Psychology, American Psychological Association.

[61]  Juno Kim,et al.  Effects of gaze on vection from jittering, oscillating, and purely radial optic flow , 2009, Attention, perception & psychophysics.

[62]  Xiaoli Li,et al.  Dynamical characteristics of pre-epileptic seizures in rats with recurrence quantification analysis , 2004 .

[63]  Lori Ann Vallis,et al.  The relationship between postural stability and virtual environment adaptation , 2008, Neuroscience Letters.

[64]  Michael W. Haas,et al.  Postural Instability and Motion Sickness in a Fixed-Base Flight Simulator , 2000, Hum. Factors.

[65]  M. van der Schoot,et al.  The developmental onset of symbolic approximation: beyond nonsymbolic representations, the language of numbers matters , 2015, Front. Psychol..

[66]  Heiko Hecht,et al.  Visually Induced Motion Sickness: Causes, Characteristics, and Countermeasures , 2014, Handbook of Virtual Environments, 2nd ed..

[67]  Yoichi Yokota,et al.  Motion sickness susceptibility associated with visually induced postural instability and cardiac autonomic responses in healthy subjects , 2005, Acta oto-laryngologica.

[68]  Hiroyasu Ujike,et al.  Effects of visually simulated roll motion on vection and postural stabilization , 2007, Journal of NeuroEngineering and Rehabilitation.

[69]  T. Stoffregen,et al.  Postural instability precedes motion sickness , 1998, Brain Research Bulletin.

[70]  T. Seno,et al.  Vection aftereffects from expanding/contracting stimuli. , 2010, Seeing and perceiving.

[71]  Stephen Palmisano,et al.  Accelerating Self-Motion Displays Produce More Compelling Vection in Depth , 2008, Perception.

[72]  D. Apthorp,et al.  The Shepard–Risset glissando: music that moves you , 2017, Experimental Brain Research.

[73]  Timothy P. McNamara,et al.  More than a cool illusion? Functional significance of self-motion illusion (circular vection) for perspective switches , 2015, Front. Psychol..

[74]  Jennifer L. Campos,et al.  Passive Restraint Reduces Visually Induced Motion Sickness in Older Adults , 2017, Journal of experimental psychology. Applied.

[75]  Moira B. Flanagan,et al.  Motion Sickness and Postural Sway in Console Video Games , 2008, Hum. Factors.

[76]  Juno Kim,et al.  Effects of active and passive viewpoint jitter on vection in depth , 2008, Brain Research Bulletin.

[77]  Elise Faugloire,et al.  Motion sickness preceded by unstable displacements of the center of pressure. , 2006, Human movement science.

[78]  J. Norman.  Two visual systems and two theories of perception: An attempt to reconcile the constructivist and ecological approaches. , 2001, The Behavioral and brain sciences.

[79]  Stephen Palmisano,et al.  Effects of Simulated Viewpoint Jitter on Visually Induced Postural Sway , 2009, Perception.

[80]  T A Furness,et al.  The use of an independent visual background to reduce simulator side-effects. , 1999, Aviation, space, and environmental medicine.

[81]  Charles B. Owen,et al.  Review on cybersickness in applications and visual displays , 2016, Virtual Reality.

[82]  Stephen Palmisano,et al.  Chaos in Balance: Non-Linear Measures of Postural Control Predict Individual Variations in Visual Illusions of Motion , 2014, PloS one.

[83]  A. El-Jaroudi,et al.  Time-frequency analysis of postural sway , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[84]  M. Griffin,et al.  Eye movement, vection, and motion sickness with foveal and peripheral vision. , 2003, Aviation, space, and environmental medicine.

[85]  Moira B. Flanagan,et al.  Optokinetic nystagmus, vection, and motion sickness. , 2002, Aviation, space, and environmental medicine.

[86]  Shoji Sunaga,et al.  Temporonasal motion projected on the nasal retina underlies expansion–contraction asymmetry in vection , 2010, Vision Research.

[87]  Ben D. Lawson,et al.  Motion Sickness Symptomatology and Origins , 2014, Handbook of Virtual Environments, 2nd ed..

[88]  B. Riecke.  Compelling Self-Motion Through Virtual Environments without Actual Self-Motion – Using Self-Motion Illusions (“Vection”) to Improve User Experience in VR , 2011 .