Demonstrating the Potential for Dynamic Auditory Stimulation to Contribute to Motion Sickness

Auditory cues can create the illusion of self-motion (vection) in the absence of visual or physical stimulation. The present study aimed to determine whether auditory cues alone can also elicit motion sickness and how auditory cues contribute to motion sickness when added to visual motion stimuli. Twenty participants were seated in front of a curved projection display and were exposed to a virtual scene that constantly rotated around the participant's vertical axis. The virtual scene contained either visual-only, auditory-only, or a combination of corresponding visual and auditory cues. All participants performed all three conditions in a counterbalanced order. Participants tilted their heads alternately towards the right or left shoulder in all conditions during stimulus exposure in order to create pseudo-Coriolis effects and to maximize the likelihood for motion sickness. Measurements of motion sickness (onset, severity), vection (latency, strength, duration), and postural steadiness (center of pressure) were recorded. Results showed that adding auditory cues to the visual stimuli did not, on average, affect motion sickness and postural steadiness, but it did reduce vection onset times and increased vection strength compared to pure visual or pure auditory stimulation. Eighteen of the 20 participants reported at least slight motion sickness in the two conditions including visual stimuli. More interestingly, six participants also reported slight motion sickness during pure auditory stimulation and two of the six participants stopped the pure auditory test session due to motion sickness. The present study is the first to demonstrate that motion sickness may be caused by pure auditory stimulation, which we refer to as “auditorily induced motion sickness”.

[1]  Kay M. Stanney,et al.  Handbook of Virtual Environments - Design, Implementation, and Applications, Second Edition , 2014, Handbook of Virtual Environments, 2nd ed..

[2]  Heiko Hecht,et al.  Visually Induced Motion Sickness: Causes, Characteristics, and Countermeasures , 2014, Handbook of Virtual Environments, 2nd ed..

[3]  Marc M. Sebrechts,et al.  HANDBOOK OF VIRTUAL ENVIRONMENTS , 2014 .

[4]  Jennifer L. Campos,et al.  Combined effects of auditory and visual cues on the perception of vection , 2014, Experimental Brain Research.

[5]  H. Hecht,et al.  Visually induced motion sickness and presence in videogames: The role of sound , 2012 .

[6]  Y. Nakajima,et al.  Perceptually Plausible Sounds Facilitate Visually Induced Self-Motion Perception (Vection) , 2012, Perception.

[7]  Behrang Keshavarz,et al.  Stereoscopic Viewing Enhances Visually Induced Motion Sickness but Sound Does Not , 2012, PRESENCE: Teleoperators and Virtual Environments.

[8]  Behrang Keshavarz,et al.  Validating an Efficient Method to Quantify Motion Sickness , 2011, Hum. Factors.

[9]  Emanuel Schmider,et al.  Is It Really Robust , 2010 .

[10]  Julie M. Drexler,et al.  Research in visually induced motion sickness. , 2010, Applied ergonomics.

[11]  T. Stoffregen,et al.  The Postural Responses to a Moving Environment of Adults who are Blind , 2010 .

[12]  A. Väljamäe Auditorily-induced illusory self-motion: A review , 2009, Brain Research Reviews.

[13]  Richard H. Y. So,et al.  Isolating the Effects of Vection and Optokinetic Nystagmus on Optokinetic Rotation-Induced Motion Sickness , 2009, Hum. Factors.

[14]  Bernhard E. Riecke,et al.  Moving sounds enhance the visually-induced self-motion illusion (circular vection) in virtual reality , 2009, TAP.

[15]  Bernhard E. Riecke,et al.  Auditory self-motion illusions ("circular vection") can be facilitated by vibrations and the potential for actual motion , 2008, APGV '08.

[16]  Stephen A. Palmisano,et al.  Vection Change Exacerbates Simulator Sickness in Virtual Environments , 2008, PRESENCE: Teleoperators and Virtual Environments.

[17]  C. Gordon,et al.  Motion sickness: advances in pathogenesis, prediction, prevention, and treatment. , 2006, Aviation, space, and environmental medicine.

[18]  M. Alessandrini,et al.  Posturography frequency analysis of sound-evoked body sway in normal subjects , 2006, European Archives of Oto-Rhino-Laryngology and Head & Neck.

[19]  Moira B. Flanagan,et al.  The role of vection, eye movements and postural instability in the etiology of motion sickness. , 2004, Journal of vestibular research : equilibrium & orientation.

[20]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[21]  Benoît G. Bardy,et al.  Visually Induced Motion Sickness Predicted by Postural Instability , 2002, Hum. Factors.

[22]  S Ino,et al.  The influence of moving auditory stimuli on standing balance in healthy young adults and the elderly , 2001, Ergonomics.

[23]  John R. Wilson,et al.  Measurement of presence and its consequences in virtual environments , 2000, Int. J. Hum. Comput. Stud..

[24]  J. Lackner,et al.  Auditory cues for orientation and postural control in sighted and congenitally blind people , 1998, Experimental Brain Research.

[25]  S M Ebenholtz,et al.  The possible role of nystagmus in motion sickness: a hypothesis. , 1994, Aviation, space, and environmental medicine.

[26]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[27]  Sheldon M. Ebenholtz,et al.  Motion Sickness and Oculomotor Systems in Virtual Environments , 1992, Presence: Teleoperators & Virtual Environments.

[28]  T. Stoffregen,et al.  An ecological Theory of Motion Sickness and Postural Instability , 1991 .

[29]  Gary E. Riccio,et al.  An Ecological Critique of the Sensory Conflict Theory of Motion Sickness , 1991 .

[30]  Yang Td,et al.  Motion sickness severity under interaction of vection and head movements. , 1991 .

[31]  G. H. Crampton,et al.  Motion and Space Sickness , 1990 .

[32]  J T Reason,et al.  Motion Sickness Adaptation: A Neural Mismatch Model 1 , 1978, Journal of the Royal Society of Medicine.

[33]  J R Lackner,et al.  Optokinetic motion sickness: continuous head movements attenuate the visual induction of apparent self-rotation and symptoms of motion sickness. , 1977, Aviation, space, and environmental medicine.

[34]  J. Lackner,et al.  Induction of illusory self-rotation and nystagmus by a rotating sound-field. , 1977, Aviation, space, and environmental medicine.

[35]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[36]  J. Dichgans,et al.  Optokinetic motion sickness and pseudo-Coriolis effects induced by moving visual stimuli. , 1973, Acta oto-laryngologica.

[37]  Ashton Graybiel,et al.  Comparison of five levels of motion sickness severity as the basis for grading susceptibility , 1970 .

[38]  Collins We Coriolis vestibular stimulation and the influence of different visual surrounds. , 1968 .

[39]  Behrang Keshavarz,et al.  Illusory Self-Motion in Virtual Environments , 2014, Handbook of Virtual Environments, 2nd ed..

[40]  P. Mamassian,et al.  Multisensory processing in review: from physiology to behaviour. , 2010, Seeing and perceiving.

[41]  Willem Bles,et al.  Motion sickness induced by optokinetic drums. , 2004, Aviation, space, and environmental medicine.

[42]  W. Bles,et al.  Motion sickness. , 2000, Current opinion in neurology.

[43]  Kay M. Stanney,et al.  Postural instability induced by virtual reality exposure: Development of a certification protocol , 1996, Int. J. Hum. Comput. Interact..

[44]  Margaret D. Nolan,et al.  Vection and simulator sickness. , 1990, Military psychology : the official journal of the Division of Military Psychology, American Psychological Association.

[45]  W Bles,et al.  Circular vection and human posture, II. Does the auditory system play a role? , 1977, Agressologie: revue internationale de physio-biologie et de pharmacologie appliquees aux effets de l'agression.

[46]  W. E. Collins Coriolis vestibular stimulation and the influence of different visual surrounds. , 1968, Aerospace medicine.

[47]  P. Hennebert,et al.  [Audiokinetic nystagmus]. , 1960, Acta oto-laryngologica.