The Effect of Apparent Latency on Simulator Sickness While Using a See-Through Helmet-Mounted Display

Objective: The aim of this study was to determine the effect of head movement frequency and predictive compensation on (a) latency produced in a monocular see-through helmet-mounted display (HMD) test bed and (b) simulator sickness experienced by users wearing the HMD. Background: There is conflicting research regarding latency as a significant factor in the onset of simulator sickness. Predictive compensation has been shown to mitigate the magnitude of latency, but little is known about the extent of its effect on simulator sickness. Method: A video camera recorded HMD and simulator imagery to accurately measure apparent latency produced at three head movement frequencies. Predictive compensation strategies were manipulated to measure the difference in apparent latency produced by the test bed in various conditions. Similar methodology was employed with human participants to measure simulator sickness experienced by users of this test bed. Results: In Experiment 1, apparent latency increased significantly as head movement frequency increased. Predictive compensation strategies significantly reduced apparent latency present in the test bed. In Experiment 2, predictive compensation significantly reduced the magnitude of simulator sickness. Conclusion: Predictive compensation can be effectively implemented to reduce apparent latency, resulting in a lower magnitude of simulator sickness. Application: Potential applications include HMD use in which head position is tracked and visual imagery is linked to head or body movement, such as in virtual and augmented reality systems, and is thus critical to functionality and performance.

[1]  D'nardo Colucci,et al.  Perception in HMDs: what is it in head-mounted displays (HMDs) that really make them all so terrible? , 1998, Defense, Security, and Sensing.

[2]  Bernard D. Adelstein,et al.  Head Tracking Latency in Virtual Environments: Psychophysics and a Model , 2003 .

[3]  Bernard D. Adelstein,et al.  Demand Characteristics of a Questionnaire Used to Assess Motion Sickness in a Virtual Environment , 2006, IEEE Virtual Reality Conference (VR 2006).

[4]  R WilsonJohn,et al.  Virtual Reality-Induced Symptoms and Effects (VRISE) , 1999 .

[5]  Regan Ec,et al.  The frequency of occurrence and severity of side-effects of immersion virtual reality. , 1994 .

[6]  Cheryl M Hein.  Driving Simulators: Six Years of Hands-On Experience at Hughes Aircraft Company , 1993 .

[7]  Rs Kennedy,et al.  A simulator sickness questionnaire (SSQ) : A new method for quantifying simulator sickness , 1993 .

[8]  R. Kennedy,et al.  The effects of visual deprivation on adaptation to a rotating environment , 1965 .

[9]  David M Johnson,et al.  Introduction to and Review of Simulator Sickness Research , 2005 .

[10]  Thomas B. Sheridan,et al.  Remote Manipulative Control with Transmission Delay , 1963 .

[11]  E. C. Regan,et al.  The frequency of occurrence and severity of side-effects of immersion virtual reality. , 1994, Aviation, space, and environmental medicine.

[12]  A GRAYBIEL,et al.  MOTION SICKNESS SYMPTOMATOLOGY OF LABYRINTHINE DEFECTIVE AND NORMAL SUBJECTS DURING ZERO GRAVITY MANEUVERS. , 1964, Aerospace medicine.

[13]  Clare Regan,et al.  An investigation into nausea and other side-effects of head-coupled immersive virtual reality , 1995, Virtual Reality.

[14]  Jae Y. Jurg.  DISCRIMINABILITY OF PREDICTION ARTIFACTS IN A TIME-DELAYED VIRTUAL ENVIRONMENT , 1999 .

[15]  Robert S. Allison,et al.  Tolerance of temporal delay in virtual environments , 2001, Proceedings IEEE Virtual Reality 2001.

[16]  Jason D. Moss,et al.  Perceptual thresholds for display lag in a real visual environment are not affected by field of view or psychophysical technique , 2010, Displays.

[17]  R S Kennedy,et al.  Simulator sickness in U.S. Navy flight simulators. , 1989, Aviation, space, and environmental medicine.

[18]  Jason D. Moss,et al.  Characteristics of Head-Mounted Displays and Their Effects on Simulator Sickness , 2011, Hum. Factors.

[19]  Rjv Bertin,et al.  Objective Measurement of Simulator Sickness and the Role of Visual-Vestibular Conflict Situations , 2004 .

[20]  James R. Lackner,et al.  Circumventing Side Effects of Immersive Virtual Environments , 1997, HCI.

[21]  Ramsey Ad.  Virtual Reality induced symptoms and effects : a psychophysiological perspective. , 1999 .

[22]  John E. Deaton,et al.  Mitigation of System Latency in Next Generation Helmet Mounted Display Systems (Nghmds) , 2011 .

[23]  W. Bles,et al.  Motion sickness. , 2000, Current opinion in neurology.

[24]  M. Young,et al.  Discrimination of Changes of Latency during Voluntary Hand Movement of Virtual Objects , 1999 .

[25]  D G Watt,et al.  "Torso rotation" experiments; 1: Adaptation to motion sickness does not correlate with changes in VOR gain. , 1996, Journal of vestibular research : equilibrium & orientation.

[26]  Randy J. Pagulayan,et al.  Self-induced motion sickness in unperturbed stance , 1998, Brain Research Bulletin.

[27]  Joseph J. LaViola,et al.  A discussion of cybersickness in virtual environments , 2000, SGCH.

[28]  Paul C. Knox,et al.  The Effect of a Projected Virtual Reality Training Environment on Vision Symptoms in Undergraduates , 2010 .

[29]  J. Reason.  Motion sickness: a special case of sensory rearrangement. , 1970, Advancement of science.

[30]  Katerina Mania,et al.  Perceptual sensitivity to head tracking latency in virtual environments with varying degrees of scene complexity , 2004, APGV '04.

[31]  Randy F. Pausch,et al.  A Literature Survey for Virtual Environments: Military Flight Simulator Visual Systems and Simulator Sickness , 1992, Presence: Teleoperators & Virtual Environments.

[32]  Richard H. Y. So.  An investigation of the effects of lags on motion sickness with a head-coupled visual display , 1994 .

[33]  Reason Jt.  Motion sickness: a special case of sensory rearrangement. , 1970, Advancement of science.

[34]  Mark H. Draper,et al.  Effects of Image Scale and System Time Delay on Simulator Sickness within Head-Coupled Virtual Environments , 2001, Hum. Factors.

[35]  M G Braithwaite,et al.  Simulator sickness in an army simulator. , 1990, The Journal of the Society of Occupational Medicine.

[36]  Eric R. Muth,et al.  Simulator Sickness during Head Mounted Display (HMD) of Real World Video Captured Scenes , 2008 .

[37]  Craig A. Mertler,et al.  Advanced and multivariate statistical methods: Practical application and interpretation: Sixth edition , 2001 .

[38]  N. Mcbrien,et al.  Effects of a Head-Mounted Display on the Oculomotor System of Children , 2009, Optometry and vision science : official publication of the American Academy of Optometry.

[39]  C. E. Rash,et al.  Helmet-mounted Displays: Sensation, Perception, and Cognition Issues , 2009 .

[40]  T. Stoffregen,et al.  An ecological Theory of Motion Sickness and Postural Instability , 1991 .

[41]  Gavin S. P. Miller,et al.  A real-time low-latency hardware light-field renderer , 1999, SIGGRAPH.

[42]  J T Reason,et al.  Motion Sickness Adaptation: A Neural Mismatch Model 1 , 1978, Journal of the Royal Society of Medicine.

[43]  Konrad Pesudovs,et al.  The development of a symptom questionnaire for assessing virtual reality viewing using a head-mounted display. , 2005, Optometry and vision science : official publication of the American Academy of Optometry.

[44]  Peter A. Hancock,et al.  Human Factors in Simulation and Training , 2008 .

[45]  Ming Ouhyoung,et al.  On latency compensation and its effects on head-motion trajectories in virtual environments , 2000, The Visual Computer.

[46]  Robert S. Bolia,et al.  ASSESSING SIMULATOR SICKNESS IN A SEE-THROUGH HMD: EFFECTS OF TIME DELAY, TIME ON TASK, AND TASK COMPLEXITY , 2000 .

[47]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .