Queasy Rider: How Head Movements Influence Motion Sickness in Passenger Use of Head-Mounted Displays

In autonomous cars, drivers will spend more time on non-driving-related activities. Getting their hands off the wheel and eyes off the road, the driver, similar to a rear-seat passenger today, can use multiple built-in displays for such activities or even mobile head-mounted displays (HMDs) in virtual reality (VR). A wider motion range is known to increase engagement, but might also amplify the risk of motion sickness while switching between displays. In a rear-seat VR field study (N=21) on a city highway, we found a head movement range of ± 50° with a speed of 1.95m/s to provide the best trade-off between motion sickness and engagement. Compared to the pitch (Y) axis, movement around the yaw (X) axis induced less discomfort and more engagement with less motion sickness. Our work provides a concrete starting point for future research on self-driving carsickness, starting from today’s rear-seat passengers.

[1]  Cyriel Diels,et al.  Looking forward: In-vehicle auxiliary display positioning affects carsickness. , 2018, Applied ergonomics.

[2]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[3]  Markku Tukiainen,et al.  Gaze interaction enhances problem solving: Effects of dwell-time based, gaze-augmented, and mouse interaction on problem-solving strategies and user experience , 2009 .

[4]  H. Leibowitz,et al.  Tachygastria and motion sickness. , 1985, Aviation, space, and environmental medicine.

[5]  Cyriel Diels,et al.  Frequency Characteristics of Visually Induced Motion Sickness , 2013, Hum. Factors.

[6]  T. Wyss,et al.  RR interval signal quality of a heart rate monitor and an ECG Holter at rest and during exercise , 2019, European Journal of Applied Physiology.

[7]  I. Scott MacKenzie,et al.  A Fitts' law study of click and dwell interaction by gaze, head and mouse with a head-mounted display , 2018, COGAIN@ETRA.

[8]  Bob Cheung,et al.  Perspectives of electrogastrography and motion sickness , 1998, Brain Research Bulletin.

[9]  Shun'ichi Doi,et al.  Can Passengers’ Active Head Tilt Decrease the Severity of Carsickness? , 2012, Hum. Factors.

[10]  Niels Henze,et al.  Virtual reality on the go?: a study on social acceptance of VR glasses , 2018, MobileHCI Adjunct.

[11]  Masahito Hirakawa,et al.  Effectiveness of a Head Movement Interface for Steering a Vehicle in a Virtual Reality Driving Simulation , 2020, Symmetry.

[12]  Daniel Vogel,et al.  Cross-Car, Multiplayer Games for Semi-Autonomous Driving , 2019, CHI PLAY.

[13]  Elena Mugellini,et al.  Wearable Technologies for Automotive User Interfaces: Danger or Opportunity? , 2014, AutomotiveUI.

[14]  Stephen A. Brewster,et al.  I Am The Passenger: How Visual Motion Cues Can Influence Sickness For In-Car VR , 2017, CHI.

[15]  Julie R. Williamson,et al.  PlaneVR: Social Acceptability of Virtual Reality for Aeroplane Passengers , 2019, CHI.

[16]  F. Shaffer,et al.  An Overview of Heart Rate Variability Metrics and Norms , 2017, Front. Public Health.

[17]  Thereza Schmelter,et al.  Analysis of Interaction Spaces for VR in Public Transport Systems , 2020, 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW).

[18]  Hideyuki Takagi,et al.  Virtual reality environment design of managing both presence and virtual reality sickness. , 2004, Journal of physiological anthropology and applied human science.

[19]  Voicu Popescu,et al.  MotionReader: Visual Acceleration Cues for Alleviating Passenger E-Reader Motion Sickness , 2017, AutomotiveUI.

[20]  Enrico Rukzio,et al.  CarVR: Enabling In-Car Virtual Reality Entertainment , 2017, CHI.

[21]  Bastian Pfleging,et al.  A Wizard of Oz Field Study to Understand Non-Driving-Related Activities, Trust, and Acceptance of Automated Vehicles , 2020, AutomotiveUI.

[22]  Andreas Riener,et al.  Sick of Scents: Investigating Non-invasive Olfactory Motion Sickness Mitigation in Automated Driving , 2020, AutomotiveUI.

[23]  Holger Regenbrecht,et al.  The Experience of Presence: Factor Analytic Insights , 2001, Presence: Teleoperators & Virtual Environments.

[24]  Wendy Ju,et al.  Driving with the Fishes , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[25]  Andreas Butz,et al.  Rear-Seat Productivity in Virtual Reality: Investigating VR Interaction in the Confined Space of a Car , 2021, Multimodal Technol. Interact..

[26]  M J Griffin,et al.  Motion sickness in public road transport: passenger behavior and susceptibility. , 1999, Ergonomics.

[27]  W. Bles,et al.  Motion sickness. , 2000, Current opinion in neurology.

[28]  Jelte E. Bos,et al.  User interface considerations to prevent self-driving carsickness , 2015, AutomotiveUI.

[29]  Andreas Butz,et al.  An Exploration of Users’ Thoughts on Rear-Seat Productivity in Virtual Reality , 2020, AutomotiveUI.

[30]  Alexander Meschtscherjakov,et al.  Motion Sickness Prevention System (MSPS): Reading Between the Lines , 2016, AutomotiveUI.

[31]  Methodical recommendations USE KARDiVAR SYSTEM FOR DETERMINATION OF THE STRESS LEVEL AND ESTIMATION OF THE BODY ADAPTABILITY Standards of measurements and physiological interpretation , 2009 .

[32]  Eyal M. Reingold,et al.  Selection By Looking: A Novel Computer Interface And Its Application To Psychological Research , 1995 .

[33]  A. Bronstein,et al.  Vertigo and Dizziness from Environmental Motion: Visual Vertigo, Motion Sickness, and Drivers' Disorientation , 2013, Seminars in Neurology.

[34]  Gerard J. Kim,et al.  RoadVR: Mitigating the Effect of Vection and Sickness by Distortion of Pathways for In-Car Virtual Reality , 2020, VRST.

[35]  Stephen A. Brewster,et al.  Virtual reality passenger experiences , 2019, AutomotiveUI.

[36]  Albrecht Schmidt,et al.  Virtual Field Studies: Conducting Studies on Public Displays in Virtual Reality , 2020, CHI.

[37]  Jieyun Yin,et al.  Electrogastrography: Methodology, Validation and Applications , 2013, Journal of neurogastroenterology and motility.

[38]  P K Ahnelt,et al.  The photoreceptor mosaic , 1998, Eye.

[39]  S. Pietraszek,et al.  The simultaneous recording and analysis both EGG and HRV signals , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[40]  Stephen Brewster,et al.  Expanding the Bounds of Seated Virtual Workspaces , 2020, ACM Trans. Comput. Hum. Interact..

[41]  Stephen Brewster,et al.  Challenges in passenger use of mixed reality headsets in cars and other transportation , 2019, Virtual Reality.

[42]  Cyriel Diels,et al.  Self-driving carsickness. , 2016, Applied ergonomics.

[43]  Martin Schrepp,et al.  Design and Evaluation of a Short Version of the User Experience Questionnaire (UEQ-S) , 2017, Int. J. Interact. Multim. Artif. Intell..

[44]  Alexander Meschtscherjakov,et al.  Bubble Margin: Motion Sickness Prevention While Reading on Smartphones in Vehicles , 2019, INTERACT.

[45]  Philipp Wintersberger,et al.  AutoWork 2020: Second Workshop on the Future of Work and Well-Being in Automated Vehicles , 2020, AutomotiveUI.

[46]  Kay M. Stanney,et al.  Locus of User-Initiated Control in Virtual Environments: Influences on Cybersickness , 1998, Presence.

[47]  Kazuhito Kato,et al.  Improvement of Ease of Viewing Images on an In-vehicle Display and Reduction of Carsickness , 2008 .

[48]  Jelte E. Bos,et al.  A theory on visually induced motion sickness , 2008, Displays.

[49]  Jonas Haeling,et al.  In-Car 6-DoF Mixed Reality for Rear-Seat and Co-Driver Entertainment , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[50]  Maria Isabel Saludares,et al.  Interaction techniques using head gaze for virtual reality , 2016, 2016 IEEE Region 10 Symposium (TENSYMP).

[51]  Kazuhito Kato,et al.  A Study of Carsickness of Rear-seat Passengers due to Acceleration and Deceleration when Watching an In-vehicle Display , 2006 .

[52]  Stephen A. Brewster,et al.  AutoWork 2019: workshop on the future of work and well-being in automated vehicles , 2019, AutomotiveUI.

[53]  Tobias Hecht,et al.  What Do You Do? An Analysis of Non-driving Related Activities During a 60 Minutes Conditionally Automated Highway Drive , 2019, IHIET.

[54]  Hiroyuki Kajimoto,et al.  COMS-VR: Mobile virtual reality entertainment system using electric car and head-mounted display , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[55]  Raimund Dachselt,et al.  Designing gaze-based user interfaces for steering in virtual environments , 2012, ETRA.

[56]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[57]  John Paulin Hansen,et al.  Gaze typing in virtual reality: impact of keyboard design, selection method, and motion , 2018, ETRA.

[58]  Bastian Pfleging,et al.  Investigating user needs for non-driving-related activities during automated driving , 2016, MUM.

[59]  Jelte E. Bos,et al.  A visual display enhancing comfort by counteracting airsickness , 2011, Displays.

[60]  Julie M. Drexler,et al.  Cybersickness is Not Simulator Sickness , 1997 .

[61]  R. Lubow,et al.  Why is the driver rarely motion sick? The role of controllability in motion sickness. , 1991, Ergonomics.

[62]  J. Williamson,et al.  PlaneVR , 2019, Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems.

[63]  F. Schmäl,et al.  Neuronal Mechanisms and the Treatment of Motion Sickness , 2013, Pharmacology.

[64]  M. Griffin,et al.  Motion sickness in public road transport: the relative importance of motion, vision and individual differences. , 1999, British journal of psychology.