Rear-Seat Productivity in Virtual Reality: Investigating VR Interaction in the Confined Space of a Car

Ubiquitous technology lets us work in flexible and decentralised ways. Passengers can already use travel time to be productive, and we envision even better performance and experience in vehicles with emerging technologies, such as virtual reality (VR) headsets. However, the confined physical space constrains interactions while the virtual space may be conceptually borderless. We therefore conducted a VR study (N = 33) to examine the influence of physical restraints and virtual working environments on performance, presence, and the feeling of safety. Our findings show that virtual borders make passengers touch the car interior less, while performance and presence are comparable across conditions. Although passengers prefer a secluded and unlimited virtual environment (nature), they are more productive in a shared and limited one (office). We further discuss choices for virtual borders and environments, social experience, and safety responsiveness. Our work highlights opportunities and challenges for future research and design of rear-seat VR interaction.

[1]  Michael F. Bunting,et al.  Working memory span tasks: A methodological review and user’s guide , 2005, Psychonomic bulletin & review.

[2]  David J. Bryant,et al.  Model for Situation Awareness and Driving: Application to Analysis and Research for Intelligent Transportation Systems , 2001 .

[3]  Mark Blythe,et al.  Research through design fiction: narrative in real and imaginary abstracts , 2014, CHI.

[4]  Mary C. Whitton,et al.  A Survey of Presence and Related Concepts , 2017, ACM Comput. Surv..

[5]  Kay M. Stanney,et al.  Duration and Exposure to Virtual Environments: Sickness Curves During and Across Sessions , 2000, Presence: Teleoperators & Virtual Environments.

[6]  Myounghoon Jeon,et al.  Spindex (Speech Index) Improves Auditory Menu Acceptance and Navigation Performance , 2011, TACC.

[7]  Florian Alt,et al.  Should I Interrupt or Not?: Understanding Interruptions in Head-Mounted Display Settings , 2019, Conference on Designing Interactive Systems.

[8]  Kenneth Hugdahl,et al.  A Standard Computerized Version of the Reading Span Test in Different Languages , 2008 .

[9]  Ralph Schroeder.  Social Interaction in Virtual Environments: Key Issues, Common Themes, and a Framework for Research , 2005 .

[10]  Stephen A. Brewster,et al.  I Am The Passenger: How Visual Motion Cues Can Influence Sickness For In-Car VR , 2017, CHI.

[11]  Julie R. Williamson,et al.  PlaneVR: Social Acceptability of Virtual Reality for Aeroplane Passengers , 2019, CHI.

[12]  J. Golding,et al.  Behavioral methods of alleviating motion sickness: effectiveness of controlled breathing and a music audiotape. , 2006, Journal of travel medicine.

[13]  Christian Mai.  Get to the Head: Why We Currently Miss the Full Potential of Head-Mounted Displays in Vehicles , 2019 .

[14]  Enrico Rukzio,et al.  CarVR: Enabling In-Car Virtual Reality Entertainment , 2017, CHI.

[15]  Niels Henze,et al.  Notification in VR: The Effect of Notification Placement, Task and Environment , 2019, CHI PLAY.

[16]  Gunnar Stevens,et al.  Using Time and Space Efficiently in Driverless Cars: Findings of a Co-Design Study , 2019, CHI.

[17]  K. Laumann,et al.  The Use of Virtual Reality Alone Does Not Promote Training Performance (but Sense of Presence Does) , 2020, Frontiers in Psychology.

[18]  Wendy Ju,et al.  Driving with the Fishes , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[19]  David Bissell.  Understanding the impacts of commuting: research report for stakeholders , 2015 .

[20]  Hans-Werner Gellersen,et al.  Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences , 2015, CHI.

[21]  Philipp Wintersberger,et al.  Type-o-Steer: Reimagining the Steering Wheel for Productive Non-Driving Related Tasks in Conditionally Automated Vehicles , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[22]  Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles , 2022 .

[23]  Philipp Wintersberger,et al.  Text Comprehension: Heads-Up vs. Auditory Displays: Implications for a Productive Work Environment in SAE Level 3 Automated Vehicles , 2019, AutomotiveUI.

[24]  Mengyao Li,et al.  Defining A Design Space of The Auto-Mobile Office: A Computational Abstraction Hierarchy Analysis , 2020 .

[25]  Stephen Brewster,et al.  Acoustic Transparency and the Changing Soundscape of Auditory Mixed Reality , 2020, CHI.

[26]  Linda Ng Boyle,et al.  Exploring the concept of the (future) mobile office , 2019, AutomotiveUI.

[27]  Kathrin Pollmann,et al.  How to Work in the Car of the Future?: A Neuroergonomical Study Assessing Concentration, Performance and Workload Based on Subjective, Behavioral and Neurophysiological Insights , 2019, CHI.

[28]  Heinrich Hußmann,et al.  Training in IVR: investigating the effect of instructor design on social presence and performance of the VR user , 2018, VRST.

[29]  Titus von der Malsburg.  Py-Span-Task - A Software for Testing Working Memory Span , 2015 .

[30]  Andreas Butz,et al.  An Exploration of Users’ Thoughts on Rear-Seat Productivity in Virtual Reality , 2020, AutomotiveUI.

[31]  Heinrich Hußmann,et al.  Fearing Disengagement from the Real World , 2019, VRST.

[32]  Pascal Knierim,et al.  The Virtual Office of the Future: Are Centralized Workplaces Obsolete? , 2020 .

[33]  James A. Landay,et al.  On-road Guided Slow Breathing Interventions for Car Commuters , 2019, CHI Extended Abstracts.

[34]  Gregory D. Abowd,et al.  NotifiVR: Exploring Interruptions and Notifications in Virtual Reality , 2018, IEEE Transactions on Visualization and Computer Graphics.

[35]  Statistics on commuting patterns at regional level Statistics , 2018 .

[36]  Ceenu George,et al.  Invisible Boundaries for VR: Auditory and Haptic Signals as Indicators for Real World Boundaries , 2020, IEEE Transactions on Visualization and Computer Graphics.

[37]  Stephen A. Brewster,et al.  Virtual reality passenger experiences , 2019, AutomotiveUI.

[38]  Patricia L. Mokhtarian,et al.  How do activities conducted while commuting influence mode choice? Using revealed preference models to inform public transportation advantage and autonomous vehicle scenarios , 2019, Transportation Research Part A: Policy and Practice.

[39]  Liwei Chan,et al.  ShareSpace: Facilitating Shared Use of the Physical Space by both VR Head-Mounted Display and External Users , 2018, UIST.

[40]  Ahmed Sabbir Arif,et al.  Text Entry in Virtual Reality: A Comprehensive Review of the Literature , 2019, HCI.

[41]  Per Ola Kristensson,et al.  The Office of the Future: Virtual, Portable, and Global , 2018, IEEE Computer Graphics and Applications.

[42]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[43]  Heinrich Hußmann,et al.  Investigating the Third Dimension for Authentication in Immersive Virtual Reality and in the Real World , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[44]  Stephen Brewster,et al.  Expanding the Bounds of Seated Virtual Workspaces , 2020, ACM Trans. Comput. Hum. Interact..

[45]  Stephen Brewster,et al.  Challenges in passenger use of mixed reality headsets in cars and other transportation , 2019, Virtual Reality.

[46]  Manfred Tscheligi,et al.  Activities and Technology Usage while Driving: A Field Study with Private Short-Distance Car Commuters , 2016, NordiCHI.

[47]  Werner Tietz.  Haptic design of vehicle interiors at AUDI , 2008 .

[48]  Philipp Wintersberger,et al.  AutoWork 2020: Second Workshop on the Future of Work and Well-Being in Automated Vehicles , 2020, AutomotiveUI.

[49]  J. J. Higgins,et al.  The aligned rank transform for nonparametric factorial analyses using only anova procedures , 2011, CHI.

[50]  Myounghoon Jeon,et al.  “Spindex” (Speech Index) Enhances Menus on Touch Screen Devices with Tapping, Wheeling, and Flicking , 2012, TCHI.

[51]  Stephen A. Brewster,et al.  AutoWork 2019: workshop on the future of work and well-being in automated vehicles , 2019, AutomotiveUI.

[52]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[53]  Bastian Pfleging,et al.  Investigating user needs for non-driving-related activities during automated driving , 2016, MUM.

[54]  Mel Slater,et al.  A note on presence terminology , 2003 .

[55]  Roderick Murray-Smith,et al.  A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays , 2015, CHI Extended Abstracts.