NotifiVR: Exploring Interruptions and Notifications in Virtual Reality

The proliferation of high resolution and affordable virtual reality (VR) headsets is quickly making room-scale VR experiences available in our homes. Most VR experiences strive to achieve complete immersion by creating a disconnect from the real world. However, due to the lack of a standardized notification management system and minimal context awareness in VR, an immersed user may face certain situations such as missing an important phone call (digital scenario), tripping over wandering pets (physical scenario), or losing track of time (temporal scenario). In this paper, we present the results of 1) a survey across 61 VR users to understand common interruptions and scenarios that would benefit from some form of notifications; 2) a design exercise with VR professionals to explore possible notification methods; and 3) an empirical study on the noticeability and perception of 5 different VR interruption scenarios across 6 modality combinations (e.g., audio, visual, haptic, audio + haptic, visual + haptic, and audio + visual) implemented in Unity and presented using the HTC Vive headset. Finally, we combine key learnings from each of these steps along with participant feedback to present a set of observations and recommendations for notification design in VR.

[1]  Susanne Boll,et al.  Where to turn my car?: comparison of a tactile display and a conventional car navigation system under high load condition , 2010, AutomotiveUI.

[2]  Gerd Bruder,et al.  Who turned the clock? Effects of Manipulated Zeitgebers, Cognitive Load and Immersion on Time Estimation , 2016, IEEE Transactions on Visualization and Computer Graphics.

[3]  Niels Henze,et al.  Design Guidelines for Notifications on Smart TVs , 2016, TVX.

[4]  David A. Forsyth,et al.  Where's My Drink? Enabling Peripheral Real World Interactions While Using HMDs , 2015, ArXiv.

[5]  Mark T. Bolas,et al.  Impossible Spaces: Maximizing Natural Walking in Virtual Environments with Self-Overlapping Architecture , 2012, IEEE Transactions on Visualization and Computer Graphics.

[6]  Ernesto Arroyo,et al.  Interruptions as multimodal outputs: which are the less disruptive? , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[7]  Michael J. Singer,et al.  The Factor Structure of the Presence Questionnaire , 2005, Presence: Teleoperators & Virtual Environments.

[8]  Niels Henze,et al.  Exploring notifications in smart home environments , 2016, MobileHCI Adjunct.

[9]  Thomas Grechenig,et al.  Towards a Taxonomy for Ambient Information Systems , 2007, Ambient Information Systems.

[10]  Bernt Schiele,et al.  Context-aware notification for wearable computing , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[11]  Pattie Maes,et al.  eye-q: eyeglass peripheral display for subtle intimate notifications , 2006, Mobile HCI.

[12]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[13]  Roope Raisamo,et al.  Effects of directional haptic and non-speech audio cues in a cognitively demanding navigation task , 2014, NordiCHI.

[14]  Ian Oakley,et al.  Hot & tight: exploring thermo and squeeze cues recognition on wrist wearables , 2015, SEMWEB.

[15]  Eyal Ofek,et al.  Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences , 2016, CHI.

[16]  Joshua D. Hoffman,et al.  Collision warning design to mitigate driver distraction , 2004, CHI.

[17]  John T. Stasko,et al.  A taxonomy of ambient information systems: four patterns of design , 2006, AVI '06.

[18]  Chris Schmandt,et al.  Physical embodiments for mobile communication agents , 2005, UIST '05.

[19]  Michael J. Muller.  PICTIVE—an exploration in participatory design , 1991, CHI.

[20]  Kara A. Latorella,et al.  The Scope and Importance of Human Interruption in Human-Computer Interaction Design , 2002, Hum. Comput. Interact..

[21]  Sharif Razzaque,et al.  Redirected Walking , 2001, Eurographics.

[22]  Hans-Werner Gellersen,et al.  Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences , 2015, CHI.

[23]  Omer Tsimhoni,et al.  Haptic seat for automated driving: preparing the driver to take control effectively , 2015, AutomotiveUI.

[24]  Jaakko Hakulinen,et al.  THE USE OF WALKING SOUNDS IN SUPPORTING AWARENESS , 2003 .

[25]  Stefan Schneegaß,et al.  Towards Notifications in the Era of the Internet of Things , 2016, IOT.

[26]  Caecilia Charbonnier,et al.  Real virtuality: a multi-user immersive platform connecting real and virtual worlds , 2016, VRIC.

[27]  Jacob P. Somervell,et al.  A model for notification systems evaluation—assessing user goals for multitasking activity , 2003, TCHI.

[28]  Thijs Roumen,et al.  NotiRing: A Comparative Study of Notification Channels for Wearable Interactive Rings , 2015, CHI.

[29]  Tara Matthews,et al.  Designing and evaluating glanceable peripheral displays , 2006, DIS '06.

[30]  Manfred Tscheligi,et al.  Dorsal haptic display: a shape-changing car seat for sensory augmentation of rear obstacles , 2015, AutomotiveUI.

[31]  Dragos Datcu,et al.  Workspace Awareness in Collaborative AR using HMDs: A User Study Comparing Audio and Visual Notifications , 2016, AH.

[32]  Daniel Freedman,et al.  Reality Skins: Creating Immersive and Tactile Virtual Environments , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[33]  Li-Yi Wei,et al.  Mapping virtual and physical reality , 2016, ACM Trans. Graph..

[34]  Peter Tarasewich,et al.  Testing visual notification cues on a mobile device , 2004, CHI EA '04.

[35]  Finland,et al.  DYNAMIC AUDITORY CUES FOR EVENT IMPORTANCE LEVEL , 2003 .

[36]  Christopher G. Atkeson,et al.  Predicting human interruptibility with sensors: a Wizard of Oz feasibility study , 2003, CHI '03.

[37]  Fredrik Winberg,et al.  Designing auditory displays to facilitate object localization in virtual haptic 3D environments , 2006, Assets '06.

[38]  Andrés Lucero,et al.  NotifEye: using interactive glasses to deal with notifications while walking in public , 2014, Advances in Computer Entertainment.

[39]  Matt Adcock,et al.  Cultivating Design Patterns for Auditory Displays , 2004, ICAD.