FrontFace: facilitating communication between HMD users and outsiders using front-facing-screen HMDs

A head-mounted display (HMD) immerses users in a virtual world, but separates them from outsiders in the real world. We present FrontFace, which is a novel HMD that combines an eye-tracker with a front-facing screen, to lower the communication barrier between HMD users and outsiders. The front-facing screen reveals user attention (e.g., the users eye motions) and user presence in the virtual or real world by displaying the scene in the virtual world or a skin background respectively, enabling eye-contact interactions between the HMD user and the outsiders. FrontFace has the following benefits. Firstly, it communicates the presence of the HMD user to outsiders; secondly, it reveals the player's visual attention by introducing the HMD users originally occluded eye motions, enabling outsiders to make sense of the HMD user's reaction in the virtual world or the real world. Three interactive techniques for the outsiders to initiate communication to HMD users are proposed: they are tap-trigger, hand-gesture trigger, and voice-trigger interactions. A small focus group provided feedback.

[1]  Jun Hu,et al.  E-Gaze Glasses: Simulating Natural Gazes for Blind People , 2016, Tangible and Embedded Interaction.

[2]  Jun Rekimoto,et al.  Wearing another's personality: a human-surrogate system with a telepresence face , 2015, SEMWEB.

[3]  Hirotaka Osawa Emotional Cyborg: Human Extension with Agency for Emotional Labor , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[4]  Julian Frommel,et al.  ShareVR: Enabling Co-Located Experiences for Virtual Reality between HMD and Non-HMD Users , 2017, CHI.

[5]  Tovi Grossman,et al.  Candid Interaction: Revealing Hidden Mobile and Wearable Computing Activities , 2015, UIST.

[6]  Andrew Vande Moere,et al.  Evaluating a Wearable Display Jersey for Augmenting Team Sports Awareness , 2007, Pervasive.

[7]  Jennifer Pearson,et al.  It's About Time: Smartwatches as Public Displays , 2015, CHI.

[8]  Mochimaru Masaaki,et al.  Dollhouse VR: A Multi-view, Multi-user Collaborative Design Workspace with VR Technology , 2016 .

[9]  Staffan Björk,et al.  The BubbleBadge: a wearable public display , 1999, CHI EA '99.

[10]  Roderick Murray-Smith,et al.  A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays , 2015, CHI Extended Abstracts.

[11]  Mitsunori Tada,et al.  Dollhouse VR: a multi-view, multi-user collaborative design workspace with VR technology , 2015, SIGGRAPH Asia Posters.

[12]  Xing-Dong Yang,et al.  Surround-see: enabling peripheral vision on smartphones during active use , 2013, UIST.