Robotic Haptic Proxies for Collaborative Virtual Reality

We propose a new approach for interaction in Virtual Reality (VR) using mobile robots as proxies for haptic feedback. This approach allows VR users to have the experience of sharing and manipulating tangible physical objects with remote collaborators. Because participants do not directly observe the robotic proxies, the mapping between them and the virtual objects is not required to be direct. In this paper, we describe our implementation, various scenarios for interaction, and a preliminary user study.

[1]  Hiroshi Ishii,et al.  Physical telepresence: shape capture and display for embodied, computer-mediated remote collaboration , 2014, UIST.

[2]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[3]  Daniel J. Wigdor,et al.  Snake Charmer: Physically Enabling Virtual Objects , 2016, TEI.

[4]  Kasper Hornbæk,et al.  Tangible bots: interaction with active tangibles in tabletop interfaces , 2011, CHI.

[5]  P‐J Fager,et al.  The use of haptics in medical applications , 2004, The international journal of medical robotics + computer assisted surgery : MRCAS.

[6]  Hiroshi Ishii,et al.  inFORM: dynamic physical affordances and constraints through shape and object actuation , 2013, UIST.

[7]  Hiroshi Ishii,et al.  Token+constraint systems for tangible interaction with digital information , 2005, TCHI.

[8]  A. Agarwal,et al.  C-Slate: A Multi-Touch and Object Recognition System for Remote Collaboration using Horizontal Surfaces , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[9]  A. Okamura.  Haptic feedback in robot-assisted minimally invasive surgery , 2009, Current opinion in urology.

[10]  Hiroshi Ishii,et al.  Tangible interfaces for remote collaboration and communication , 1998, CSCW '98.

[11]  Zhenyi He,et al.  Hand-based interaction for object manipulation with augmented reality glasses , 2014, VRCAI '14.

[12]  Ken Perlin,et al.  Future Reality: How Emerging Technologies Will Change Language Itself , 2016, IEEE Computer Graphics and Applications.

[13]  Luv Kohli,et al.  Redirected touching: Warping space to remap passive haptics , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[14]  B. Dunkin,et al.  Surgical simulation: a current review , 2007, Surgical Endoscopy.

[15]  Hiroshi Ishii,et al.  Tangible bits: beyond pixels , 2008, TEI.

[16]  Eyal Ofek,et al.  Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences , 2016, CHI.

[17]  Orit Shaer,et al.  Reality-based interaction: a framework for post-WIMP interfaces , 2008, CHI.