VRRobot: Robot actuated props in an infinite virtual environment

We present the design and development of a fully immersive virtual reality (VR) system that can provide prop-based haptic feedback in an infinite virtual environment. It is conceived as a research tool for studying topics related to haptics in VR and based on off-the-shelf components. A robotic arm moves physical props, dynamically matching pose and location of an object in the virtual world. When the user reaches for the virtual object, his or her hands also encounter it in the real physical space. The interaction is not limited to specific body parts and does not rely on an external structure like an exoskeleton. In combination with a locomotion platform for close-to-natural walking, this allows unrestricted haptic interaction in a natural way in virtual environments of unlimited size. We describe the concept, the hardware and software architecture in detail. We establish safety design guidelines for human-robot interaction in VR. Our technical evaluation shows good response times and accuracy. We report on a user study conducted with 34 participants indicating promising results, and discuss the potential of our system.

[1]  Mike Sinclair,et al.  TouchMover: actuated 3D touchscreen with haptic feedback , 2013, ITS.

[2]  In Lee,et al.  Haptic simulation of refrigerator door , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[3]  NICOLESCU ADRIAN,et al.  Volumetric accuracy experimental evaluation and 3 D error map generation for a Kawasaki FS 10 E articulated arm industrial robot , 2013 .

[4]  Yasuyoshi Yokokohji,et al.  Path planning for encountered-type haptic devices that render multiple objects in 3D space , 2001, Proceedings IEEE Virtual Reality 2001.

[5]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[6]  Takeo Kanade,et al.  What you can see is what you can feel-development of a visual/haptic interface to virtual environment , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[7]  Daniel J. Wigdor,et al.  Snake Charmer: Physically Enabling Virtual Objects , 2016, TEI.

[8]  Ken Hinckley,et al.  Passive real-world interface props for neurosurgical visualization , 1994, International Conference on Human Factors in Computing Systems.

[9]  Thijs Roumen,et al.  TurkDeck: Physical Virtual Reality Based on People , 2015, UIST.

[10]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[11]  Mary C. Whitton,et al.  Walking > walking-in-place > flying, in virtual environments , 1999, SIGGRAPH.

[12]  Hiroo Iwata,et al.  Haptic interfaces , 2002 .

[13]  Michitaka Hirose,et al.  Development of surface display , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[14]  Takeo Kanade,et al.  Automated Construction of Robotic Manipulation Programs , 2010 .

[15]  Alan Lipschultz,et al.  Virtual Reality Technology, 2nd edition , 2004 .

[16]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[17]  Yasuyoshi Yokokohji,et al.  Haptically rendering different switches arranged on a virtual control panel by using an encountered-type haptic device , 2011, 2011 IEEE World Haptics Conference.

[18]  Robert W. Lindeman,et al.  Hand-held windows: towards effective 2D interaction in immersive virtual environments , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[19]  Kiyoshi Kiyokawa,et al.  A Non-grounded and Encountered-type Haptic Display Using a Drone , 2016, SUI.

[20]  Anselmo Lastra,et al.  Life-sized projector-based dioramas , 2001, VRST '01.

[21]  Amy Hendrix.  Snake charmer , 2004, NTWK.

[22]  Michitaka Hirose,et al.  Simulation and presentation of curved surface in virtual reality environment through surface display , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[23]  Mel Slater,et al.  Taking steps: the influence of a walking technique on presence in virtual reality , 1995, TCHI.

[24]  Hunter G. Hoffman,et al.  Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[25]  Alejandro Jarillo Silva,et al.  PHANToM OMNI Haptic Device: Kinematic and Manipulability , 2009, 2009 Electronics, Robotics and Automotive Mechanics Conference (CERMA).

[26]  Florian Gosselin,et al.  Large Workspace Haptic Devices for Human-Scale Interaction: A Survey , 2008, EuroHaptics.

[27]  Michael Ortega-Binderberger,et al.  Prop-based haptic interaction with co-location and immersion: an automotive application , 2005, IEEE International Workshop on Haptic Audio Visual Environments and their Applications.

[28]  Kirsten Rassmus-Gröhn,et al.  Supporting presence in collaborative environments by haptic force feedback , 2000, TCHI.

[29]  Tsuneo Yoshikawa,et al.  Designing an Encountered-type Haptic Display for Multiple Fingertip Contacts Based on the Observation of Human Grasping Behaviors , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[30]  William A. McNeely,et al.  Robotic graphics: a new approach to force feedback for virtual reality , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[31]  Mary C. Whitton,et al.  Passive haptics significantly enhances virtual environments , 2001 .