GamesBond: Bimanual Haptic Illusion of Physically Connected Objects for Immersive VR Using Grip Deformation

Virtual Reality experiences, such as games and simulations, typically support the usage of bimanual controllers to interact with virtual objects. To recreate the haptic sensation of holding objects of various shapes and behaviors with both hands, previous researchers have used mechanical linkages between the controllers that render adjustable stiffness. However, the linkage cannot quickly adapt to simulate dynamic objects, nor it can be removed to support free movements. This paper introduces GamesBond, a pair of 4-DoF controllers without physical linkage but capable to create the illusion of being connected as a single device, forming a virtual bond. The two controllers work together by dynamically displaying and physically rendering deformations of hand grips, and so allowing users to perceive a single connected object between the hands, such as a jumping rope. With a user study and various applications we show that GamesBond increases the realism, immersion, and enjoyment of bimanual interaction.

[1]  Fabrice Matulic,et al.  Sensing techniques for tablet+stylus interaction , 2014, UIST.

[2]  William R. Provancher,et al.  Discrimination thresholds for communicating rotational inertia and torque using differential skin stretch feedback in virtual environments , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[3]  Takuji Narumi,et al.  PaCaPa: A Handheld VR Device for Rendering Size, Shape, and Stiffness of Virtual Objects in Tool-based Interactions , 2019, CHI.

[4]  Ravin Balakrishnan,et al.  The role of kinesthetic reference frames in two-handed input performance , 1999, UIST '99.

[5]  Eckehard G. Steinbach,et al.  Disposal of explosive ordnances by use of a bimanual haptic telepresence system , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[6]  Allison M. Okamura,et al.  Holdable Haptic Device for 4-DOF Motion Guidance , 2019, 2019 IEEE World Haptics Conference (WHC).

[7]  Daniel J. Wigdor,et al.  PseudoBend: Producing Haptic Illusions of Stretching, Bending, and Twisting Using Grain Vibrations , 2019, UIST.

[8]  Da-Yuan Huang,et al.  PuPoP: Pop-up Prop on Palm for Virtual Reality , 2018, UIST.

[9]  Makiko Azuma,et al.  GraspForm: Shape and Hardness Rendering on Handheld Device toward Universal Interface for 3D Haptic TV , 2017, UIST.

[10]  Antonio Krüger,et al.  Drag:on: A Virtual Reality Controller Providing Haptic Feedback Based on Drag and Weight Shift , 2019, CHI.

[11]  William R. Provancher,et al.  An ungrounded tactile feedback device to portray force and torque-like interactions in virtual environments , 2014, 2014 IEEE Virtual Reality (VR).

[12]  Shoichi Hasegawa,et al.  SPIDAR G&G: A Two-Handed Haptic Interface for Bimanual VR Interaction , 2004 .

[13]  Sean Follmer,et al.  Investigating the Detection of Bimanual Haptic Retargeting in Virtual Reality , 2019, VRST.

[14]  Hiroshi Ishii,et al.  Linked-Stick: Conveying a Physical Experience using a Shape-Shifting Stick , 2015, CHI Extended Abstracts.

[15]  Pedro Lopes,et al.  Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation , 2017, CHI.

[16]  Aaron M. Dollar,et al.  Development and experimental validation of a minimalistic shape-changing haptic navigation device , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Oussama Khatib,et al.  Ocean One: A Robotic Avatar for Oceanic Discovery , 2016, IEEE Robotics & Automation Magazine.

[18]  Tomás Henriques SPR1NG Controller: An Interface for Kinesthetic Spatial Manipulation , 2019, 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH).

[19]  Peter B. Shull,et al.  HaptiVec: Presenting Haptic Feedback Vectors in Handheld Controllers using Embedded Tactile Pin Arrays , 2019, CHI.

[20]  Michael A Liss,et al.  Robotic Surgical Simulation , 2013, Cancer journal.

[21]  Mar Gonzalez-Franco,et al.  Avatar Embodiment Enhances Haptic Confidence on the Out-of-Body Touch Illusion , 2019, IEEE Transactions on Haptics.

[22]  William Buxton,et al.  Pen + touch = new tools , 2010, UIST.

[23]  Antonio Krüger,et al.  Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality , 2017, IEEE Transactions on Visualization and Computer Graphics.

[24]  Josef B. Spjut,et al.  A variable shape and variable stiffness controller for haptic virtual interactions , 2018, 2018 IEEE International Conference on Soft Robotics (RoboSoft).

[25]  François Conti,et al.  Virtual reality simulation in neurosurgery: technologies and evolution. , 2013, Neurosurgery.

[26]  Masahiko Inami,et al.  Leviopole: mid-air haptic interactions using multirotor , 2018, SIGGRAPH Emerging Technologies.

[27]  Andrey Krekhov,et al.  Self-Transforming Controllers for Virtual Reality First Person Shooters , 2017, CHI PLAY.

[28]  Eyal Ofek,et al.  Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation , 2018, CHI.

[29]  C. Swindells,et al.  TorqueBAR: an ungrounded haptic feedback device , 2003, ICMI '03.

[30]  Aaron M. Dollar,et al.  Design and Evaluation of Shape-Changing Haptic Interfaces for Pedestrian Navigation Assistance , 2017, IEEE Transactions on Haptics.

[31]  Matthias Müller,et al.  XPBD: position-based simulation of compliant constrained dynamics , 2016, MIG.

[32]  Takuji Narumi,et al.  Transcalibur: A Weight Shifting Virtual Reality Controller for 2D Shape Rendering based on Computational Perception Model , 2019, CHI.

[33]  William Buxton,et al.  Thumb + Pen Interaction on Tablets , 2017, CHI.

[34]  M. Buss,et al.  A New Admittance-Type Haptic Interface for Bimanual Manipulations , 2008, IEEE/ASME Transactions on Mechatronics.

[35]  Filipe Miguel Teixeira Pereira da Silva,et al.  Bimanual Haptics for Humanoid Robot Teleoperation Using ROS and V-REP , 2015, 2015 IEEE International Conference on Autonomous Robot Systems and Competitions.

[36]  Xing-Dong Yang,et al.  Aero-plane: A Handheld Force-Feedback Device that Renders Weight Motion Illusion on a Virtual 2D Plane , 2019, UIST.

[37]  Peng Song,et al.  A handle bar metaphor for virtual object manipulation with mid-air interaction , 2012, CHI.

[38]  Hideaki Kuzuoka,et al.  PoCoPo: Handheld Pin-based Shape Display for Haptic Rendering in Virtual Reality , 2020, CHI.