Wireality: Enabling Complex Tangible Geometries in Virtual Reality with Worn Multi-String Haptics

Today's virtual reality (VR) systems allow users to explore immersive new worlds and experiences through sight. Unfortunately, most VR systems lack haptic feedback, and even high-end consumer systems use only basic vibration motors. This clearly precludes realistic physical interactions with virtual objects. Larger obstacles, such as walls, railings, and furniture are not simulated at all. In response, we developed Wireality, a self-contained worn system that allows for individual joints on the hands to be accurately arrested in 3D space through the use of retractable wires that can be programmatically locked. This allows for convincing tangible interactions with complex geometries, such as wrapping fingers around a railing. Our approach is lightweight, low-cost, and low-power, criteria important for future, worn consumer uses. In our studies, we further show that our system is fast-acting, spatially-accurate, high-strength, comfortable, and immersive.

[1]  Takuji Narumi,et al.  PaCaPa: A Handheld VR Device for Rendering Size, Shape, and Stiffness of Virtual Objects in Tool-based Interactions , 2019, CHI.

[2]  Meredith Ringel Morris,et al.  Enabling People with Visual Impairments to Navigate Virtual Reality with a Haptic and Auditory Cane Simulation , 2018, CHI.

[3]  Clément Gosselin,et al.  Cable-driven parallel mechanisms: state of the art and perspectives , 2014 .

[4]  Pinhas Ben-Tzvi,et al.  RML Glove—An Exoskeleton Glove Mechanism With Haptics Feedback , 2015, IEEE/ASME Transactions on Mechatronics.

[5]  Robert W. Lindeman,et al.  Wearable vibrotactile systems for virtual contact and information display , 2006, Virtual Reality.

[6]  Cagdas D. Onal,et al.  A Soft Robotic Wearable Wrist Device for Kinesthetic Haptic Feedback , 2018, Front. Robot. AI.

[7]  Eyal Ofek,et al.  CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality , 2018, CHI.

[8]  Daniel J. Wigdor,et al.  Snake Charmer: Physically Enabling Virtual Objects , 2016, TEI.

[9]  Markus Funk,et al.  VRHapticDrones: Providing Haptics in Virtual Reality through Quadcopters , 2018, MUM.

[10]  Eyal Ofek,et al.  NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers , 2016, UIST.

[11]  Eyal Ofek,et al.  Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation , 2018, CHI.

[12]  Jeha Ryu,et al.  billiARds: Augmented Reality System with wearable Force-Feedback device , 2005 .

[13]  Alex Olwal,et al.  Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality , 2017, UIST.

[14]  Sean Follmer,et al.  Wolverine: A wearable haptic interface for grasping in virtual reality , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Heinz W. Schmidt HapticWalker-A novel haptic device for walking simulation , 2004 .

[16]  Claudio Melchiorri,et al.  WireMan: a portable wire manipulator for touch-rendering of bas-relief virtual surfaces , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[17]  Edward Cutrell,et al.  Hacking Blind Navigation , 2019, CHI Extended Abstracts.

[18]  Claudio Melchiorri,et al.  What kind of haptic perception can we get with a one-wire interface? , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[19]  Eyal Ofek,et al.  Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller , 2018, CHI.

[20]  Richard Martin,et al.  Design for wearability , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[21]  Ali Israr,et al.  Tactile brush: drawing on skin with a tactile grid display , 2011, CHI.

[22]  Peter B. Shull,et al.  HaptiVec: Presenting Haptic Feedback Vectors in Handheld Controllers using Embedded Tactile Pin Arrays , 2019, CHI.

[23]  Velko Vechev,et al.  DextrES: Wearable Haptic Feedback for Grasping in VR via a Thin Form-Factor Electrostatic Brake , 2018, UIST.

[24]  Yuru Zhang,et al.  A new cable-driven haptic device for integrating kinesthetic and cutaneous display , 2009, 2009 ASME/IFToMM International Conference on Reconfigurable Mechanisms and Robots.

[25]  Clément Gosselin,et al.  Cable Tension Control and Analysis of Reel Transparency for 6-DOF Haptic Foot Platform on a Cable-Driven Locomotion Interface , 2009 .

[26]  Makoto Sato,et al.  A 3D Spatial Interface Device Using Tensed Strings , 1994, Presence: Teleoperators & Virtual Environments.

[27]  Michael T. Tolley,et al.  Soft robotic glove for kinesthetic haptic feedback in virtual reality environments , 2017 .

[28]  Anderson Maciel,et al.  Localized Magnification in Vibrotactile HMDs for Accurate Spatial Awareness , 2016, EuroHaptics.

[29]  Alanson P. Sample,et al.  Force Jacket: Pneumatically-Actuated Jacket for Embodied Haptic Experiences , 2018, CHI.

[30]  Eyal Ofek,et al.  TORC: A Virtual Reality Controller for In-Hand High-Dexterity Finger Interaction , 2019, CHI.

[31]  Robert L. Williams,et al.  Cable-Suspended Haptic Interface , 1998, Int. J. Virtual Real..

[32]  Sungho Jin,et al.  Pneumatic actuator and flexible piezoelectric sensor for soft virtual reality glove system , 2019, Scientific Reports.

[33]  Jeha Ryu,et al.  Design and Control of a Wire-driven Haptic Device: HapticPen , 2005 .

[34]  NATRAH MANSOR,et al.  CONCEPT AND APPLICATION OF VIRTUAL REALITY HAPTIC TECHNOLOGY : A REVIEW , 2017 .

[35]  Jun Rekimoto,et al.  ElasticVR: Providing Multilevel Continuously-Changing Resistive Force and Instant Impact Using Elasticity for VR , 2019, CHI.

[36]  Stefano Mattoccia,et al.  Perception of depth information by means of a wire-actuated haptic interface , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[37]  Geehyuk Lee,et al.  Thor's Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force , 2018, CHI.

[38]  Yi Yang,et al.  Enhancing Touch Screen Games Through a Cable-driven Force Feedback Device , 2012, 2012 International Conference on Virtual Reality and Visualization.

[39]  Pattie Maes,et al.  GyroVR: Simulating Inertia in Virtual Reality using Head Worn Flywheels , 2016, UIST.

[40]  Pedro Lopes,et al.  Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation , 2017, CHI.

[41]  C. Melchiorri,et al.  3D position measurement based on force sensors for a one-wire haptic interface , 1999, IMTC/99. Proceedings of the 16th IEEE Instrumentation and Measurement Technology Conference (Cat. No.99CH36309).

[42]  Wei Peng,et al.  ThermoVR: Exploring Integrated Thermal Haptic Feedback with Head Mounted Displays , 2017, CHI.

[43]  Da-Yuan Huang,et al.  PuPoP: Pop-up Prop on Palm for Virtual Reality , 2018, UIST.

[44]  M.K. O'Malley,et al.  Design of a haptic arm exoskeleton for training and rehabilitation , 2006, IEEE/ASME Transactions on Mechatronics.