Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality

Ungrounded haptic devices for virtual reality (VR) applications lack the ability to convincingly render the sensations of a grasped virtual object's rigidity and weight. We present Grabity, a wearable haptic device designed to simulate kinesthetic pad opposition grip forces and weight for grasping virtual objects in VR. The device is mounted on the index finger and thumb and enables precision grasps with a wide range of motion. A unidirectional brake creates rigid grasping force feedback. Two voice coil actuators create virtual force tangential to each finger pad through asymmetric skin deformation. These forces can be perceived as gravitational and inertial forces of virtual objects. The rotational orientation of the voice coil actuators is passively aligned with the real direction of gravity through a revolute joint, causing the virtual forces to always point downward. This paper evaluates the performance of Grabity through two user studies, finding promising ability to simulate different levels of weight with convincing object rigidity. The first user study shows that Grabity can convey various magnitudes of weight and force sensations to users by manipulating the amplitude of the asymmetric vibration. The second user study shows that users can differentiate different weights in a virtual environment using Grabity.

[1]  Ryuta Okazaki,et al.  FinGAR: combination of electrical and mechanical stimulation for high-fidelity tactile presentation , 2016, SIGGRAPH Emerging Technologies.

[2]  Kouta Minamizawa,et al.  A Wearable Haptic Display to Present the Gravity Sensation - Preliminary Observations and Device Design , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[3]  Shwetak N. Patel,et al.  SqueezeBlock: using virtual springs in mobile devices for eyes-free interaction , 2010, UIST.

[4]  Allison M. Okamura,et al.  Modeling and design of asymmetric vibrations to induce ungrounded pulling sensation through asymmetric skin displacement , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[5]  Shoichi Hasegawa,et al.  SPIDAR G&G: A Two-Handed Haptic Interface for Bimanual VR Interaction , 2004 .

[6]  Katherine J. Kuchenbecker,et al.  VerroTouch: High-Frequency Acceleration Feedback for Telerobotic Surgery , 2010, EuroHaptics.

[7]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[8]  Allison M. Okamura,et al.  WAVES: A Wearable Asymmetric Vibration Excitation System for Presenting Three-Dimensional Translation and Rotation Cues , 2017, CHI.

[9]  Antonio Krüger,et al.  Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality , 2017, IEEE Transactions on Visualization and Computer Graphics.

[10]  Yifei Zhang,et al.  Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR , 2016, CHI.

[11]  Katherine J. Kuchenbecker,et al.  Effects of Grip-Force, Contact, and Acceleration Feedback on a Teleoperated Pick-and-Place Task , 2017, IEEE Transactions on Haptics.

[12]  A A Amis,et al.  Variation of finger forces in maximal isometric grasp tests on a range of cylinder diameters. , 1987, Journal of biomedical engineering.

[13]  Allison M. Okamura,et al.  Sensory Substitution and Augmentation Using 3-Degree-of-Freedom Skin Deformation Feedback , 2015, IEEE Transactions on Haptics.

[14]  Claudio Pacchierotti,et al.  Design and development of a 3RRS wearable fingertip cutaneous device , 2015, 2015 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[15]  Ryuta Okazaki,et al.  Vibrotactile and pseudo force presentation using motor rotational acceleration , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[16]  Grigore C. Burdea,et al.  The Rutgers Master II-new design force-feedback glove , 2002 .

[17]  Nikolaos G. Tsagarakis,et al.  SLIP AESTHEASIS: a portable 2D slip/skin stretch display for the fingertip , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[18]  Haruhisa Kawasaki,et al.  Five-fingered haptic interface robot: HIRO III , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[19]  Federico Barbagli,et al.  Toward virtual manipulation: from one point of contact to four , 2004 .

[20]  Eyal Ofek,et al.  NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers , 2016, UIST.

[21]  William R. Provancher,et al.  Fingerpad Skin Stretch Increases the Perception of Virtual Friction , 2009, IEEE Transactions on Haptics.

[22]  Katherine J. Kuchenbecker,et al.  Dynamic modeling and control of voice-coil actuators for high-fidelity display of haptic vibrations , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[23]  T. Cornsweet,et al.  The staircrase-method in psychophysics. , 1962, The American journal of psychology.

[24]  Patrick Baudisch,et al.  Skin Drag Displays: Dragging a Physical Tactor across the User's Skin Produces a Stronger Tactile Stimulus than Vibrotactile , 2015, CHI.

[25]  Mark R. Cutkosky,et al.  A wearable skin stretch device for haptic feedback , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[26]  Tomohiro Amemiya,et al.  Asymmetric Oscillation Distorts the Perceived Heaviness of Handheld Objects , 2008, IEEE Transactions on Haptics.

[27]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[28]  Tomohiro Amemiya,et al.  Distinct Pseudo-Attraction Force Sensation by a Thumb-Sized Vibrator that Oscillates Asymmetrically , 2014, EuroHaptics.

[29]  Christine L. MacKenzie,et al.  The Grasping Hand , 2011, The Grasping Hand.

[30]  Hiroshi Ishii,et al.  Weight and volume changing device with liquid metal transfer , 2014, TEI '14.

[31]  Allison M. Okamura,et al.  Fingertip Tactile Devices for Virtual Object Manipulation and Exploration , 2017, CHI.

[32]  Kouta Minamizawa,et al.  Gravity grabber: wearable haptic display to present virtual mass sensation , 2007, SIGGRAPH '07.

[33]  Wendy Ju,et al.  Haptic skin stretch on a steering wheel for displaying preview information in autonomous cars , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[34]  J Houk,et al.  Responses of Golgi tendon organs to forces applied to muscle tendon. , 1967, Journal of neurophysiology.

[35]  Sean Follmer,et al.  Wolverine: A wearable haptic interface for grasping in virtual reality , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[36]  Vincent Hayward,et al.  Tactile Display Device Using Distributed Lateral Skin Stretch , 2000, Dynamic Systems and Control: Volume 2.

[37]  L. Jones,et al.  Perception of force and weight: theory and research. , 1986, Psychological bulletin.

[38]  Claudio Pacchierotti,et al.  The hRing: A wearable haptic device to avoid occlusions in hand tracking , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[39]  Kenneth O. Johnson,et al.  The roles and functions of cutaneous mechanoreceptors , 2001, Current Opinion in Neurobiology.

[40]  Haruhisa Kawasaki,et al.  Five-Fingered Haptic Interface Robot: HIRO III , 2009, IEEE Transactions on Haptics.

[41]  R. S. Johansson,et al.  Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects , 2004, Experimental Brain Research.

[42]  Vincent Hayward,et al.  STReSS: A Practical Tactile Display System with One Millimeter Spatial Resolution and 700 Hz Refresh Rate , 2003 .

[43]  Saeid Nahavandi,et al.  Extending Haptic Device Capability for 3D Virtual Grasping , 2008, EuroHaptics.