ElaStick: A Handheld Variable Stiffness Display for Rendering Dynamic Haptic Response of Flexible Object

Haptic controllers have an important role in providing rich and immersive Virtual Reality (VR) experiences. While previous works have succeeded in creating handheld devices that simulate dynamic properties of rigid objects, such as weight, shape, and movement, recreating the behavior of flexible objects with different stiffness using ungrounded controllers remains an open challenge. In this paper we present ElaStick, a variable-stiffness controller that simulates the dynamic response resulting from shaking or swinging flexible virtual objects. This is achieved by dynamically changing the stiffness of four custom elastic tendons along a joint that effectively increase and reduce the overall stiffness of a perceived object in 2-DoF. We show that with the proposed mechanism, we can render stiffness with high precision and granularity in a continuous range between 10.8 and 71.5Nmm/degree. We estimate the threshold of the human perception of stiffness with a just-noticeable difference (JND) study and investigate the levels of immersion, realism and enjoyment using a VR application.

[1]  S. M. Cadwell,et al.  THE DYNAMIC FATIGUE LIFE OF RUBBER , 1939 .

[2]  Ali Israr,et al.  Passive and Active Discrimination of Natural Frequency of Virtual Dynamic Systems , 2009, IEEE Transactions on Haptics.

[3]  Takuji Narumi,et al.  Transcalibur: A Weight Shifting Virtual Reality Controller for 2D Shape Rendering based on Computational Perception Model , 2019, CHI.

[4]  Pratibha Mishra,et al.  Advanced Engineering Mathematics , 2013 .

[5]  Aiguo Song,et al.  A Mass-Spring Model for Haptic Display of Flexible Object Global Deformation , 2007, 2007 International Conference on Mechatronics and Automation.

[6]  Da-Yuan Huang,et al.  PuPoP: Pop-up Prop on Palm for Virtual Reality , 2018, UIST.

[7]  Robert LiKamWa,et al.  SWISH: A Shifting-Weight Interface of Simulated Hydrodynamics for Haptic Perception of Virtual Fluid Vessels , 2019, UIST.

[8]  Koichi Hirota,et al.  Recognition of weight through shaking interaction , 2015, 2015 IEEE World Haptics Conference (WHC).

[9]  Hyelip Lee,et al.  Wind-blaster: a wearable propeller-based prototype that provides ungrounded force-feedback , 2018, SIGGRAPH Emerging Technologies.

[10]  Koichi Hirota,et al.  Haptic Representation of Elastic Objects , 2001, Presence: Teleoperators & Virtual Environments.

[11]  Lynette A. Jones,et al.  Application of Psychophysical Techniques to Haptic Research , 2013, IEEE Transactions on Haptics.

[12]  Antonio Krüger,et al.  Drag:on: A Virtual Reality Controller Providing Haptic Feedback Based on Drag and Weight Shift , 2019, CHI.

[13]  Xing-Dong Yang,et al.  Aero-plane: A Handheld Force-Feedback Device that Renders Weight Motion Illusion on a Virtual 2D Plane , 2019, UIST.

[14]  Nadia Magnenat-Thalmann,et al.  Haptic interaction with one-dimensional structures , 2009, VRST '09.

[15]  Hiroshi Ishii,et al.  Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices , 2012, UIST.

[16]  Bing-Yu Chen,et al.  ElastOscillation: 3D Multilevel Force Feedback for Damped Oscillation on VR Controllers , 2020, CHI.

[17]  Liwei Chan,et al.  HapticSphere: Physical Support To Enable Precision Touch Interaction in Mobile Mixed-Reality , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[18]  Shwetak N. Patel,et al.  SqueezeBlock: using virtual springs in mobile devices for eyes-free interaction , 2010, UIST.

[19]  M. Dixit,et al.  Tata McGraw Hill Education Private Limited , 2015 .

[20]  Bing-Yu Chen,et al.  ElastImpact: 2.5D Multilevel Instant Impact Using Elasticity on Head-Mounted Displays , 2019, UIST.

[21]  Ross T. Smith,et al.  Wearable jamming mitten for virtual environment haptics , 2014, SEMWEB.

[22]  Jong-In Kim,et al.  Quaternion Joint: Dexterous 3-DOF Joint Representing Quaternion Motion for High-Speed Safe Interaction , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Masahiko Inami,et al.  Leviopole: mid-air haptic interactions using multirotor , 2018, SIGGRAPH Emerging Technologies.

[24]  Jun Rekimoto,et al.  ElasticVR: Providing Multilevel Continuously-Changing Resistive Force and Instant Impact Using Elasticity for VR , 2019, CHI.

[25]  D. S. Dugdale,et al.  Introduction to the Mechanics of Solids , 1967 .

[26]  C. Swindells,et al.  TorqueBAR: an ungrounded haptic feedback device , 2003, ICMI '03.

[27]  Maud Marchal,et al.  Elastic-Arm: Human-scale passive haptic feedback for augmenting interaction and perception in virtual environments , 2015, 2015 IEEE Virtual Reality (VR).

[28]  Eyal Ofek,et al.  Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation , 2018, CHI.

[29]  Hiroo Iwata,et al.  Pen-based haptic virtual environment , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[30]  Kouichi Konno,et al.  Torque display method for free-form deformation with haptic device , 2009, 2009 ICCAS-SICE.

[31]  Hiroshi Ishii,et al.  jamSheets: thin interfaces with tunable stiffness enabled by layer jamming , 2014, TEI '14.

[32]  Andrey Krekhov,et al.  Self-Transforming Controllers for Virtual Reality First Person Shooters , 2017, CHI PLAY.

[33]  Eyal Ofek,et al.  CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality , 2018, CHI.

[34]  Tomás Henriques.  SPR1NG Controller: An Interface for Kinesthetic Spatial Manipulation , 2019, 2019 IEEE 7th International Conference on Serious Games and Applications for Health (SeGAH).

[35]  Pedro Lopes,et al.  Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation , 2017, CHI.

[36]  Takuji Narumi,et al.  PaCaPa: A Handheld VR Device for Rendering Size, Shape, and Stiffness of Virtual Objects in Tool-based Interactions , 2019, CHI.

[37]  Astrid M. L. Kappers,et al.  Cues for Haptic Perception of Compliance , 2009, IEEE Transactions on Haptics.

[38]  Daniel J. Wigdor,et al.  PseudoBend: Producing Haptic Illusions of Stretching, Bending, and Twisting Using Grain Vibrations , 2019, UIST.

[39]  Eyal Ofek,et al.  CapstanCrunch: A Haptic VR Controller with User-supplied Force Feedback , 2019, UIST.

[40]  Alex Olwal,et al.  Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality , 2017, UIST.

[41]  Sean Follmer,et al.  Wolverine: A wearable haptic interface for grasping in virtual reality , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[42]  Enrico Rukzio,et al.  Breaking the Tracking: Enabling Weight Perception using Perceivable Tracking Offsets , 2018, CHI.

[43]  Geehyuk Lee,et al.  Thor's Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force , 2018, CHI.

[44]  Lena Zentner,et al.  General design equations for the rotational stiffness, maximal angular deflection and rotational precision of various notch flexure hinges , 2017 .