SWISH: A Shifting-Weight Interface of Simulated Hydrodynamics for Haptic Perception of Virtual Fluid Vessels

Current VR/AR systems are unable to reproduce the physical sensation of fluid vessels, due to the shifting nature of fluid motion. To this end, we introduce SWISH, an ungrounded mixed-reality interface, capable of affording the users a realistic haptic sensation of fluid behaviors in vessels. The chief mechanism behind SWISH is in the use of virtual reality tracking and motor actuation to actively relocate the center of gravity of a handheld vessel, emulating the moving center of gravity of a handheld vessel that contains fluid. In addition to solving challenges related to reliable and efficient motor actuation, our SWISH designs place an emphasis on reproducibility, scalability, and availability to the maker culture. Our virtual-to-physical coupling uses Nvidia Flex's Unity integration for virtual fluid dynamics with a 3D printed augmented vessel containing a motorized mechanical actuation system. To evaluate the effectiveness and perceptual efficacy of SWISH, we conduct a user study with 24 participants, 7 vessel actions, and 2 virtual fluid viscosities in a virtual reality environment. In all cases, the users on average reported that the SWISH bucket generates accurate tactile sensations for the fluid behavior. This opens the potential for multi-modal interactions with programmable fluids in virtual environments for chemistry education, worker training, and immersive entertainment.

[1]  Pradeep K. Khosla,et al.  Psychophysical Characterization and Testbed Validation of a Wearable Vibrotactile Glove for Telemanipulation , 2003, Presence: Teleoperators & Virtual Environments.

[2]  R S Kalawsky,et al.  VRUSE--a computerised diagnostic tool: for usability evaluation of virtual/synthetic environment systems. , 1999, Applied ergonomics.

[3]  Ali Mazalek,et al.  Sensory VR: Smelling, Touching, and Eating Virtual Reality , 2018, TEI.

[4]  Pinhas Ben-Tzvi,et al.  RML Glove—An Exoskeleton Glove Mechanism With Haptics Feedback , 2015, IEEE/ASME Transactions on Mechatronics.

[5]  Tae-Yong Kim,et al.  Unified particle physics for real-time applications , 2014, ACM Trans. Graph..

[6]  Kyle N. Winfree,et al.  Control of a high fidelity ungrounded torque feedback device: The iTorqU 2.1 , 2010, 2010 IEEE International Conference on Robotics and Automation.

[7]  Won-Sook Lee,et al.  Haptic display of 3D liquids for interactive applications , 2009, 2009 International IEEE Consumer Electronics Society's Games Innovations Conference.

[8]  Hans-Werner Gellersen,et al.  Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences , 2015, CHI.

[9]  C. Swindells,et al.  TorqueBAR: an ungrounded haptic feedback device , 2003, ICMI '03.

[10]  Ryuta Okazaki,et al.  FinGAR: combination of electrical and mechanical stimulation for high-fidelity tactile presentation , 2016, SIGGRAPH Emerging Technologies.

[11]  Takuji Narumi,et al.  Computational design of hand-held VR controllers using haptic shape illusion , 2017, VRST.

[12]  Miles Macklin,et al.  Position based fluids , 2013, ACM Trans. Graph..

[13]  Allison M. Okamura,et al.  Haptic Orientation Guidance Using Two Parallel Double-Gimbal Control Moment Gyroscopes , 2018, IEEE Transactions on Haptics.

[14]  Hiroshi Ishii,et al.  Weight and volume changing device with liquid metal transfer , 2014, TEI '14.

[15]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.

[16]  Maud Marchal,et al.  Six-oof haptic interaction with fluids, solids, and their transitions , 2013, 2013 World Haptics Conference (WHC).

[17]  Karen A. F. Copeland Design and Analysis of Experiments, Volume 1: Introduction to Experimental Design , 1995 .

[18]  Sean Follmer,et al.  Wolverine: A wearable haptic interface for grasping in virtual reality , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Shin-ichiro Mori,et al.  A real-time GPU-based coupled fluid-structure simulation with haptic interaction , 2016, 2016 IEEE/ACIS 15th International Conference on Computer and Information Science (ICIS).

[20]  Eyal Ofek,et al.  NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers , 2016, UIST.

[21]  Daniel J. Wigdor,et al.  Snake Charmer: Physically Enabling Virtual Objects , 2016, TEI.

[22]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[23]  Karl Johan Åström,et al.  PID Controllers: Theory, Design, and Tuning , 1995 .

[24]  Kouta Minamizawa,et al.  Gravity grabber: wearable haptic display to present virtual mass sensation , 2007, SIGGRAPH '07.

[25]  Yifei Zhang,et al.  Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR , 2016, CHI.

[26]  Allison M. Okamura,et al.  Modeling and design of asymmetric vibrations to induce ungrounded pulling sensation through asymmetric skin displacement , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[27]  Antonio Krüger,et al.  Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality , 2017, IEEE Transactions on Visualization and Computer Graphics.

[28]  H HELSON,et al.  TORQUE: A NEW DIMENSION IN TACTILE-KINESTHETIC SENSITIVITY. , 1965, The American journal of psychology.