Ultrasound Rendering of Tactile Interaction with Fluids

When we interact with fluid media, e.g., with our hands, we experience a spatially and temporally varying pressure field on our skin, which depends on the density and viscosity of the fluid, as well as the relative motion between our hands and the surrounding flow. Ultrasound phased arrays stimulate skin in mid air by controlling pressure waves at particular spatial locations. In this work, we explore the connection between the pressure-based stimulation of ultrasound haptics and the actual pressure field experienced when interacting with fluid media, to devise a novel algorithm for ultrasound-based rendering of tactile interaction with fluids. Our algorithm extracts the target pressure field on a virtual hand from an interactive fluid simulation, and formulates the computation of the rendered pressure as an optimization problem. We have designed an efficient solver for this optimization problem, and we show results of interactive experiments with several fluid simulations.

[1]  Hiroyuki Shinoda,et al.  HaptoMime: mid-air haptic interaction with a floating virtual screen , 2014, UIST.

[2]  J. Steinhoff,et al.  Modification of the Euler equations for ‘‘vorticity confinement’’: Application to the computation of interacting vortex rings , 1994 .

[3]  Desney S. Tan,et al.  AirWave: non-contact haptic feedback using air vortex rings , 2013, UbiComp.

[4]  Ronald Fedkiw,et al.  Visual simulation of smoke , 2001, SIGGRAPH.

[5]  Hiroyuki Shinoda,et al.  Aerial Vibrotactile Display Based on Multiunit Ultrasound Phased Array , 2018, IEEE Transactions on Haptics.

[6]  Hiroyuki Shinoda,et al.  Non-contact Method for Producing Tactile Sensation Using Airborne Ultrasound , 2008, EuroHaptics.

[7]  Sriram Subramanian,et al.  Rendering volumetric haptic shapes in mid-air using ultrasound , 2014, ACM Trans. Graph..

[8]  Mohamad Eid,et al.  Haptogram: Ultrasonic Point-Cloud Tactile Stimulation , 2016, IEEE Access.

[9]  Jingwan Lu,et al.  GPU methods for real-time haptic interaction with 3D fluids , 2009, 2009 IEEE International Workshop on Haptic Audio visual Environments and Games.

[10]  Yasutoshi Makino,et al.  Active touch perception produced by airborne ultrasonic haptic hologram , 2015, 2015 IEEE World Haptics Conference (WHC).

[11]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[12]  Sriram Subramanian,et al.  UltraHaptics: multi-point mid-air haptic feedback for touch surfaces , 2013, UIST.

[13]  Hiroyuki Shinoda,et al.  Noncontact Tactile Display Based on Radiation Pressure of Airborne Ultrasound , 2010, IEEE Transactions on Haptics.

[14]  Andoni Rivera Pinto,et al.  Real-Time Simulation and Rendering of 3D Fluids , 2018 .

[15]  Maud Marchal,et al.  Vibrotactile Rendering of Splashing Fluids , 2013, IEEE Transactions on Haptics.

[16]  Benjamin Long,et al.  Spatiotemporal modulation for mid-air haptic feedback from an ultrasonic phased array , 2018 .

[17]  Sriram Subramanian,et al.  Sampling Strategy for Ultrasonic Mid-Air Haptics , 2019, CHI.

[18]  Sriram Subramanian,et al.  Perception of ultrasonic haptic feedback on the hand: localisation and apparent motion , 2014, CHI.

[19]  William V. Baxter,et al.  Haptic interaction with fluid media , 2004, Graphics Interface.

[20]  Abdulmotaleb El-Saddik,et al.  Magnetic Field Control for Haptic Display: System Design and Simulation , 2016, IEEE Access.

[21]  Sriram Subramanian,et al.  Haptic technologies for direct touch in virtual reality , 2016, SIGGRAPH Courses.

[22]  Sriram Subramanian,et al.  Using Spatiotemporal Modulation to Draw Tactile Patterns in Mid-Air , 2018, EuroHaptics.

[23]  Ali Israr,et al.  AIREAL: interactive tactile experiences in free air , 2013, ACM Trans. Graph..

[24]  Maud Marchal,et al.  Six-oof haptic interaction with fluids, solids, and their transitions , 2013, 2013 World Haptics Conference (WHC).

[25]  Won-Sook Lee,et al.  Real-Time 3D Fluid Interaction with a Haptic User Interface , 2008, 2008 IEEE Symposium on 3D User Interfaces.

[26]  Makoto Sato,et al.  A fluid resistance map method for real-time haptic interaction with fluids , 2006, VRST '06.

[27]  Jong-Rak Park,et al.  Mid-air tactile stimulation using laser-induced thermoelastic effects: The first study for indirect radiation , 2015, 2015 IEEE World Haptics Conference (WHC).