SPH Fluid Tactile Rendering for Ultrasonic Mid-Air Haptics

In our daily lives, we interact with fluids by touching them directly with our hands. Fluids produce a pressure field against the surface of our hands, and we experience fluid dynamics over our skin temporally and spatially at varying pressure distributions depending on fluid properties as well as on the interacting hand's poses and motions. To improve the realism of fluid simulation together with user interaction, we propose a real-time fluid tactile rendering technique that computes the pressure field on a virtual hand surface to be delivered to the user's actual hand via ultrasound-based mid-air haptic display. Our haptic rendering algorithm computes the feedback force in two stages: First, the pressure distribution of the rigid-fluid interaction is computed from a real-time Lagrangian fluid simulation, and then a set of focal points that reflects the generated pressure field is extracted by using a hill-climbing method which gives the local extrema of the pressure field of simulation. We implement a real-time smoothed-particle hydrodynamics fluid simulator and the proposed haptic rendering algorithm using adaptive amplitude modulation approach to demonstrate the effectiveness of our method in fluid tactile rendering in various scenarios.

[1]  Hiroyuki Shinoda,et al.  Non-contact Method for Producing Tactile Sensation Using Airborne Ultrasound , 2008, EuroHaptics.

[2]  Hiroyuki Shinoda,et al.  Noncontact Tactile Display Based on Radiation Pressure of Airborne Ultrasound , 2010, IEEE Transactions on Haptics.

[3]  Matthias Teschner,et al.  Versatile rigid-fluid coupling for incompressible SPH , 2012, ACM Trans. Graph..

[4]  Sriram Subramanian,et al.  UltraHaptics: multi-point mid-air haptic feedback for touch surfaces , 2013, UIST.

[5]  Hiroyuki Shinoda,et al.  Lateral Modulation of Midair Ultrasound Focus for Intensified Vibrotactile Stimuli , 2018, EuroHaptics.

[6]  Guirong Liu,et al.  Smoothed Particle Hydrodynamics (SPH): an Overview and Recent Developments , 2010 .

[7]  Jingwan Lu,et al.  GPU methods for real-time haptic interaction with 3D fluids , 2009, 2009 IEEE International Workshop on Haptic Audio visual Environments and Games.

[8]  L. Gavrilov,et al.  Application of focused ultrasound for the stimulation of neural structures. , 1996, Ultrasound in medicine & biology.

[9]  Sriram Subramanian,et al.  Rendering volumetric haptic shapes in mid-air using ultrasound , 2014, ACM Trans. Graph..

[10]  Maud Marchal,et al.  Six Degrees-of-Freedom Haptic Interaction with Fluids , 2011, IEEE Transactions on Visualization and Computer Graphics.

[11]  Jinah Park,et al.  Collaborative Haptic Exploration of Dynamic Remote Environments , 2018, IEEE Computer Graphics and Applications.

[12]  Maud Marchal,et al.  Vibrotactile Rendering of Splashing Fluids , 2013, IEEE Transactions on Haptics.

[13]  J. Monaghan Simulating Free Surface Flows with SPH , 1994 .

[14]  Miguel A. Otaduy,et al.  Ultrasound Rendering of Tactile Interaction with Fluids , 2019, 2019 IEEE World Haptics Conference (WHC).

[15]  Sriram Subramanian,et al.  Perception of ultrasonic haptic feedback on the hand: localisation and apparent motion , 2014, CHI.

[16]  Inwook Hwang,et al.  AirPiano: Enhancing music playing experience in virtual reality with mid-air haptic feedback , 2017, 2017 IEEE World Haptics Conference (WHC).

[17]  J. Monaghan Smoothed particle hydrodynamics , 2005 .

[18]  Yasutoshi Makino,et al.  Direct Finger Manipulation of 3D Object Image with Ultrasound Haptic Feedback , 2019, CHI.

[19]  Matthias Teschner,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2007) Weakly Compressible Sph for Free Surface Flows , 2022 .