Acoustic rendering of particle-based simulation of liquids in motion

In interaction and interface design, the representation of continuous processes often uses liquid metaphors, such as dripping or streaming. When an auditory display of such processes is required, an approach to sound-synthesis based on the physics of liquids in motion would be the most convincing, especially when real-time interaction is into play. In order to bridge the complexity of fluid-dynamic simulations with the needs of interactive sonification, we propose a multi-rate sound synthesis of liquid phenomena. Low-rate smoothed-particle hydrodynamics is used to model liquids in motion and to trigger sound-emitting events. Such events, such as solid-liquid collision, or bubble formation, are synthesized at audio rate. The proposed method is applied to the two important cases of liquid falling into a vessel, and of solid object falling into a liquid. Some example applications in interaction design are presented.

[1]  Davide Rocchesso,et al.  Sounding Objects , 2003, IEEE Multim..

[2]  H. Pumphrey,et al.  Underwater sound produced by individual drop impacts and rainfall , 1989 .

[3]  Cumhur Erkut,et al.  Synthesis of Hand Clapping Sounds , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[4]  M. Minnarert,et al.  Musical air-bubbles and the sound of running water , 1933 .

[5]  Ronald Fedkiw,et al.  Animation and rendering of complex water surfaces , 2002, ACM Trans. Graph..

[6]  Dinesh Manocha,et al.  Sounding liquids: Automatic sound synthesis from fluid simulation , 2010, TOGS.

[7]  Davide Rocchesso,et al.  A toolkit for explorations in sonic interaction design , 2010, Audio Mostly Conference.

[8]  M. Minnaert XVI.On musical air-bubbles and the sounds of running water , 1933 .

[9]  M. Rein Phenomena of liquid drop impact on solid and liquid surfaces , 1993 .

[10]  Davide Rocchesso,et al.  Gamelunch: a Physics-Based Sonic Dining Table , 2007, ICMC.

[11]  Dinesh K. Pai,et al.  FoleyAutomatic: physically-based sound effects for interactive simulation and animation , 2001, SIGGRAPH.

[12]  Davide Rocchesso,et al.  Continuous sonic feedback from a rolling ball , 2005, IEEE MultiMedia.

[13]  Yoshinori Dobashi,et al.  Real-time rendering of aerodynamic sound using sound textures based on computational fluid dynamics , 2003, ACM Trans. Graph..

[14]  P A Cabe,et al.  Human sensitivity to acoustic information from vessel filling. , 2000, Journal of experimental psychology. Human perception and performance.

[15]  Stephen McAdams,et al.  A Vibrotactile Device for Display of Virtual Ground Materials in Walking , 2008, EuroHaptics.

[16]  Detlef Lohse,et al.  Supersonic air flow due to solid-liquid impact. , 2009, Physical review letters.

[17]  Perry R. Cook,et al.  Physically Informed Sonic Modeling (PhISM): Synthesis of percussive sounds , 1997 .

[18]  Paul Dourish,et al.  Where the action is , 2001 .

[19]  Doug L. James,et al.  Harmonic fluids , 2009, ACM Trans. Graph..

[20]  Davide Rocchesso,et al.  Designing Continuous Sonic Interaction , 2009 .

[21]  Stefan Bilbao 12th International Conference on Digital Audio Effects , 2010 .

[22]  Stefan aus der Wiesche Computational slosh dynamics: theory and industrial application , 2003 .

[23]  Davide Rocchesso,et al.  Gamelunch: forging a dining experience through sound , 2008, CHI Extended Abstracts.

[24]  G. J. Franz Splashes as Sources of Sound in Liquids , 1959 .

[25]  Doug L. James,et al.  Harmonic fluids , 2009, SIGGRAPH 2009.

[26]  Richard M. Heitmeyer,et al.  Low-frequency sound generation by an individual open-ocean breaking wave , 2001 .

[27]  Davide Rocchesso,et al.  The Sounding Object , 2002 .

[28]  Inger Ekman,et al.  Using vocal sketching for designing sonic interactions , 2010, Conference on Designing Interactive Systems.

[29]  Andy Farnell,et al.  Designing Sound , 2008 .

[30]  Maud Marchal,et al.  Six Degrees-of-Freedom Haptic Interaction with Fluids , 2011, IEEE Transactions on Visualization and Computer Graphics.

[31]  E. G. Richardson The Impact of a Solid on a Liquid Surface , 1948 .

[32]  Markus H. Gross,et al.  Particle-based fluid simulation for interactive applications , 2003, SCA '03.

[33]  J. Nystuen,et al.  The hydroacoustics of a raindrop impact , 1992 .

[34]  Kees van den Doel,et al.  Physically based models for liquid sounds , 2005, TAP.