Sounding Solid Combustibles: Non-Premixed Flame Sound Synthesis for Different Solid Combustibles

With the rapidly growing VR industry, in recent years, more and more attention has been paid for fire sound synthesis. However, previous methods usually ignore the influences of the different solid combustibles, leading to unrealistic sounding results. This paper proposes SSC (sounding solid combustibles), which is a new recording-driven non-premixed flame sound synthesis framework accounting for different solid combustibles. SSC consists of three components: combustion noise, vortex noise and popping sounds. The popping sounds are the keys to distinguish the differences of solid combustibles. To improve the quality of fire sound, we extract the features of popping sounds from the real fire sound examples based on modified Empirical Mode Decomposition (EMD) method. Unlike previous methods, we take both direct combustion noise and vortex noise into account because the fire model is non-premixed flame. In our method, we also greatly resolve the synchronization problem during blending the three components of SSC. Due to the introduction of the popping sounds, it is easy to distinguish the fire sounds of different solid combustibles by our method, with great potential in practical applications such as games, VR system, etc. Various experiments and comparisons are presented to validate our method.

[1]  James F. O'Brien,et al.  Synthesizing Sounds from Physically Based Motion , 2001, SIGGRAPH Video Review on Animation Theater Program.

[2]  Ziv Bar-Joseph,et al.  Sound-by-numbers: motion-driven sound synthesis , 2003, SCA '03.

[3]  Dinesh Manocha,et al.  Sounding liquids: Automatic sound synthesis from fluid simulation , 2010, TOGS.

[4]  Julia Kastner,et al.  Theory Of Vortex Sound , 2016 .

[5]  Doug L. James,et al.  Harmonic fluids , 2009, SIGGRAPH 2009.

[6]  Doug L. James,et al.  Animating fire with sound , 2011, SIGGRAPH 2011.

[7]  Julius O. Smith,et al.  Spectral modeling synthesis: A sound analysis/synthesis based on a deterministic plus stochastic decomposition , 1990 .

[8]  Eero P. Simoncelli,et al.  Sound texture synthesis via filter statistics , 2009, 2009 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics.

[9]  John Keyser,et al.  Interactive simulation of fire , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[10]  Tim Lieuwen,et al.  Acoustic radiation from turbulent premixed flames , 2009, Journal of Fluid Mechanics.

[11]  Ming C. Lin,et al.  Example-guided physically based modal sound synthesis , 2013, ACM Trans. Graph..

[12]  Duc Quang Nguyen,et al.  Physically based modeling and animation of fire , 2002, ACM Trans. Graph..

[13]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[14]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[15]  Chen Shen,et al.  Synthesizing sounds from rigid-body simulations , 2002, SCA '02.

[16]  Qinglin Wu,et al.  Chemical Coupling in Wood Fiber and Polymer Composites: A Review of Coupling Agents and Treatments , 2000 .

[17]  Jeong-Mo Hong,et al.  Bubbles alive , 2008, SIGGRAPH 2008.

[18]  Yoshinori Dobashi,et al.  Synthesizing Sound from Turbulent Field using Sound Textures for Interactive Fluid Simulation , 2004, Comput. Graph. Forum.

[19]  Yoshinori Dobashi,et al.  Real-time rendering of aerodynamic sound using sound textures based on computational fluid dynamics , 2003, ACM Trans. Graph..

[20]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[21]  F. G. Leppington,et al.  Modern Methods in Analytical Acoustics , 1992 .

[22]  Doug L. James,et al.  Inverse-Foley animation , 2014, ACM Trans. Graph..

[23]  Dani Lischinski,et al.  Synthesizing Sound Textures through Wavelet Tree Learning , 2002, IEEE Computer Graphics and Applications.

[24]  Arun N. Netravali,et al.  Reconstruction filters in computer-graphics , 1988, SIGGRAPH.

[25]  Shiguang Liu,et al.  Sounding fire for immersive virtual reality , 2015, Virtual Reality.

[26]  Julien Pinquier,et al.  Water sound recognition based on physical models , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[27]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..