Synthesizing contact sounds between textured models

We present a new interaction handling model for physics-based sound synthesis in virtual environments. A new three-level surface representation for describing object shapes, visible surface bumpiness, and microscopic roughness (e.g. friction) is proposed to model surface contacts at varying resolutions for automatically simulating rich, complex contact sounds. This new model can capture various types of surface interaction, including sliding, rolling, and impact with a combination of three levels of spatial resolutions. We demonstrate our method by synthesizing complex, varying sounds in several interactive scenarios and a game-like virtual environment. The three-level interaction model for sound synthesis enhances the perceived coherence between audio and visual cues in virtual reality applications.

[1]  Tapio Takala,et al.  Sound rendering , 1992, SIGGRAPH.

[2]  Davide Rocchesso,et al.  Interactive Simulation of rigid body interaction with friction-induced sound generation , 2005, IEEE Transactions on Speech and Audio Processing.

[3]  Dinesh K. Pai,et al.  Physically-based Sound Eects for Interactive Simulation and Animation , 2001 .

[4]  Matt Adcock,et al.  Interactive Granular Synthesis of Haptic Contact Sounds , 2002 .

[5]  Dinesh K. Pai,et al.  MEASUREMENTS OF PERCEPTUAL QUALITY OF CONTACT SOUND MODELS , 2002 .

[6]  Ming C. Lin,et al.  Interactive sound synthesis for large scale environments , 2006, I3D '06.

[7]  Doug L. James,et al.  Harmonic shells: a practical nonlinear sound model for near-rigid thin shells , 2009, SIGGRAPH 2009.

[8]  Dinesh K. Pai,et al.  The Sounds of Physical Shapes , 1998, Presence.

[9]  T. Dawson Game Creation using OGRE – Object-Oriented Graphics Rendering Engine , 2010 .

[10]  Dinesh Manocha,et al.  Interactive sound rendering , 2009, CAD/Graphics.

[11]  Perry R. Cook,et al.  Real Sound Synthesis for Interactive Applications , 2002 .

[12]  James F. O'Brien,et al.  Synthesizing Sounds from Physically Based Motion , 2001, SIGGRAPH Video Review on Animation Theater Program.

[13]  Davide Rocchesso,et al.  MODELING INTERACTIONS BETWEEN RUBBED DRY SURFACES USING AN ELASTO-PLASTIC FRICTION MODEL , 2002 .

[14]  Chen Shen,et al.  Synthesizing sounds from rigid-body simulations , 2002, SCA '02.

[15]  C. Glocker,et al.  Vibration of discrete and continuous systems , 1998 .

[16]  Anatole Lécuyer,et al.  Using an event-based approach to improve the multimodal rendering of 6DOF virtual contact , 2007, VRST '07.

[17]  George Drettakis,et al.  Fast modal sounds with scalable frequency-domain synthesis , 2008, ACM Trans. Graph..

[18]  Cynthia Bruyns,et al.  Modal Synthesis for Arbitrarily Shaped Objects , 2006, Computer Music Journal.