Physically-based real-time modeling of contact sounds

In the following the theory, background and practical use of several real-time sound models of contact scenarios are described. The common audio synthesis core is an algorithm derived from a physically-based impact model, where the acoustic characteristics of colliding objects can be realistically simulated by properly adjusting the physical parameters of the model. Techniques of parameter adjustment are explained for the expression of attributes of ecological hearing, in particular material and position of interaction, starting from physical and/or acoustical specifications. It is shown that in final combination with relevant higherlevel structures an efficient implementation of various expressive sound objects is reached. The intuitive practical usability of the models, running in real-time on low cost platforms, is demonstrated, underlining the potential of benefit for a wide range of applications.

[1]  D. Freed,et al.  Auditory correlates of perceived mallet hardness for a set of recorded percussive sound events. , 1990, The Journal of the Acoustical Society of America.

[2]  W H Warren,et al.  Auditory perception of breaking and bouncing events: a case study in ecological acoustics. , 1984, Journal of experimental psychology. Human perception and performance.

[3]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[4]  James F. O'Brien,et al.  Synthesizing sounds from physically based motion , 2001, SIGGRAPH.

[5]  K. H. Hunt,et al.  Coefficient of Restitution Interpreted as Damping in Vibroimpact , 1975 .

[6]  Davide Rocchesso,et al.  MODELING COLLISION SOUNDS: NON-LINEAR CONTACT FORCE , 2001 .

[7]  William Buxton Using our ears: an introduction to the use of nonspeech audio cues , 1990, Other Conferences.

[8]  Mark T. Marshall,et al.  The Virtual Bodhran - The Vodhran , 2002, NIME.

[9]  D. Norman,et al.  Everyday listening and auditory icons , 1988 .

[10]  David E. Orin,et al.  A compliant contact model with nonlinear damping for simulation of robotic systems , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[11]  Dinesh K. Pai,et al.  Perception of Material from Contact Sounds , 2000, Presence: Teleoperators & Virtual Environments.

[12]  Jean-Marie Adrien,et al.  The missing link: modal synthesis , 1991 .

[13]  Davide Rocchesso,et al.  Controlling Material Properties in Physical Models of Sounding Objects , 2001, ICMC.