The Sounds of Physical Shapes

We propose a general framework for the simulation of sounds produced by colliding physical objects in a virtual reality environment. The framework is based on the vibration dynamics of bodies. The computed sounds depend on the material of the body, its shape, and the location of the contact. This simulation of sounds allows the user to obtain important auditory clues about the objects in the simulation, as well as about the locations on the objects of the collisions. Specifically, we show how to compute (1) the spectral signature of each body (its natural frequencies), which depends on the material and the shape, (2) the timbre of the vibration (the relative amplitudes of the spectral components) generated by an impulsive force applied to the object at a grid of locations, (3) the decay rates of the various frequency components that correlate with the type of material, based on its internal friction parameter, and finally (4) the mapping of sounds onto the object's geometry for real-time rendering of the resulting sound. The framework has been implemented in a Sonic Explorer program which simulates a room with several objects such as a chair, tables, and rods. After a preprocessing stage, the user can hit the objects at different points to interactively produce realistic sounds.

[1]  P. Morse.  Vibration and Sound , 1949, Nature.

[2]  H. Lamb.  The Dynamical Theory of Sound , 1965 .

[3]  M. Kac.  Can One Hear the Shape of a Drum , 1966 .

[4]  C. Moler,et al.  APPROXIMATIONS AND BOUNDS FOR EIGENVALUES OF ELLIPTIC OPERATORS , 1967 .

[5]  E. Owens,et al.  An Introduction to the Psychology of Hearing , 1997 .

[6]  F. Fahy,et al.  Sound and Structural Vibration: Radiation, Transmission and Response , 1987 .

[7]  Editors , 1986, Brain Research Bulletin.

[8]  C. Wert.  Internal friction in solids , 1986 .

[9]  Gilbert Strang,et al.  Introduction to applied mathematics , 1988 .

[10]  A. R. Mitchell.  Numerical solutions of partial differential equations by the finite element method, Claes Johnson, Cambridge University Press, Cambridge, 1987. No. pages: 278. Price £40.00 hardback, £15.00 paperback. ISBN 0‐521347‐58‐0 , 1988 .

[11]  F. B. Ellerby,et al.  Numerical solutions of partial differential equations by the finite element method , by C. Johnson. Pp 278. £40 (hardback), £15 (paperback). 1988. ISBN 0-521-34514-6, 34758-0 (Cambridge University Press) , 1989, The Mathematical Gazette.

[12]  Alex Pentland,et al.  Good vibrations: modal dynamics for graphics and animation , 1989, SIGGRAPH.

[13]  Donald P. Greenberg,et al.  Computer graphics visualization for acoustic simulation , 1989, SIGGRAPH '89.

[14]  Frederick P. Brooks,et al.  Towards image realism with interactive update rates in complex virtual building environments , 1990, I3D '90.

[15]  S. Schwerman,et al.  The Physics of Musical Instruments , 1991 .

[16]  David L. Webb,et al.  Isospectral plane domains and surfaces via Riemannian orbifolds , 1992 .

[17]  Tapio Takala,et al.  Sound rendering , 1992, SIGGRAPH.

[18]  William W. Gaver.  What in the World Do We Hear? An Ecological Approach to Auditory Event Perception , 1993 .

[19]  William W. Gaver.  Synthesizing auditory icons , 1993, INTERCHI.

[20]  Alexander F. Vakakis,et al.  Theory of Vibration: I. An Introduction and II: Discrete and Continuous Systems (A. A. Shabana) , 1993, SIAM Rev..

[21]  Bill Gardner,et al.  HRTF Measurements of a KEMAR Dummy-Head Microphone , 1994 .

[22]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[23]  Nathaniel I. Durlach,et al.  Virtual Reality: Scientific and Technological Challenges , 1994 .

[24]  Eric Krotkov,et al.  Robotic Perception of Material: Experiments with Shape-Invariant Acoustic Measures of Material Type , 1995, ISER.

[25]  Tapio Takala,et al.  An integrated approach to motion and sound , 1995, Comput. Animat. Virtual Worlds.

[26]  Dinesh K. Pai,et al.  Haptic texturing-a stochastic approach , 1996, Proceedings of IEEE International Conference on Robotics and Automation.