Synthesizing sounds from rigid-body simulations

This paper describes a real-time technique for generating realistic and compelling sounds that correspond to the motions of rigid objects. By numerically precomputing the shape and frequencies of an object's deformation modes, audio can be synthesized interactively directly from the force data generated by a standard rigid-body simulation. Using sparse-matrix eigen-decomposition methods, the deformation modes can be computed efficiently even for large meshes. This approach allows us to accurately model the sounds generated by arbitrarily shaped objects based only on a geometric description of the objects and a handful of material parameters. We validate our method by comparing results from a simulated set of wind chimes to audio measurements taken from a real set.

[1]  Tapio Takala,et al.  Sound rendering , 1992, SIGGRAPH.

[2]  H. Simon,et al.  TRLAN User Guide , 1999 .

[3]  Thomas A. Funkhouser,et al.  A beam tracing approach to acoustic modeling for interactive virtual environments , 1998, SIGGRAPH.

[4]  Thomas A. Funkhouser,et al.  Modeling acoustics in virtual environments using the uniform theory of diffraction , 2001, SIGGRAPH.

[5]  Jessica K. Hodgins,et al.  Graphical modeling and animation of brittle fracture , 1999, SIGGRAPH.

[6]  James F. O'Brien,et al.  Synthesizing Sounds from Physically Based Motion , 2001, SIGGRAPH Video Review on Animation Theater Program.

[7]  Lawrence E. Kinsler,et al.  Fundamentals of acoustics , 1950 .

[8]  James F. O'Brien,et al.  Graphical modeling and animation of ductile fracture , 2002, SIGGRAPH '02.

[9]  B. B. Bauer,et al.  Fundamentals of acoustics , 1963 .

[10]  Dinesh K. Pai,et al.  The Sounds of Physical Shapes , 1998, Presence.

[11]  Thomas A. Funkhouser,et al.  Priority‐Driven Acoustic Modeling for Virtual Environments , 2000, Comput. Graph. Forum.

[12]  Dinesh K. Pai,et al.  Synthesis of shape dependent sounds with physical modeling , 1996 .

[13]  Thomas A. Funkhouser,et al.  Real-time acoustic modeling for distributed virtual environments , 1999, SIGGRAPH.

[14]  Ed Anderson,et al.  LAPACK Users' Guide , 1995 .

[15]  Dinesh K. Pai,et al.  FoleyAutomatic: physically-based sound effects for interactive simulation and animation , 2001, SIGGRAPH.

[16]  Jack Dongarra,et al.  LAPACK Users' guide (third ed.) , 1999 .

[17]  Alex Pentland,et al.  Good vibrations: modal dynamics for graphics and animation , 1989, SIGGRAPH.

[18]  R. Cook,et al.  Concepts and Applications of Finite Element Analysis , 1974 .

[19]  Jack Dongarra,et al.  Templates for the Solution of Algebraic Eigenvalue Problems , 2000, Software, environments, tools.

[20]  Tapio Lokki,et al.  Virtual Environment Simulation - Advances in the DIVA project , 1997 .

[21]  Perry R. Cook,et al.  Real Sound Synthesis for Interactive Applications , 2002 .

[22]  Tapio Takala,et al.  An integrated approach to motion and sound , 1995, Comput. Animat. Virtual Worlds.