Object-based sound synthesis for virtual environments-using musical acoustics

We show how to construct an object-based environment for sound generation, whose objects can be individually synthesized and which can interact with each other through modelling of a potential interaction topology. We show how this interaction topology can be mode dynamic and time-varying. We also discuss how we envision an object-based environment that integrates geometric, radiometric, and intrinsic/extrinsic acoustic properties. We finally illustrate our first results towards modelling of complex sound generation systems.

[1]  Davide Rocchesso.  Maximally diffusive yet efficient feedback delay networks for artificial reverberation , 1997, IEEE Signal Processing Letters.

[2]  Davide Rocchesso,et al.  Bandwidth of perceived inharmonicity for physical modeling of dispersive strings , 1999, IEEE Trans. Speech Audio Process..

[3]  H. Kuttruff.  A simple iteration scheme for the computation of decay constants in enclosures with diffusely reflecting boundaries , 1995 .

[4]  Augusto Sarti,et al.  Multi-camera systems , 1999 .

[5]  K. Meerkotter,et al.  Digital simulation of nonlinear circuits by wave digital filter principles , 1989, IEEE International Symposium on Circuits and Systems,.

[6]  Luc Van Gool,et al.  Automatic 3D model building from video sequences , 1997, Eur. Trans. Telecommun..

[7]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[8]  Augusto Sarti,et al.  A Modular Approach to Excitator-Resonator Interaction in Physical Models Synthesis , 1989, ICMC.

[9]  Tapio Lokki,et al.  Virtual Environment Simulation - Advances in the DIVA project , 1997 .

[10]  Nicolas Tsingos,et al.  A general model for the simulation of room acoustics based on hierachical radiosity , 1997, SIGGRAPH '97.

[11]  Rudolf Rabenstein,et al.  Simulation of wave propagation by multidimensional digital filters , 1996, Simul. Pract. Theory.

[12]  Jont B. Allen,et al.  Image method for efficiently simulating small‐room acoustics , 1976 .

[13]  A. Fettweis.  Wave digital filters: Theory and practice , 1986, Proceedings of the IEEE.

[14]  Daniel Thalmann,et al.  Computer Animation and Simulation ’95 , 1995, Eurographics.

[15]  Augusto Sarti,et al.  3D area matching with arbitrary multiview geometry , 1998, Signal Process. Image Commun..

[16]  Rudolf Rabenstein,et al.  Application of multidimensional wave digital filters to boundary value problems , 1995, IEEE Signal Processing Letters.

[17]  Pat Hanrahan,et al.  Beam tracing polygonal objects , 1984, SIGGRAPH.

[18]  T. Felderhoff,et al.  A new wave description for nonlinear elements , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[19]  Alfred Fettweis,et al.  On adaptors for wave digital filters , 1975 .

[20]  Leon O. Chua,et al.  Device modeling via nonlinear circuit elements , 1980 .

[21]  Cliff B. Jones,et al.  A New Approach to the 'Hidden Line' Problem , 1971, Comput. J..

[22]  Augusto Sarti,et al.  Generalized adaptors with memory for nonlinear wave digital structures , 1996, 1996 8th European Signal Processing Conference (EUSIPCO 1996).

[23]  Julius O. Smith,et al.  Traveling Wave Implementation of a Lossless Mode-coupling Filter and the Wave Digital Hammer , 1994, ICMC.

[24]  Davide Rocchesso,et al.  Physical modeling of membranes for percussion instruments , 1998 .

[25]  Giovanni De Poli.  A Tutorial on Digital Sound Synthesis Techniques , 1983 .

[26]  Augusto Sarti,et al.  Visible surface reconstruction with accurate localization of object boundaries , 2000, IEEE Trans. Circuits Syst. Video Technol..

[27]  Paul A. Beardsley,et al.  3D Model Acquisition from Extended Image Sequences , 1996, ECCV.

[28]  A. Krokstad,et al.  Calculating the acoustical room response by the use of a ray tracing technique , 1968 .

[29]  L. Chua.  Dynamic nonlinear networks: State-of-the-art , 1980 .

[30]  Demetri Terzopoulos,et al.  Physically based models with rigid and deformable components , 1988, IEEE Computer Graphics and Applications.

[31]  David G. Kirkpatrick,et al.  The geometry of beam tracing , 1985, SCG '85.

[32]  M. Hodgson.  Evidence of diffuse surface reflections in rooms , 1990 .

[33]  T. Lewers,et al.  A combined beam tracing and radiatn exchange computer model of room acoustics , 1993 .

[34]  Augusto Sarti,et al.  Toward the automatic synthesis of nonlinear wave digital models for musical acoustics , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[35]  Donald P. Greenberg,et al.  Modeling the interaction of light between diffuse surfaces , 1984, SIGGRAPH.

[36]  Augusto Sarti,et al.  Toward nonlinear wave digital filters , 1999, IEEE Trans. Signal Process..

[37]  Matti Karjalainen,et al.  Efficient and Parametric Reverberator for Room Acoustics Modeling , 1997, ICMC.

[38]  L. Chua.  Memristor-The missing circuit element , 1971 .

[39]  Giovanni De Poli,et al.  Algorithms and Structures for Synthesis Using Physical Models , 1992 .

[40]  J. Borish.  Extension of the image model to arbitrary polyhedra , 1984 .

[41]  Davide Rocchesso,et al.  Circulant and elliptic feedback delay networks for artificial reverberation , 1997, IEEE Trans. Speech Audio Process..

[42]  Robert L. Cook,et al.  Distributed ray tracing , 1998 .

[43]  R. Rabenstein,et al.  DISCRETE SIMULATION OF UNIFORM TRANSMISSION LINES BY MULTIDIMENSIONAL DIGITAL FILTERS , 1996 .

[44]  Leon O. Chua,et al.  Synthesis of new nonlinear network elements , 1968 .

[45]  A. Fettweis.  Pseudo-passivity, sensitivity, and stability of wave digital filters , 1972 .

[46]  Thomas A. Funkhouser,et al.  A beam tracing approach to acoustic modeling for interactive virtual environments , 1998, SIGGRAPH.

[47]  Carlo H. Séquin,et al.  Visibility preprocessing for interactive walkthroughs , 1991, SIGGRAPH.

[48]  A. Fettweis,et al.  Some principles of designing digital filters imitating classical filter structures , 1971, IEEE Transactions on Circuit Theory.

[49]  Augusto Sarti,et al.  Block-wise physical model synthesis for musical acoustics , 1999 .

[50]  L. Chua.  Nonlinear circuits , 1984 .

[51]  T. Felderhoff,et al.  Simulation of nonlinear circuits with period doubling and chaotic behavior by wave digital filter principles , 1994 .

[52]  Turner Whitted,et al.  An improved illumination model for shaded display , 1979, CACM.

[53]  H. Lehnert.  Systematic errors of the ray-tracing algorithm , 1993 .

[54]  Augusto Sarti,et al.  Multicamera motion estimation for high-accuracy 3D reconstruction , 2000, Signal Process..

[55]  Takeo Kanade,et al.  Virtualized Reality: Constructing Virtual Worlds from Real Scenes , 1997, IEEE Multim..

[56]  Jyri Huopaniemi,et al.  DIVA Virtual Audio Reality System , 1996 .