Modal Synthesis for Arbitrarily Shaped Objects

22 Computer Music Journal This research extends real-time, physics-based sound synthesis in computer music. Using our system, one can synthesize sounds resulting from striking three-dimensional models of objects in an interactive music setting. In computer music, previous software synthesizers have focused on modeling shapes for which there is an analytical solution. Our method allows for the design of atypical object shapes for which finding an analytical solution may be impossible. Creating such object sounds using software synthesizers available today would require an intimate knowledge of the frequency spectrum of that object and precise tuning of a number of digital oscillators. Tuning would require not only frequency adjustment but also precise amplitude envelope settings for each oscillator. Using our system, one would need only a three-dimensional model and a selection of material to generate the object’s frequency spectra. This method also allows for real-time modification to the intensity, direction, and location of the object strike, a feature generic instrument sampling cannot provide. We also provide controls over material parameters and object scale. Such flexibility also allows computer musicians to explore realistic (and even unrealistic) instrument sounds.

[1]  Tapio Takala,et al.  Sound rendering , 1992, SIGGRAPH.

[2]  Hyeong-Seok Ko,et al.  Modal warping: real-time simulation of large rotational deformation and manipulation , 2004, IEEE Transactions on Visualization and Computer Graphics.

[3]  D. Chapelle,et al.  The Finite Element Analysis of Shells - Fundamentals , 2003 .

[4]  Andrew Horner,et al.  Detection of random alterations to time-varying musical instrument spectra. , 2004, The Journal of the Acoustical Society of America.

[5]  Chen Shen,et al.  Synthesizing sounds from rigid-body simulations , 2002, SCA '02.

[6]  Curtis Roads,et al.  The Computer Music Tutorial , 1996 .

[7]  Cagatay Basdogan,et al.  Virtual environments for medical training: graphical and haptic simulation of laparoscopic common bile duct exploration , 2001 .

[8]  Thomas D. Rossing,et al.  Science of Percussion Instruments , 2001 .

[9]  Stefan Bilbao,et al.  MODAL-TYPE SYNTHESIS TECHNIQUES FOR NONLINEAR STRINGS WITH AN ENERGY CONSERVATION PROPERTY , 2004 .

[10]  Chen Shen,et al.  Interactive Deformation Using Modal Analysis with Constraints , 2003, Graphics Interface.

[11]  Perry R. Cook,et al.  Music, Cognition, and Computerized Sound , 1999 .

[12]  Dinesh K. Pai,et al.  DyRT: dynamic response textures for real time deformation simulation with graphics hardware , 2002, SIGGRAPH.

[13]  Antoine Chaigne,et al.  TIME-DOMAIN MODELING AND NUMERICAL SIMULATION OF A KETTLEDRUM , 1999 .

[14]  Lawrence E. Kinsler,et al.  Fundamentals of Acoustics, 4th Edition , 1999 .

[15]  Chen Shen,et al.  Modal analysis for real-time viscoelastic deformation , 2002, SIGGRAPH '02.

[16]  F. Fahy,et al.  Sound and Structural Vibration: Radiation, Transmission and Response , 1987 .

[17]  James F. O'Brien,et al.  Synthesizing Sounds from Physically Based Motion , 2001, SIGGRAPH Video Review on Animation Theater Program.

[18]  Perry R. Cook,et al.  Physically Informed Sonic Modeling (PhISM): Synthesis of percussive sounds , 1997 .

[19]  Michael Cohen,et al.  Proceedings of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, San Antonio, TX, USA, July 21-22, 2002 , 2002, Symposium on Computer Animation.

[20]  P. Guillaume.  MODAL ANALYSIS , 2022 .

[21]  Yoshinori Dobashi,et al.  Real-time rendering of aerodynamic sound using sound textures based on computational fluid dynamics , 2003, ACM Trans. Graph..

[22]  Dinesh K. Pai,et al.  Interactive Simulation of Complex Audiovisual Scenes , 2004, Presence: Teleoperators & Virtual Environments.

[23]  N. Fletcher,et al.  Music Producers.(Book Reviews: The Physics of Musical Instruments.) , 1991 .

[24]  Jean-Marie Adrien,et al.  The missing link: modal synthesis , 1991 .

[25]  Perry R. Cook,et al.  Music, cognition, and computerized sound: an introduction to psychoacoustics , 1999 .

[26]  L. Rayleigh,et al.  The theory of sound , 1894 .

[27]  Alex Pentland,et al.  Good vibrations: modal dynamics for graphics and animation , 1989, SIGGRAPH.

[28]  Jean-Marie Adrien,et al.  MOSAIC: A Framework for Modal Synthesis , 1993 .

[29]  Lawrence E. Kinsler,et al.  Fundamentals of acoustics , 1950 .

[30]  Arthur W. Leissa,et al.  Vibration of Plates , 2021, Solid Acoustic Waves and Vibration.

[31]  Dinesh K. Pai,et al.  Physically-based Sound Eects for Interactive Simulation and Animation , 2001 .

[32]  Jernej Barbic,et al.  Squashing cubes: automating deformable model construction for graphics , 2004, SIGGRAPH '04.

[33]  James Demmel,et al.  Applied Numerical Linear Algebra , 1997 .

[34]  Dinesh K. Pai,et al.  The Sounds of Physical Shapes , 1998, Presence.

[35]  Jos Stam,et al.  Stochastic Dynamics: Simulating the Effects of Turbulence on Flexible Structures , 1997 .

[36]  Giovanni De Poli,et al.  Representations of Musical Signals , 1991, Leonardo Music Journal.

[37]  Ronen Barzel,et al.  Faking Dynamics of Ropes and Springs , 1997, IEEE Computer Graphics and Applications.