Sound authoring tools for future multimedia systems

A framework for authoring non-speech sound objects in the context of multimedia systems is proposed. The goal is to design specific sounds and their dynamic behavior in such a way that they convey dynamic and multidimensional information. Sounds are designed using a three-layer abstraction model: physically-based description of sound identity, signal-based description of sound quality, perception- and geometry-based description of sound projection in space. The model is validated with the aid of an experimental tool where manipulation of sound objects can be performed in three ways: handling a set of parameter control sliders, editing the evolution in time of compound parameter settings, via client applications sending their requests to the sounding engine.

[1]  Gary S. Kendall,et al.  The Decorrelation of Audio Signals and Its Impact on Spatial Imagery , 1995 .

[2]  Davide Rocchesso.  The Ball within the Box: A Sound-Processing Metaphor , 1995 .

[3]  Gary S. Kendall,et al.  A 3-D Sound Primer: Directional Hearing and Stereo Reproduction , 1995 .

[4]  Pierre Schaeffer,et al.  Traité des objets musicaux : essai interdisciplines , 1966 .

[5]  Stephen Barrass.  Sculpting a sound space with information properties , 1996 .

[6]  J. Grey.  Multidimensional perceptual scaling of musical timbres. , 1977, The Journal of the Acoustical Society of America.

[7]  Davide Rocchesso,et al.  Circulant and elliptic feedback delay networks for artificial reverberation , 1997, IEEE Trans. Speech Audio Process..

[8]  Jean-Marc Jot,et al.  A Real-Time Spatial Sound Processor for Music and Virtual Reality Applications , 1995, ICMC.

[9]  Paolo Prandoni,et al.  Sonological models for timbre characterization , 1997 .

[10]  Woodrow Barfield,et al.  The Sense of Presence within Auditory Virtual Environments , 1996, Presence: Teleoperators & Virtual Environments.

[11]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[12]  Hugo Fastl,et al.  Psychoacoustics: Facts and Models , 1990 .

[13]  Davide Rocchesso,et al.  Physically based sound modelling , 1998, Organised Sound.

[14]  Chris Kyriakakis.  Fundamental and technological limitations of immersive audio systems , 1998 .

[15]  Stephen Barrass,et al.  Auditory information design , 1998 .

[16]  Roger B. Dannenberg,et al.  Real-time software synthesis on superscalar architectures , 1997 .

[17]  Daniel A. Reed,et al.  Data Sonification: Do You See What I Hear? , 1995, IEEE Softw..

[18]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[19]  Giovanni De Poli.  In search of new sounds , 1996 .