Spatial sound synthesis in computer-aided composition*

In this article we describe our ongoing research and development efforts towards integrating the control of sound spatialisation in computer-aided composition. Most commonly, the process of sound spatialisation is separated from the world of symbolic computation. We propose a model in which spatial sound rendering is regarded as a subset of sound synthesis, and spatial parameters are treated as abstract musical materials within a global compositional framework. The library OMPrisma is presented, which implements a generic system for the control of spatial sound synthesis in the computer-aided composition environment OpenMusic.

[1]  Carlos Agon,et al.  Représentation des données de contrôle pour la spatialisation dans OpenMusic , 2010 .

[2]  Victor Lazzarini.  Extensions to the Csound Language from user-defined to plugin opcodes and beyond , 2005 .

[3]  Chandrasekhar Ramakrishnan,et al.  The ZKM Klangdom , 2006, NIME.

[4]  Jean Bresson.  SOUND PROCESSING IN OPENMUSIC , 2006 .

[5]  Camilo Rueda,et al.  Computer-Assisted Composition at IRCAM: From PatchWork to OpenMusic , 1999, Computer Music Journal.

[6]  Collectif.  The OM Composer's book 2 , 2006 .

[7]  Matthew Wright,et al.  Open Sound Control: an enabling technology for musical networking , 2005, Organised Sound.

[8]  Olivier Delerue,et al.  Spatialisation du son et programmation par contraintes : le système MusicSpace , 2004 .

[9]  Gérard Assayag,et al.  High Level Musical Control of Sound Synthesis in OpenMusic , 2000, ICMC.

[10]  Matthias Geier,et al.  Towards an Interchange Format for Spatial audio Scenes , 2008, ICMC.

[11]  Benjamin Cabaud,et al.  Le contrôle de la spatialisation multi-sources Nouvelles fonctionnalités dans Holophon version 2.2 , 2002 .

[12]  Udo Zölzer,et al.  Adaptive digital audio effects (a-DAFx): a new class of sound transformations , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[13]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1998 .

[14]  Marcelo M. Wanderley,et al.  Gesture Control of Sound Spatialization for Live Musical Performance , 2007, Gesture Workshop.

[15]  Cort Lippe,et al.  Techniques for Multi-Channel Real-Time Spatial Distribution Using Frequency-Domain Processing , 2004, NIME.

[16]  Nicolas Misdariis,et al.  DIRECTIVITY SYNTHESIS WITH A 3D ARRAY OF LOUDSPEAKERS APPLICATION FOR STAGE PERFORMANCE , 2001 .

[17]  Timothy A. Place,et al.  Jamoma: A Modular Standard for Structuring Patches in Max , 2006, ICMC.

[18]  Robin Maconie,et al.  Stockhausen on Music: Lectures and Interviews , 2000 .

[19]  Ville Pulkki.  Uniform spreading of amplitude panned virtual sources , 1999, Proceedings of the 1999 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics. WASPAA'99 (Cat. No.99TH8452).

[20]  Stephen McAdams,et al.  Towards a Spatial Sound Description Interchange Format (SpatDIF) , 2007 .

[21]  Jean-Marc Jot,et al.  A Real-Time Spatial Sound Processor for Music and Virtual Reality Applications , 1995, ICMC.

[22]  Daniel G. Bobrow,et al.  CLOS: integrating object-oriented and functional programming , 1991, CACM.

[23]  James McCartney,et al.  Rethinking the Computer Music Language: SuperCollider , 2002, Computer Music Journal.

[24]  Bob L. Sturm,et al.  Proceedings of the International Computer Music Conference , 2011 .

[25]  François Pachet,et al.  ON-THE-FLY MULTI TRACK MIXING , 2000 .

[26]  Jerome Daniel,et al.  Spatial Sound Encoding Including Near Field Effect: Introducing Distance Coding Filters and a Viable, New Ambisonic Format , 2003 .

[27]  Maria Anna Harley.  Spatiality of sound and stream segregation in twentieth century instrumental music , 1998 .

[28]  Eric Lindemann.  The IRCAM Musical Workstation: Hardware Overview and Signal Processing Features , 1990, ICMC.

[29]  Jonas Braasch.  A Loudspeaker-based 3D Sound Projection using Virtual Microphone Control (ViMiC) , 2005 .

[30]  François Pachet,et al.  MidiSpace: a temporal constraint-based music spatializer , 1998, MULTIMEDIA '98.

[31]  Jan C. Schacher,et al.  Ambisonics Spatialization Tools for Max/MSP , 2006, ICMC.

[32]  Harry D. Castle,et al.  Real-Time Implementation of a General Model for Spatial Processing of Sounds , 1983, ICMC.

[33]  Carlos Agon,et al.  Musical Representation of Sound in Computer-Aided Composition: A Visual Programming Framework , 2007 .

[34]  J. Daniel,et al.  Représentation de champs acoustiques, application à la transmission et à la reproduction de scènes sonores complexes dans un contexte multimédia , 2000 .

[35]  Miller S. Puckette,et al.  Combining Event and Signal Processing in the MAX Graphical Programming Environment , 1991 .

[36]  David Kim-Boyle.  Spectral spatialization - an Overview , 2008, ICMC.

[37]  Scott Wilson.  Spatial Swarm Granulation , 2008, ICMC.

[38]  Todor Todoroff,et al.  NeXTSTEP Graphical Interfaces to Control Sound Processing and Spatialization Instruments , 1997, ICMC.

[39]  Nils Günther Peters,et al.  A STRATIFIED APPROACH FOR SOUND SPATIALIZATION , 2009 .

[40]  Marlon Schumacher,et al.  Compositional Control of Periphonic Sound Spatialization , 2010 .

[41]  S Puckette Miller,et al.  Pure Data : another integrated computer music environment , 1996 .

[42]  Sascha Spors,et al.  The SoundScape Renderer: A Unified Spatial Audio Reproduction Framework for Arbitrary Rendering Methods , 2008 .

[43]  Dylan Menzies.  W-Panning and O-Format, Tools for Object Spatialization , 2002 .

[44]  Ville Pulkki,et al.  Virtual Sound Source Positioning Using Vector Base Amplitude Panning , 1997 .

[45]  Stefania Serafin,et al.  Spatio-Operational Spectral (S.O.S) Synthesis , 2003, ICMC.

[46]  Richard Boulanger.  The Csound book: perspectives in software synthesis, sound design, signal processing, and programming , 2000 .

[47]  Carlos Agon,et al.  Generation and Representation of Data and Events for the Control of Sound Synthesis , 2007 .

[48]  Bob L. Sturm,et al.  Analysis, Visualization, and Transformation of Audio Signals Using Dictionary-based Methods , 2009, ICMC.

[49]  A. Berkhout,et al.  Acoustic control by wave field synthesis , 1993 .

[50]  Marco Stroppa.  PARADIGMS FOR THE HIGH-LEVEL MUSICAL CONTROL OF DIGITAL SIGNAL PROCESSING , 2001 .

[51]  Gérard Assayag,et al.  Computer Assisted Composition today. , 1998 .