MidiSpace: a temporal constraint-based music spatializer

1. ABSTRACT We develop multimedia technology for enriching the music listening experience. We propose a system - MidiSpace - in which users may listen to music while controlling in real time the localization of sound sources, through a simple interface. We introduce the problem of mixing consistency, and propose a solution based on a constraint propagation mechanism. The proposed system contains both an authoring mode, in which sound engineers may specify spatialization constraints to be satisfied, and a listening mode in which listeners can modify the localization of sources under the supervision of a constraint solver that ensures the spatialization always satisfies the constraints. We describe the architecture of the system and report on experiments done so far.

[1]  Mikael Laurson,et al.  Patchwork: a Graphic Language in preFORM , 1989, ICMC.

[2]  Bjørn N. Freeman-Benson,et al.  Indigo: a local propagation algorithm for inequality constraints , 1996, UIST '96.

[3]  Heinrich Taube,et al.  Common music. A music composition language in common lisp and CLOS , 1991 .

[4]  Bjørn N. Freeman-Benson,et al.  Kaleidoscope: A Constraint Imperative Programming Language , 1993, NATO ASI CP.

[5]  François Pachet,et al.  Representing temporal musical objects and reasoning in the MusES system , 1996 .

[6]  Satoshi Matsuoka,et al.  Generalized Local Propagation: A Framework for Solving Constraint Hierarchies , 1996, CP.

[7]  Alan Borning,et al.  ThingLab: a constraint-oriented simulation laboratory , 1979 .

[8]  Bradley T. Vander Zanden,et al.  An incremental algorithm for satisfying hierarchies of multiway dataflow constraints , 1996, TOPL.

[9]  Leonard B. Meyer Emotion and Meaning in Music , 1957 .

[10]  O. Delerue,et al.  MidiSpace : a Temporal Constraint-Based Music , 1998 .

[11]  Jean-Marc Jot,et al.  A Real-Time Spatial Sound Processor for Music and Virtual Reality Applications , 1995, ICMC.

[12]  Alan Borning,et al.  The Programming Language Aspects of ThingLab, a Constraint-Oriented Simulation Laboratory , 1981, TOPL.

[13]  Bjørn N. Freeman-Benson,et al.  The OTI Constraint Solver: A Constraint Library for Constructing Interactive Graphical User Interfaces , 1995, CP.

[14]  Yann Orlarey,et al.  A real time multi-tasks software module for Midi applications , 1989 .

[15]  Kouichi Matsuda,et al.  Java for 3d and Vrml Worlds , 1996 .

[16]  Philipp Ackermann Developing Object-Oriented Multimedia Software , 1997 .

[17]  John M. Chowning,et al.  THE SIMULATION OF MOVING SOUND SOURCES , 1970 .

[18]  Bjørn N. Freeman-Benson,et al.  Multi‐way versus one‐way constraints in user interfaces: Experience with the deltablue algorithm , 1993, Softw. Pract. Exp..

[19]  Alan Borning,et al.  Constraints for the web , 1997, MULTIMEDIA '97.

[20]  François Pachet,et al.  Computer Analysis of Jazz Chord Sequence: Is Solar a Blues? , 2000, Readings in Music and Artificial Intelligence.

[21]  Henrik Tramberend,et al.  Virtual Spaces - VR Projection System Technologies and Applications , 1997, Eurographics.

[22]  Gérard Assayag,et al.  An Object Oriented Visual Environment For Musical Composition , 1997, ICMC.

[23]  Donald Sloan Aspects of Music Representation in HyTime/SMDL , 1993 .

[24]  Winfried Graf,et al.  A bibliographical survey of constraint-based approaches to CAD, graphics, layout, visualization, and related topics , 1996, Knowl. Based Syst..