Jamming with Plunderphonics: Interactive concatenative synthesis of music

Abstract This paper proposes to use the techniques of Concatenative Sound Synthesis in the context of real-time Music Interaction. We describe a system that generates an audio track by concatenating audio segments extracted from pre-existing musical files. The track can be controlled in real-time by specifying high-level properties (or constraints) holding on metadata about the audio segments. A constraint-satisfaction mechanism, based on local search, selects audio segments that best match those constraints at any time. We describe the real-time aspects of the system, notably the asynchronous adding/removing of constraints, and report on several constraints and controllers designed for the system. We illustrate the system with several application examples, notably a virtual drummer able to interact with a human musician in real-time.

[1]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[2]  Robert Rowe,et al.  Machine Musicianship , 2001 .

[3]  François Pachet,et al.  Musical Harmonization with Constraints: A Survey , 2004, Constraints.

[4]  François Pachet,et al.  Automatic extraction of music descriptors from acoustic signals , 2004, ISMIR.

[5]  François Pachet,et al.  Scaling up music playlist generation , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[6]  Ajay Kapur,et al.  Yeah, ChucK It! => Dynamic, Controllable Interface Mapping , 2005, NIME.

[7]  Phil Burk.  JSyn - A Real-time Synthesis API for Java , 1998, ICMC.

[8]  François Pachet,et al.  Reifying Constraint Satisfaction in Smalltalk , 1997, J. Object Oriented Program..

[9]  Eric D. Scheirer,et al.  Tempo and beat analysis of acoustic musical signals. , 1998, The Journal of the Acoustical Society of America.

[10]  Perry R. Cook,et al.  MOSIEVIUS: FEATURE DRIVEN INTERACTIVE AUDIO MOSAICING , 2003 .

[11]  François Pachet,et al.  The Cuidado music browser: an end-to-end electronic music distribution system , 2006, Multimedia Tools and Applications.

[12]  François Pachet,et al.  The Continuator: Musical Interaction With Style , 2003, ICMC.

[13]  Diemo Schwarz.  THE CATERPILLAR SYSTEM FOR DATA-DRIVEN CONCATENATIVE SOUND SYNTHESIS , 2003 .

[14]  Diemo Schwarz,et al.  Current Research in concatenative sound synthesis , 2005, ICMC.

[15]  François Pachet,et al.  The framework approach for constraint satisfaction , 2000, CSUR.

[16]  François Pachet,et al.  A Combinatorial Approach to Content-Based Music Selection , 2000, IEEE Multim..

[17]  François Pachet,et al.  Ringomatic: A Real-Time Interactive Drummer Using Constraint-Satisfaction and Drum Sound Descriptors , 2005, ISMIR.

[18]  F. Pachet,et al.  MUSICAL MOSAICING , 2001 .

[19]  John Zorn,et al.  Arcana : musicians on music , 1999 .

[20]  Philippe Codognet,et al.  Yet Another Local Search Method for Constraint Solving , 2001, SAGA.

[21]  François Pachet,et al.  ON-THE-FLY MULTI TRACK MIXING , 2000 .

[22]  Thierry Dutoit.  Data-driven techniques in speech synthesis , 2002, Computational Linguistics.

[23]  Ian M. Graham.  In Search of the Three Best Books , 1997, J. Object Oriented Program..