REAL-TIME CORPUS-BASED CONCATENATIVE SYNTHESIS WITH CATART

The concatenative real-time sound synthesis system CataRT plays grains from a large corpus of segmented and descriptor-analysed sounds according to proximity to a target position in the descriptor space. This can be seen as a content-based extension to granular synthesis providing direct access to specific sound characteristics. CataRT is implemented in Max/MSP using the FTM library and an SQL database. Segmentation and MPEG-7 descriptors are loaded from SDIF files or generated on-the-fly. CataRT allows to explore the corpus interactively or via a target sequencer, to resynthesise an audio file or live input with the source sounds, or to experiment with expressive speech synthesis and gestural control.

[1]  Xavier Rodet,et al.  Speech Rates in French Expressive Speech , 2006 .

[2]  Miller Puckette.  Low-dimensional parameter mapping using spectral envelopes , 2004, ICMC.

[3]  Perry R. Cook,et al.  MOSIEVIUS: FEATURE DRIVEN INTERACTIVE AUDIO MOSAICING , 2003 .

[4]  A. Röbel.  A NEW APPROACH TO TRANSIENT PROCESSING IN THE PHASE VOCODER , 2003 .

[5]  M. Davies,et al.  Complex domain onset detection for musical signals , 2003 .

[6]  France,et al.  Onset Detection in Polyphonic Signals by means of Transient Peak Classification , 2005 .

[7]  François Pachet,et al.  From Sound Sampling To Song Sampling , 2004, ISMIR.

[8]  Alan P. Parkes,et al.  DESCRIPTION-DRIVEN CONTEXT-SENSITIVE EFFECTS , 2003 .

[9]  Xavier Rodet,et al.  PCA-based branch and bound search algorithms for computing K nearest neighbors , 2003, Pattern Recognit. Lett..

[10]  Alain de Cheveigné,et al.  Fundamental frequency estimation of musical sounds , 2002 .

[11]  Diemo Schwarz.  Concatenative sound synthesis: The early years , 2006 .

[12]  Diemo Schwarz,et al.  A SYSTEM FOR DATA-DRIVEN CONCATENATIVE SOUND SYNTHESIS , 2000 .

[13]  Xavier Rodet,et al.  A HYBRID CONCATENATIVE SYNTHESIS SYSTEM ON THE INTERSECTION OF MUSIC AND SPEECH , .

[14]  Curtis Roads,et al.  Introduction to Granular Synthesis , 1988 .

[15]  Xavier Rodet,et al.  Hybrid Concatenative Synthesis On The Intersection of Music and Speech , 2005 .

[16]  Michael A. Casey,et al.  Acoustic lexemes for organizing internet audio , 2005 .

[17]  Xiang Pei.  A NEW SCHEME FOR REAL-TIME LOOP MUSIC PRODUCTION BASED ON GRANULAR SIMILARITY AND PROBABILITY CONTROL , 2002 .

[18]  Eric Lindemann.  Musical synthesizer capable of expressive phrasing , 2002 .

[19]  François Pachet,et al.  Ringomatic: A Real-Time Interactive Drummer Using Constraint-Satisfaction and Drum Sound Descriptors , 2005, ISMIR.

[20]  A. Lindsay.  Audio Mosaicing: Feature-Driven Audio Editing/Synthesis , 2005 .

[21]  Diemo Schwarz.  THE CATERPILLAR SYSTEM FOR DATA-DRIVEN CONCATENATIVE SOUND SYNTHESIS , 2003 .