Real-time timbral organisation: Selecting samples based upon similarity1

A comparison is made between two systems of real-time sample selection using timbral proximity that has relevance for live performance. Sound files in large sample libraries are analysed for audio features (amplitude RMS, spectral centroid, spectral flatness, and spectral energy using a Bark auditory modeller), and this data is statistically analysed and stored. Two methods of organisation are described: the first uses fuzzy logic to rate sample similarity, the second uses a self-organising map. The benefits and detriments of each method are described.

[1]  Arne Eigenfeldt,et al.  Realtime Selection of Percussion Samples Through Timbral Similarity in Max/MSP , 2009, ICMC.

[2]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[3]  Tommy W. S. Chow,et al.  A flexible multi-layer self-organizing map for generic processing of tree-structured data , 2007, Pattern Recognit..

[4]  P. Cano,et al.  Automatic sound annotation , 2004, Proceedings of the 2004 14th IEEE Signal Processing Society Workshop Machine Learning for Signal Processing, 2004..

[5]  William Hsu,et al.  Managing Gesture and Timbre for Analysis and Instrument Control in an Interactive Environment , 2006, NIME.

[6]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[7]  Arne Eigenfeldt,et al.  The Evolution of Evolutionary Software: Intelligent Rhythm Generation in Kinetic Engine , 2009, EvoWorkshops.

[8]  Perry R. Cook,et al.  Support for MIR Prototyping and Real-Time Applications in the ChucK Programming Language , 2008, ISMIR.

[9]  Rolf Drechsler,et al.  Applications of Evolutionary Computing, EvoWorkshops 2008: EvoCOMNET, EvoFIN, EvoHOT, EvoIASP, EvoMUSART, EvoNUM, EvoSTOC, and EvoTransLog, Naples, Italy, March 26-28, 2008. Proceedings , 2008, EvoWorkshops.

[10]  Peter Knees,et al.  Automatically Describing Music on a Map , 2006 .

[11]  Thomas Ciufo.  Beginner's Mind: an Environment for Sonic Improvisation , 2005, ICMC.

[12]  Beth Logan,et al.  Content-Based Playlist Generation: Exploratory Experiments , 2002, ISMIR.

[13]  Jouko Lampinen,et al.  Clustering properties of hierarchical self-organizing maps , 1992, Journal of Mathematical Imaging and Vision.

[14]  Bob L. Sturm,et al.  Proceedings of the International Computer Music Conference , 2011 .

[15]  Dominik Lübbers.  SoniXplorer: Combining Visualization and Auralization for Content-Based Exploration of Music Collections , 2005, ISMIR.

[16]  Gerhard Widmer,et al.  Exploring Music Collections by Browsing Different Views , 2004, Computer Music Journal.

[17]  Cort Lippe,et al.  A Composition for Clarinet and Real-Time Signal Processing : Using Max on the IRCAM Signal Processing Workstation , 1998 .

[18]  George Tzanetakis,et al.  MARSYAS: a framework for audio analysis , 1999, Organised Sound.

[19]  Pedro Rebelo,et al.  The Frequencyliator - Distributing Structures for Networked Laptop Improvisation , 2006, NIME.

[20]  François Pachet,et al.  Music Similarity Measures: What's the use? , 2002, ISMIR.

[21]  Tristan Jehan,et al.  An Audio-Driven Perceptually Meaningful Timbre Synthesizer , 2001, ICMC.

[22]  E. Zwicker,et al.  Subdivision of the audible frequency range into critical bands , 1961 .