Sample Orchestrator : gestion par le contenu d'échantillons sonores

RESUME. Nous presentons les principaux travaux menes dans le projet Sample Orchestrator, destine au developpement de fonctions innovantes de manipulation d’echantillons sonores. Celles-ci se fondent sur des etudes consacrees a la description des sons, c’est-a-dire a la formalisation de structures de donnees pertinentes pour caracteriser le contenu et l’organisation des sons. Ces travaux ont ete appliques a l’indexation automatique des sons, ainsi qu’a la realisation d’applications inedites pour la creation musicale - synthese sonore interactive par corpus et aide informatisee a l’orchestration. Le projet a aussi comporte un important volet consacre au traitement de haute qualite des sons, a travers plusieurs perfectionnements du modele de vocodeur de phase ‐ traitement par modele sinusoidal dans le domaine spectral et calcul automatique des parametres d’analyse.

[1]  Diemo Schwarz,et al.  DESCRIPTOR-BASED SOUND TEXTURE SAMPLING , 2010 .

[2]  James A. Moorer,et al.  The Use of the Phase Vocoder in Computer Music Applications , 1976 .

[3]  Stephen McAdams,et al.  The sound quality of car horns: A psychoacoustical study of timbre , 2007 .

[4]  Stephen McAdams,et al.  Multidimensional characterisation of perceptual and preference judgements of vehicle and environmental noises , 1998 .

[5]  P. Codognet,et al.  Musical constraint satisfaction problems solved with adaptive search , 2004, Soft Comput..

[6]  Hugues Vinet,et al.  The Representation Levels of Music Information , 2003, CMMR.

[7]  S. Godsill,et al.  Multi-Gabor dictionaries for audio time-frequency analysis , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[8]  Andrzej Jaszkiewicz,et al.  Genetic local search for multi-objective combinatorial optimization , 2022 .

[9]  K. Deb.  An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[10]  Yann Geslin,et al.  Ecrins: an audio-content description environment for sound samples , 2002, ICMC.

[11]  J C Brown.  Computer identification of musical instruments using pattern recognition with cepstral coefficients as features. , 1999, The Journal of the Acoustical Society of America.

[12]  Axel Röbel,et al.  Signal decomposition by means of classification of spectral peaks , 2004, ICMC.

[13]  Suzanne Winsberg,et al.  A latent class approach to fitting the weighted Euclidean model, clascal , 1993 .

[14]  E. Lindemann.  Music Synthesis with Reconstructive Phrase Modeling , 2007, IEEE Signal Processing Magazine.

[15]  A. Röbel.  A NEW APPROACH TO TRANSIENT PROCESSING IN THE PHASE VOCODER , 2003 .

[16]  Matthew Chalmers,et al.  Improving hybrid MDS with pivot-based searching , 2003, IEEE Symposium on Information Visualization 2003 (IEEE Cat. No.03TH8714).

[17]  Axel Röbel,et al.  Adaptive Threshold Determination for Spectral Peak Classification , 2008, Computer Music Journal.

[18]  Dan Stowell,et al.  Timbre remapping through a regression-tree technique , 2010 .

[19]  Diemo Schwarz,et al.  What Next? Continuation in Real-Time Corpus-Based concatenative synthesis , 2008, ICMC.

[20]  Carlos Agón,et al.  Dynamic Musical Orchestration Using Genetic Algorithms and a Spectro-Temporal Description of Musical Instruments , 2010, EvoApplications.

[21]  Rolf Inge Godøy,et al.  Gestural-Sonorous Objects: embodied extensions of Schaeffer's conceptual apparatus , 2006, Organised Sound.

[22]  Damien Tardieu,et al.  Predicting Timbre Features of Instrument Sound Combinations: Application to Automatic Orchestration , 2010 .

[23]  Jordi Janer,et al.  Extending voice-driven synthesis to audio mosaicing , 2008 .

[24]  WoldErling,et al.  Content-Based Classification, Search, and Retrieval of Audio , 1996 .

[25]  Rolf Wöhrmann,et al.  Design and Architecture of Distributed Sound Processing and Database Systems for Web-Based Computer Music Applications , 1999, Computer Music Journal.

[26]  El-Ghazali Talbi,et al.  Metaheuristics - From Design to Implementation , 2009 .

[27]  Damian T. Murphy,et al.  A Comparative Evaluation of Techniques for Single-Frame Discrimination of Nonstationary Sinusoids , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[28]  Andrzej Jaszkiewicz.  Comparison of local search-based metaheuristics on the multiple objective knapsack problem , 2001 .

[29]  Jean Laroche,et al.  New Phase-Vocoder Techniques are Real-Time Pitch Shifting, Chorusing, Harmonizing, and Other Exotic Audio Modifications , 1999 .

[30]  Bruno Torrésani,et al.  Time-Frequency Jigsaw Puzzle: Adaptive Multiwindow and Multilayered Gabor Expansions , 2007, Int. J. Wavelets Multiresolution Inf. Process..

[31]  G. Lemaître,et al.  Timbre des sons environnementaux , 2005 .

[32]  Diemo Schwarz,et al.  SOUND SEARCH BY CONTENT-BASED NAVIGATION IN LARGE DATABASES , 2009 .

[33]  WrightMatthew.  Open Sound Control: an enabling technology for musical networking , 2005 .

[34]  François Pachet,et al.  The CUIDADO Project , 2002, ISMIR.

[35]  Jean Bresson,et al.  Interacting with Symbol, Sound, and Feature Spaces in Orchide, a Computer-Aided Orchestration Environment , 2010, Computer Music Journal.

[36]  Guillaume Lemaitre,et al.  Listener expertise and sound identification influence the categorization of environmental sounds. , 2010, Journal of experimental psychology. Applied.

[37]  Jae S. Lim,et al.  Signal estimation from modified short-time Fourier transform , 1983, ICASSP.

[38]  Patrick Susini,et al.  Validation of a multidimensional distance model for perceptual dissimilarities among musical timbres , 1998 .

[39]  Xavier Serra,et al.  Expressive Concatenative Synthesis by Reusing Samples from Real Performance Recordings , 2009, Computer Music Journal.

[40]  Diemo Schwarz,et al.  Surfing the Waves: Live Audio Mosaicing of an Electric Bass Performance as a Corpus Browsing Interface , 2010, NIME.

[41]  Stephen McAdams,et al.  Environmental Sound Perception: Metadescription and Modeling Based on Independent Primary Studies , 2010, EURASIP J. Audio Speech Music. Process..

[42]  Axel Röbel,et al.  Using the SDIF Sound Description Interchange Format for Audio Features , 2008, ISMIR.

[43]  Nick Collins.  Audiovisual concatenative synthesis , 2007, ICMC.

[44]  Diemo Schwarz,et al.  A SYSTEM FOR DATA-DRIVEN CONCATENATIVE SOUND SYNTHESIS , 2000 .

[45]  Stephen McAdams,et al.  Instrument Sound Description in the Context of MPEG-7 , 2000, ICMC.

[46]  Diemo Schwarz,et al.  Scalability in Content-Based Navigation of Sound Databases , 2009, ICMC.

[47]  G. Soete,et al.  Perceptual scaling of synthesized musical timbres: Common dimensions, specificities, and latent subject classes , 1995, Psychological research.

[48]  Xavier Serra,et al.  Sound transformations based on the SMS high level attributes , 1998 .

[49]  Enric Guaus,et al.  Nuvolet: 3D Gesture-driven Collaborative Audio Mosaicing , 2011, NIME.

[50]  J. L. Flanagan,et al.  PHASE VOCODER , 2008 .

[51]  William Brent.  A Timbre Analysis And Classification Toolkit For Pure Data , 2010, ICMC.

[52]  J. Grey.  Multidimensional perceptual scaling of musical timbres. , 1977, The Journal of the Acoustical Society of America.

[53]  Norbert Schnell,et al.  MnM: a Max/MSP mapping toolbox , 2005, NIME.

[54]  Thomas Baer,et al.  A model for the prediction of thresholds, loudness, and partial loudness , 1997 .

[55]  Stephen McAdams,et al.  Caractérisation du timbre des sons complexes.II. Analyses acoustiques et quantification psychophysique , 1994 .

[56]  Gérard Assayag,et al.  Solving the musical orchestration problem using multiobjective constrained optimization with a genetic local search approach , 2010, J. Heuristics.

[57]  Ben Shneiderman,et al.  Designing The User Interface , 2013 .

[58]  Axel Röbel.  A SHAPE-INVARIANT PHASE VOCODER FOR SPEECH TRANSFORMATION , 2010 .

[59]  Grégoire Carpentier,et al.  Approche computationnelle de l'orchestration musciale - Optimisation multicritère sous contraintes de combinaisons instrumentales dans de grandes banques de sons. (Computational Approach of Musical Orchestration - Constrained Multiobjective Optimization in Large Sound Sample Databases) , 2008 .

[60]  Arshia Cont,et al.  Making an orchestra speak , 2009 .

[61]  Xavier Rodet,et al.  Characterizing the sound quality of air-conditioning noise , 2004 .

[62]  Diemo Schwarz,et al.  Ftm - Complex Data Structures for Max , 2005, ICMC.

[63]  Axel Röbel,et al.  MuBu and Friends - Assembling Tools for Content Based Real-Time Interactive Audio Processing in Max/MSP , 2009, ICMC.

[64]  Julius O. Smith,et al.  AM/FM rate estimation for time-varying sinusoidal modeling , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[65]  Jae Lim,et al.  Signal estimation from modified short-time Fourier transform , 1984 .

[66]  Xavier Rodet,et al.  Efficient Fourier Synthesis of Nonstationary Sinusoids , 1994, ICMC.

[67]  G. Peeters.  Automatic Classification of Large Musical Instrument Databases Using Hierarchical Classifiers with Inertia Ratio Maximization , 2003 .

[68]  E. Zwicker,et al.  Analytical expressions for critical‐band rate and critical bandwidth as a function of frequency , 1980 .

[69]  Pierre Schaeffer.  Traité des objets musicaux , 1966 .

[70]  Diemo Schwarz.  Concatenative sound synthesis: The early years , 2006 .

[71]  Axel Röbel,et al.  Multiple Fundamental Frequency Estimation and Polyphony Inference of Polyphonic Music Signals , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[72]  William W. Gaver.  What in the World Do We Hear? An Ecological Approach to Auditory Event Perception , 1993 .

[73]  Alexander Refsum Jensenius,et al.  Action-sound : developing methods and tools to study music-related body movement , 2007 .

[74]  Xavier Rodet,et al.  Fundamental frequency estimation and tracking using maximum likelihood harmonic matching and HMMs , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[75]  Michael A. Casey,et al.  Soundspotter / remix-TV: Fast Approximate Matching for audio and video Performance , 2007, ICMC.

[76]  Doug Van Nort,et al.  Instrumental Listening: sonic gesture as design principle , 2009, Organised Sound.

[77]  François Pachet,et al.  Jamming with Plunderphonics: Interactive concatenative synthesis of music , 2006 .

[78]  Malcolm Slaney,et al.  Construction and evaluation of a robust multifeature speech/music discriminator , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[79]  Curtis Roads,et al.  Introduction to Granular Synthesis , 1988 .

[80]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[81]  Emmanuel Deruty,et al.  Automatic morphological description of sounds , 2008 .

[82]  Diemo Schwarz,et al.  Corpus-Based Transcription as an Approach to the Compositional Control of Timbre , 2009, ICMC.

[83]  Eduardo Miranda,et al.  Composing Music with Computers , 2001 .

[84]  William W. Gaver.  How Do We Hear in the World?: Explorations in Ecological Acoustics , 1993 .

[85]  Jean Laroche,et al.  Improved phase vocoder time-scale modification of audio , 1999, IEEE Trans. Speech Audio Process..

[86]  D. Schwarz,et al.  Corpus-Based Concatenative Synthesis , 2007, IEEE Signal Processing Magazine.

[87]  Diemo Schwarz,et al.  State of the Art in Sound Texture Synthesis , 2011 .

[88]  Diemo Schwarz,et al.  Gabor, Multi-Representation Real-Time Analysis/Synthesis , 2005 .

[89]  Etienne Parizet,et al.  Analysis of car door closing sound quality , 2008 .

[90]  H. Vinet.  Applications musicales du traitement de signal : synthèse et prospective , 2005 .

[91]  Axel Röbel,et al.  A Reduced Multiple Gabor Frame for Local Time Adaptation of the Spectrogram , 2011, ArXiv.