Computer-Aided Orchestration Based on Probabilistic Instruments Models and Genetic Exploration

In this paper we introduce a tool aimed at assisting composers in orchestration tasks. Thanks to this tool, composers can specify a target sound and replicate it with a given orchestra. We discuss the problems raised by the realization of such a tool, concerning instrumental sound description and combinatorial optimization. Then we describe the solution adopted. We propose a machine learning method based on generative probabilistic modeling to represent and generalize instrument timbre possibilities from sample databases. This model allows to deduce the timbre of any mixture of instrument sounds. In a second part, we show that search of sound mixtures that match a given target is a combinatorial optimization problem that can be addressed with multicriteria genetic algorithms.

[1]  David Psenicka SPORCH: An Algorithm for Orchestration Based on Spectral Analyses of Recorded Sounds , 2003, ICMC.

[2]  Alexander Kain,et al.  Spectral voice conversion for text-to-speech synthesis , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[3]  Xavier Rodet,et al.  An Evolutionary Approach to Computer-Aided Orchestration , 2007, EvoWorkshops.

[4]  Robert L. Goldstone The role of similarity in categorization: providing a groundwork , 1994, Cognition.

[5]  Christian Genest,et al.  Combining Probability Distributions: A Critique and an Annotated Bibliography , 1986 .

[6]  G. Soete,et al.  Perceptual scaling of synthesized musical timbres: Common dimensions, specificities, and latent subject classes , 1995, Psychological research.

[7]  Paolo Toth,et al.  Knapsack Problems: Algorithms and Computer Implementations , 1990 .

[8]  Thomas Hummel Simulation of Human voice Timbre by Orchestration of acoustic Music Instruments , 2005, ICMC.

[9]  Mark J. F. Gales,et al.  Product of Gaussians for speech recognition , 2006, Comput. Speech Lang..

[10]  Andrzej Jaszkiewicz Comparison of local search-based metaheuristics on the multiple objective knapsack problem , 2001 .

[11]  Xavier Rodet,et al.  Fundamental frequency estimation and tracking using maximum likelihood harmonic matching and HMMs , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.