Toward and Integrated Sound Analysis and Processing Framework for Expressiveness Rendering

A framework for automatic expressive modification of audio musical performances is presented. Different levels of sound and performance analyses are integrated, which allows to characterize the same performance from different points of view (acoustic parameters and musical structures). Based on these analyses it is then possible to provide a score description of a recorded performance, which can be used as input to an expressiveness model. The final audio processing and resynthesis stages provide the tools for applying the sound modifications as computed by the expressiveness model.