A case based approach to expressivity-aware tempo transformation

The research presented in this paper focuses on global tempo transformations of monophonic audio recordings of saxophone jazz performances. We are investigating the problem of how a performance played at a particular tempo can be rendered automatically at another tempo, while preserving naturally sounding expressivity. Or, differently stated, how does expressiveness change with global tempo. Changing the tempo of a given melody is a problem that cannot be reduced to just applying a uniform transformation to all the notes of a musical piece. The expressive resources for emphasizing the musical structure of the melody and the affective content differ depending on the performance tempo. We present a case-based reasoning system called TempoExpress for addressing this problem, and describe the experimental results obtained with our approach.

[1]  Gerhard Widmer,et al.  Learning expressive performance: The structure‐level approach , 1996 .

[2]  A. Röbel.  A NEW APPROACH TO TRANSIENT PROCESSING IN THE PHASE VOCODER , 2003 .

[3]  Peter Desain,et al.  Timing of Ornaments in the Theme from Beethoven's Paisiello Variations: Empirical Data and a Model , 2002 .

[4]  Henkjan Honing.  Is expressive timing relational invariant under tempo transformation? , 2007 .

[5]  Johan Sundberg,et al.  Common Secrets of Musicians and Listeners - An analysis-by-synthesis Study of Musical Performance , 1991 .

[6]  Maarten Grachten,et al.  Extracting Performers' Behaviors to Annotate Cases in a CBR System for Musical Tempo Transformations , 2003, ICCBR.

[7]  Enric Plaza,et al.  Constructive Adaptation , 2002, ECCBR.

[8]  B H Repp,et al.  Relational invariance of expressive microstructure across global tempo changes in music performance: An exploratory study , 1994, Psychological research.

[9]  C. Palmer.  Anatomy of a Performance: Sources of Musical Expression , 1996 .

[10]  Robert Rowe,et al.  Action and Perception in Rhythm and Music , 1989 .

[11]  Gerhard Widmer,et al.  Machine Discoveries: A Few Simple, Robust Local Expression Principles , 2002 .

[12]  E. Schellenberg,et al.  Simplifying the Implication-Realization Model of Melodic Expectancy , 1997 .

[13]  J. Bach,et al.  Generative Rules for Music Performance: A Formal Description of a Rule System , 2008 .

[14]  Ramón López de Mántaras,et al.  An Interactive Case-Based Reasoning Approach for Generating Expressive Music , 2004, Applied Intelligence.

[15]  Eugene Narmour,et al.  The Analysis and Cognition of Basic Melodic Structures: The Implication-Realization Model , 1990 .

[16]  Johan Sundberg,et al.  Threshold and Preference Quantities of Rules for Music Performance , 1991 .

[17]  D. Temperley.  The Cognition of Basic Musical Structures , 2001 .

[18]  piano Barbara Scheidker,et al.  Sonata in A Major, K. 331 , 1979 .

[19]  Ramón López de Mántaras,et al.  Ai and Music: From Composition to Expressive Performance , 2002, AI Mag..

[20]  Sergio Canazza,et al.  Sonological Analysis of Clarinet Expressivity , 1996, Joint International Conference on Cognitive and Systematic Musicology.

[21]  Jordi Bonada,et al.  Automatic technique in frequency domain for near-lossless time-scale modification of audio , 2000, ICMC.

[22]  Anssi Klapuri,et al.  Melody Description and Extraction in the Context of Music Content Processing , 2003 .

[23]  Rafael Ramírez,et al.  Modelling Expressive Performance: A Regression Tree Approach Based on Strongly Typed Genetic Programming , 2006, EvoWorkshops.

[24]  Emmanuel Vincent,et al.  The 2005 Music Information retrieval Evaluation Exchange (MIREX 2005): Preliminary Overview , 2005, ISMIR.

[25]  Henkjan Honing.  Timing is Tempo-Specific , 2005, ICMC.

[26]  Maarten Grachten,et al.  Evolutionary Optimization of Music Performance Annotation , 2004, CMMR.

[27]  Gerhard Widmer,et al.  Case-Based Relational Learning of Expressive Phrasing in Classical Music , 2004, ECCBR.

[28]  Ray Jackendoff,et al.  An overview of hierarchical structure in music , 1983 .

[29]  J. Sloboda.  The Communication of Musical Metre in Piano Performance , 1983 .

[30]  Gerhard Widmer,et al.  Large-scale Induction of Expressive Performance Rules: First Quantitative Results , 2000, ICMC.

[31]  The Cognition of Basic Musical Structures , 2005 .

[32]  Emilia Gómez,et al.  Using and enhancing the current MPEG-7 standard for a music content processing tool , 2003 .

[33]  P. Juslin.  Communicating emotion in music performance: A review and a theoretical framework , 2001 .

[34]  P. J. Green,et al.  Probability and Statistical Inference , 1978 .

[35]  Xavier Serra,et al.  SaxEx: a case-based reasoning system for generating expressive musical performances , 1998, ICMC.

[36]  Jordi Bonada,et al.  RHYTHMIC EXPRESSIVENESS TRANSFORMATIONS OF AUDIO RECORDINGS: SWING MODIFICATIONS , 2003 .

[37]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[38]  Remco C. Veltkamp,et al.  A Ground Truth For Half A Million Musical Incipits , 2005, J. Digit. Inf. Manag..

[39]  M. Kendall.  Probability and Statistical Inference , 1956, Nature.

[40]  T. Suzuki,et al.  The Second Phase Development of Case Based Performance Rendering System "Kaguramae" , 2003, IJCAI 2003.

[41]  Emilia Gómez,et al.  Melodic characterization of monophonic recordings for expressive tempo transformations , 2003 .

[42]  Henkjan Honing,et al.  Structure and interpretation of rhythm and timing , 2002 .

[43]  Ramon López de Mántaras,et al.  Melody retrieval using the Implication/Realization Model , 2005 .

[44]  Emilia Gómez,et al.  Automatic Characterization of Dynamics and Articulation of Expressive Monophone Recordings , 2005 .

[45]  Anders Friberg,et al.  Swing Ratios and Ensemble Timing in Jazz Performance: Evidence for a Common Rhythmic Pattern , 2002 .

[46]  Peter Desain,et al.  Does expressive timing in music performance scale proportionally with tempo? , 1994 .

[47]  Maarten Grachten,et al.  TempoExpress, a CBR Approach to Musical Tempo Transformations , 2004, ECCBR.

[48]  Johan Sundberg,et al.  Generating Musical Performances with Director Musices , 2000, Computer Music Journal.

[49]  Alf Gabrielsson,et al.  Expressive Intention and Performance , 1995 .

[50]  Bruno H. Repp.  Quantitative Effects of Global Tempo on Expressive Timing in Music Performance: Some Perceptual Evidence , 1995 .