Real and Simulated Expression: A Listening Study

A number of attempts have been made in the past 10 to 15 years to construct artificial systems that can simulate human expressive performance, but few systematic studies of the relationship between model output and comparable human performances have been undertaken. In this study, we assessed listeners' responses to real and artificially generated performances. Subjects were asked to identify and evaluate performances of two differently notated editions of two pieces, played by a panel of experienced pianists and by an artificial performer. The results suggest that expressive timing and dynamics do not relate to one another in the simple manner that is implemented in the model (Todd, 1992) used here, that small objective differences in the expressive profiles of different performances can lead to distinctly different judgments by listeners, and that what appears to be the same expressive feature in performance can fulfill different functions. Although one purpose of such a study is to assess the model on which it is based, more important is its demonstration of the general value of comparing human data with a model. As is often the case, it is what the model does not explain that is most interesting.

[1]  Johan Sundberg,et al.  Rules for Expression in the Performance of Melodies , 1989 .

[2]  J. Sloboda.  The Communication of Musical Metre in Piano Performance , 1983 .

[3]  William Forde Thompson,et al.  Composer-Specific Aspects of Musical Performance: An Evaluation of Clynes's Theory of Pulse for Performances of Mozart and Beethoven , 1989 .

[4]  N. Todd.  A Model of Expressive Timing in Tonal Music , 1985 .

[5]  B. Repp.  A microcosm of musical expression. I. Quantitative analysis of pianists' timing in the initial measures of Chopin's Etude in E major. , 1998, The Journal of the Acoustical Society of America.

[6]  B. Repp.  Expressive Microstructure in Music: A Preliminary Perceptual Assessment of Four Composers' "Pulses" , 1989 .

[7]  C. Palmer.  Mapping musical thought to musical performance. , 1989, Journal of experimental psychology. Human perception and performance.

[8]  H. H. Clark,et al.  Psychology and language : an introduction to psycholinguistics , 1979 .

[9]  Peter Desain,et al.  Towards a calculus for expressive timing in music , 1991 .

[10]  N. Todd.  The kinematics of musical expression , 1995 .

[11]  H. C. Longuet-Higgins,et al.  Modelling musical cognition , 1989 .

[12]  C. Palmer.  Anatomy of a Performance: Sources of Musical Expression , 1996 .

[13]  N. Todd.  The dynamics of dynamics: A model of musical expression , 1992 .

[14]  R. Jackendoff,et al.  A Generative Theory of Tonal Music , 1985 .

[15]  Manfred Clynes,et al.  Microstructural musical linguistics: composers' pulses are liked most by the best musicians , 1995, Cognition.

[16]  Henkjan Honing.  POCO: An Environment for Analysing, Modifying and Generating Expression in Music , 1990, ICMC.

[17]  Bruno H. Repp,et al.  Further Perceptual Evaluations of Pulse Microstructure in Computer Performances of Classical Piano Music , 1990 .

[18]  Bruno H. Repp,et al.  Composers' Pulses: Science or Art? , 1990 .

[19]  W. L. Windsor,et al.  Expressive Timing and Dynamics in Real and Artificial Musical Performances: Using an Algorithm as an Analytical Tool , 1997 .