Towards Affective Algorithmic Composition

Automated systems for the selective adjustment of emotional responses by means of musical features are driving an emerging field: affective algorithmic composition. Strategies for algorithmic composition, and the large variety of systems for computer-automation of such strategies, are well documented in literature. Reviews of computer systems for expressive performance (CSEMPs) also provide a thorough overview of the extensive work carried out in the area of expressive computer music performance, with some crossover between composition and performance systems. Although there has been a significant amount of work (largely carried out within the last decade) implementing systems for algorithmic composition with the intention of targeting specific emotional responses in the listener, a full review of this work is not currently available, creating a shared obstacle to those entering the field which, if left unchecked, can only continue to grow. This paper gives an overview of the progress in this emerging field, including systems that combine composition and expressive performance metrics. Re-composition, and transformative algorithmic composition systems are included and differentiated where appropriate, highlighting the challenges these systems now face and suggesting a direction for further work. A framework for the categorisation and evaluation of these systems is proposed including methods for the parameterisation of musical features from semiotic research targeting specific emotional correlates. The framework provides an overarching epistemological platform and practical vernacular for the development of future work using algorithmic composition and expressive performance systems to monitor and induce affective states in the listener.

[1]  Giovanni De Poli,et al.  On Evaluating Systems for Generating Expressive Music Performance: the Rencon Experience , 2012 .

[2]  Eduardo Miranda,et al.  Composing Music with Computers , 2001 .

[3]  E. Miranda,et al.  A survey of computer systems for expressive music performance , 2009, CSUR.

[4]  D. Västfjäll.  Emotion induction through music: A review of the musical mood induction procedure , 2001 .

[5]  E. Schellenberg,et al.  Effects of Musical Tempo and Mode on Arousal, Mood, and Spatial Abilities , 2002 .

[6]  Tuomas Eerola,et al.  Measuring music-induced emotion , 2011 .

[7]  P. Laukka,et al.  Expression, Perception, and Induction of Musical Emotions: A Review and a Questionnaire Study of Everyday Listening , 2004 .

[8]  A. Gabrielsson.  Emotion perceived and emotion felt: Same or different? , 2001 .

[9]  Nick Collins,et al.  Musical Form and Algorithmic Composition , 2009 .

[10]  K. Scherer,et al.  Emotional states generated by music: An exploratory study of music experts , 2001 .

[11]  M. Bradley,et al.  Remembering pictures: pleasure and arousal in memory. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[12]  Joe Wolfe,et al.  Does timbral brightness scale with frequency and spectral centroid , 2006 .

[13]  D. Huron.  What is a Musical Feature? Forte’s Analysis of Brahms’s Opus 51, No. 1, Revisited , 2001 .

[14]  K. Scherer,et al.  The World of Emotions is not Two-Dimensional , 2007, Psychological science.

[15]  K. Scherer.  Which Emotions Can be Induced by Music? What Are the Underlying Mechanisms? And How Can We Measure Them? , 2004 .

[16]  Tuomas Eerola,et al.  The role of melodic and temporal cues in perceiving musical meter. , 2004, Journal of experimental psychology. Human perception and performance.

[17]  J. Russell.  A circumplex model of affect. , 1980 .

[18]  David Huron,et al.  Humdrum and Kern : selective feature encoding , 1997 .

[19]  François Pachet,et al.  "The way it Sounds": timbre models for analysis and retrieval of music signals , 2005, IEEE Transactions on Multimedia.

[20]  Gerhard Nierhaus,et al.  Algorithmic Composition: Paradigms of Automated Music Generation , 2008 .

[21]  Eduardo Miranda.  Composing Music with Computers with Cdrom , 2001 .

[22]  Emery Schubert.  Measuring emotion continuously: Validity and reliability of the two-dimensional emotion-space , 1999 .

[23]  K. Kallinen,et al.  Emotion perceived and emotion felt: Same and different , 2006 .

[24]  K. Scherer,et al.  Emotions evoked by the sound of music: characterization, classification, and measurement. , 2008, Emotion.

[25]  A. Mehrabian.  Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in Temperament , 1996 .

[26]  Slawomir J. Nasuto,et al.  Learning to Make Feelings: Expressive Performance as a Part of a Machine Learning Tool for Sound-Based Emotion Control , 2012, CMMR.

[27]  Geraint A. Wiggins,et al.  AI Methods for Algorithmic Composition: A Survey, a Critical View and Future Prospects , 1999 .

[28]  John Kratus.  A Developmental Study of Children's Interpretation of Emotion in Music , 1993 .