Software Agents in Music and Sound Art Research/Creative Work: current state and a possible direction

Composers, musicians and computer scientists have begun to use software-based agents to create music and sound art in both linear and non-linear (non-predetermined form and/or content) idioms, with some robust approaches now drawing on various disciplines. This paper surveys recent work: agent technology is first introduced, a theoretical framework for its use in creating music/sound art works put forward, and an overview of common approaches then given. Identifying areas of neglect in recent research, a possible direction for further work is then briefly explored. Finally, a vision for a new hybrid model that integrates non-linear, generative, conversational and affective perspectives on interactivity is proposed.

[1]  K. Scherer,et al.  EMOTIONAL EFFECTS OF MUSIC: PRODUCTION RULES , 2001 .

[2]  Ian Whalley.  Adding Machine Cognition to a Web-based interactive composition , 2004, ICMC.

[3]  Joel Chadabe.  The History of Electronic Music as a Reflection of Structural Paradigms , 1996 .

[4]  Andrew R. Brown.  Opportunities for Evolutionary Music Composition , 2002 .

[5]  A. Cohen.  Music as a source of emotion in film , 2001 .

[6]  Michael Spicer.  AALIVENET: An agent based distributed interactive composition environment , 2004, ICMC.

[7]  Zhang Naiyao,et al.  User-adaptive music emotion recognition , 2004, Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004..

[8]  Eduardo Miranda,et al.  The development of musical styles in a society of software agents , 2006 .

[9]  Steven Brown,et al.  The Origins of Music: Edited by Nils L. Wallin, Björn Merker, and Steven Brown, Cambridge, MA: The MIT Press, 2000, xii+ 498 pages, ISBN 0-262-23206-5, US$60.00 , 2000 .

[10]  Alexander Serenko,et al.  AGENT TOOLKITS: A GENERAL OVERVIEW OF THE MARKET AND AN ASSESSMENT OF INSTRUCTOR SATISFACTION WITH UTILIZING TOOLKITS IN THE CLASSROOM , 2002 .

[11]  Charles Nussbaum,et al.  The Musical Representation: Meaning, Ontology, and Emotion , 2007 .

[12]  Michael H. Thaut,et al.  Rhythm, Music, and the Brain: Scientific Foundations and Clinical Applications , 2005 .

[13]  Peter Beyls,et al.  Interaction and Self-organisation in a Society of Musical Agents , 2007 .

[14]  Joel Chadabe.  Electronic music and life , 2004 .

[15]  R. Weale,et al.  Discovering How Accessible Electroacoustic Music Can Be: the Intention/Reception project , 2006, Organised Sound.

[16]  Trevor Wishart,et al.  On Sonic Art , 1996 .

[17]  Christopher Booker.  The Seven Basic Plots: Why We Tell Stories , 2004 .

[18]  Arne Eigenfeldt,et al.  Emergent Rhythms through Multi-agency in Max/MSP , 2008, CMMR.

[19]  Cheng-Te Li,et al.  Emotion-based impressionism slideshow with automatic music accompaniment , 2007, ACM Multimedia.

[20]  Todd Winkler.  Composing Interactive Music: Techniques and Ideas Using Max , 1998 .

[21]  Eduardo Coutinho,et al.  Evolving Emotional Behaviour in Autonomous Agents for Expressive Performance of Music , 2005 .

[22]  P. Juslin.  Communicating emotion in music performance: A review and a theoretical framework , 2001 .

[23]  Robert Rowe,et al.  Interactive Music Systems: Machine Listening and Composing , 1992 .

[24]  Garth Paine,et al.  Interactivity, where to from here? , 2002, Organised Sound.

[25]  David Murray-Rust,et al.  MAMA: An Architecture for Interactive Musical Agents , 2006, ECAI.

[26]  Rosa Maria Vicari,et al.  A multiagent approach for musical interactive systems , 2003, AAMAS '03.

[27]  Steven Brown,et al.  The neuroscience of dance. , 2008, Scientific American.

[28]  P. Senge.  The fifth discipline : the art and practice of the learning organization/ Peter M. Senge , 1991 .

[29]  Masayuki Numao,et al.  CAUI demonstration: composing music based on human feelings , 2002, AAAI/IAAI.

[30]  Jennifer Bigus,et al.  Constructing intelligent agents using JAVA , 1998 .

[31]  S. Mithen,et al.  The Singing Neanderthals: the Origins of Music, Language, Mind and Body, by Steven Mithen. London: Weidenfeld & Nicholson, 2005. ISBN 0-297-64317-7 hardback £20 & US$25.2; ix+374 pp. , 2006, Cambridge Archaeological Journal.

[32]  Denis Smalley,et al.  Spectromorphology: explaining sound-shapes , 1997, Organised Sound.

[33]  A. Gabrielsson.  Emotions in strong experiences with music. , 2001 .

[34]  Claudia V. Goldman,et al.  NetNeg: A connectionist-agent integrated system for representing musical knowledge , 1999, Annals of Mathematics and Artificial Intelligence.

[35]  Efraim Turban,et al.  Decision support systems and intelligent systems , 1997 .

[36]  Chong Wang,et al.  MusicSense: contextual music recommendation using emotional allocation modeling , 2007, ACM Multimedia.

[37]  Alan Dorin,et al.  Generative processes and the electronic arts , 2001, Organised Sound.

[38]  Gerhard Weiss,et al.  Multiagent systems: a modern approach to distributed artificial intelligence , 1999 .

[39]  S. Baron,et al.  Origins of music , 2011 .

[40]  Alexis Drogoul,et al.  Multi-agent Based Simulation: Where Are the Agents? , 2002, MABS.

[41]  Peter M Todd,et al.  A-Life and Musical Composition : A Brief Survey , 2003 .

[42]  K. Scherer.  Which Emotions Can be Induced by Music? What Are the Underlying Mechanisms? And How Can We Measure Them? , 2004 .

[43]  Gil Weinberg,et al.  Interconnected Musical Networks: Toward a Theoretical Framework , 2005, Computer Music Journal.

[44]  Gloria E. Phillips-Wren,et al.  Innovations in multi-agent systems , 2007, J. Netw. Comput. Appl..

[45]  Masayuki Numao,et al.  Music compositional intelligence with an affective flavor , 2007, IUI '07.

[46]  Aniruddh D. Patel.  Music, Language, and the Brain , 2007 .

[47]  Andrew R. Brown,et al.  Controlling musical emotionality: an affective computational architecture for influencing musical emotions , 2007, Digit. Creativity.

[48]  Chimay J. Anumba,et al.  Agents And Multi-agent Systems In Construction , 2005 .

[49]  Mikhail Malt.  Khorwa: A musical experience with « autonomous agents » , 2004, ICMC.

[50]  Ian Whalley,et al.  Applications of system dynamics modelling to computer music , 2000, Organised Sound.

[51]  M. Casey,et al.  Computers and Musical Style , 1993 .

[52]  J. Sloboda,et al.  Music and emotion: Theory and research , 2001 .

[53]  Leigh Landy,et al.  Reviewing the musicology of electroacoustic music: a plea for greater triangulation , 1999, Organised Sound.

[54]  Ian Whalley,et al.  Software Agents and Creating Music/sound Art: Frames, Directions, and where to from here? , 2005, ICMC.

[55]  A. Gabrielsson,et al.  The influence of musical structure on emotional expression. , 2001 .

[56]  Fabio Kon,et al.  Andante: Composition and Performance with Mobile Musical Agents , 2004, ICMC.

[57]  Homer H. Chen,et al.  Music emotion recognition: the role of individuality , 2007, HCM '07.

[58]  Mithen,et al.  The Singing Neanderthals , 2005 .

[59]  Chew Lim Tan,et al.  The Learning Agent Based Interactive Performance System , 2003, ICMC.

[60]  Lars Graugaard.  Implicit relevance feedback in interactive music: issues, challenges, and case studies , 2006, IIiX.

[61]  Eduardo Reck Miranda,et al.  A Memetic Approach to the Evolution of Rhythms in a Society of Software Agents , 2005 .

[62]  P. Senge.  THE FIFTH DISCIPLINE , 1997 .

[63]  Jocelyne Kiss,et al.  Setting up of a self-organised multi-agent system for the creation of sound and visual virtual environments within the framework of a collective interactivity , 2003, ICMC.

[64]  John A. Biles,et al.  GenJam in Perspective: A Tentative Taxonomy for GA Music and Art Systems , 2003, Leonardo.

[65]  Gregory A. Bryant,et al.  Music and dance as a coalition signaling system , 2003, Human nature.

[66]  I. Peretz.  Listen to the brain: A biological perspective on musical emotions. , 2001 .