Interactive music composition driven by feature evolution

Evolutionary music composition is a prominent technique for automatic music generation. The immense adaptation potential of evolutionary algorithms has allowed the realisation of systems that automatically produce music through feature and interactive-based composition approaches. Feature-based composition employs qualitatively descriptive music features as fitness landmarks. Interactive composition systems on the other hand, derive fitness directly from human ratings and/or selection. The paper at hand introduces a methodological framework that combines the merits of both evolutionary composition methodologies. To this end, a system is presented that is organised in two levels: the higher level of interaction and the lower level of composition. The higher level incorporates the particle swarm optimisation algorithm, along with a proposed variant and evolves musical features according to user ratings. The lower level realizes feature-based music composition with a genetic algorithm, according to the top level features. The aim of this work is not to validate the efficiency of the currently utilised setup in each level, but to examine the convergence behaviour of such a two-level technique in an objective manner. Therefore, an additional novelty in this work concerns the utilisation of artificial raters that guide the system through the space of musical features, allowing the exploration of its convergence characteristics: does the system converge to optimal melodies, is this convergence fast enough for potential human listeners and is the trajectory to convergence “interesting’ and “creative” enough? The experimental results reveal that the proposed methodological framework represents a fruitful and robust, novel approach to interactive music composition.

[1]  John A. Biles,et al.  GenJam: evolution of a jazz improviser , 2001 .

[2]  Michael G. Epitropakis,et al.  Feature Extraction Using Pitch Class Profile Information Entropy , 2011, MCM.

[3]  Edward J. Coyle,et al.  Perceptual Issues in Music Pattern Recognition: Complexity of Rhythm and Key Finding , 2001, Comput. Humanit..

[4]  Penousal Machado,et al.  Zipf's Law, Music Classification, and Aesthetics , 2005, Computer Music Journal.

[5]  Vlado Keselj,et al.  n-gram-based approach to composer recognition , 2008 .

[6]  Kenneth Sörensen,et al.  Classification and Generation of Composer-Specific Music Using Global Feature Models and Variable Neighborhood Search , 2015, Computer Music Journal.

[7]  Liang Zhao,et al.  Characterizing chaotic melodies in automatic music composition. , 2010, Chaos.

[8]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[9]  Dragan Matic A GENETIC ALGORITHM FOR COMPOSING MUSIC , 2010 .

[10]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[11]  Reza Akbari,et al.  A rank based particle swarm optimization algorithm with dynamic adaptation , 2011, J. Comput. Appl. Math..

[12]  Damon Horowitz,et al.  Generating Rhythms with Genetic Algorithms , 1994, AAAI.

[13]  R. MacCallum,et al.  Evolution of music by public choice , 2012, Proceedings of the National Academy of Sciences.

[14]  Ichiro Fujinaga,et al.  Automatic Genre Classification Using Large High-Level Musical Feature Sets , 2004, ISMIR.

[15]  George Papadopoulos,et al.  A Genetic Algorithm for the Generation of Jazz Melodies , 2000 .

[16]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[17]  Bill Manaris,et al.  Monterey Mirror : Combining Markov Models , Genetic Algorithms , and Power Laws An Experiment in Interactive Evolutionary Music Performance , 2011 .

[18]  Manuel Cebrián,et al.  A simple genetic algorithm for music generation by means of algorithmic information theory , 2007, 2007 IEEE Congress on Evolutionary Computation.

[19]  Juan Romero,et al.  Evolutionary and Biologically Inspired Music, Sound, Art and Design , 2014, Lecture Notes in Computer Science.

[20]  John W. Sheppard,et al.  Evolving Four-Part Harmony Using Genetic Algorithms , 2011, EvoApplications.

[21]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[22]  Michael N. Vrahatis,et al.  Particle Swarm Optimization and Intelligence: Advances and Applications , 2010 .

[23]  Takehisa Onisawa,et al.  Music composition by interaction between human and computer , 2009, New Generation Computing.

[24]  Tim Blackwell Swarm Granulation , 2008, The Art of Artificial Evolution.

[25]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[26]  Christopher Ariza Prokaryotic Groove: Rhythmic Cycles as Real-Value Encoded Genetic Algorithms , 2002, ICMC.

[27]  Ender Özcan,et al.  A Genetic Algorithm for Generating Improvised Music , 2007, Artificial Evolution.

[28]  Daniel Jones AtomSwarm: A Framework for Swarm Improvisation , 2008, EvoWorkshops.

[29]  Michele Van Dyne,et al.  A Genetic Algorithm Approach to Improve Automated Music Composition , 2022 .

[30]  David M. Hofmann A Genetic Programming Approach to Generating Musical Compositions , 2015, EvoMUSART.

[31]  Bill Manaris,et al.  Progress towards recognizing and classifying beautiful music with computers - MIDI-encoded music and the Zipf-Mandelbrot law , 2002, Proceedings IEEE SoutheastCon 2002 (Cat. No.02CH37283).

[32]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1998 .

[33]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[34]  Bill Z. Manaris,et al.  Fractal Dimensions of Music and Automatic Playlist Generation: Similarity Search via MP3 Song Uploads , 2012, 2012 Eighth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[35]  Michael G. Epitropakis,et al.  Interactive Evolution of 8-Bit Melodies with Genetic Programming towards Finding Aesthetic Measures for Sound , 2012, EvoMUSART.

[36]  Penousal Machado,et al.  A Corpus-Based Hybrid Approach to Music Analysis and Composition , 2007, AAAI.

[37]  Klaus Obermayer,et al.  Correspondence Analysis for Visualizing Interplay of Pitch Class, Key, and Composer , 2003 .

[38]  Michael G. Epitropakis,et al.  Musical Composer Identification through Probabilistic and Feedforward Neural Networks , 2010, EvoApplications.

[39]  Carlos Guedes,et al.  Complexity Driven Recombination of MIDI Loops , 2011, ISMIR.

[40]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[41]  Tim Blackwell,et al.  Swarming and Music , 2007 .

[42]  Michael N. Vrahatis,et al.  Intelligent Real-Time Music Accompaniment for Constraint-Free Improvisation , 2012, 2012 IEEE 24th International Conference on Tools with Artificial Intelligence.

[43]  Michael G. Epitropakis,et al.  Controlling interactive evolution of 8-bit melodies with genetic programming , 2012, Soft Computing.

[44]  Geraint A. Wiggins,et al.  Evaluating Cognitive Models of Musical Composition , 2007 .

[45]  Jiangye Yuan,et al.  A modified particle swarm optimizer with dynamic adaptation , 2007, Appl. Math. Comput..

[46]  W. M. Wan,et al.  The European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD , 2011 .

[47]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[48]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[49]  Juan José Pantrigo,et al.  Spieldose: An Interactive Genetic Software for Assisting to Music Composition Tasks , 2007, IWINAC.

[50]  Hideyuki Takagi,et al.  Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation , 2001, Proc. IEEE.

[51]  Penousal Machado,et al.  Power to the Critics - A Framework for the Development of Artificial Art Critics , 2003 .

[52]  Ruben Hillewaere,et al.  Melodic models for polyphonic music classification , 2009 .

[53]  Bernard Manderick,et al.  Global Feature Versus Event Models for Folk Song Classification , 2009, ISMIR.

[54]  E. Backer,et al.  Musical style recognition - a quantitative approach , 2004 .

[55]  Michael N. Vrahatis,et al.  evoDrummer: Deriving Rhythmic Patterns through Interactive Genetic Algorithms , 2013, EvoMUSART.

[56]  Peter J. Bentley,et al.  Improvised music with swarms , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[57]  Michael N. Vrahatis,et al.  Genetic evolution of L and FL-systems for the production of rhythmic sequences , 2012, GECCO '12.

[58]  Gerhard Widmer,et al.  A Complexity-based Approach to Melody Track Identification in MIDI Files ? , 2007 .

[59]  Tim Blackwell,et al.  Swarm Granulator , 2004, EvoWorkshops.

[60]  Arne Eigenfeldt,et al.  Emergent Rhythms through Multi-agency in Max/MSP , 2008, CMMR.

[61]  Scott Wilson Spatial Swarm Granulation , 2008, ICMC.

[62]  Charles F. Hockett,et al.  A mathematical theory of communication , 1948, MOCO.

[63]  Richard Kronland-Martinet,et al.  Computer Music Modeling and Retrieval. Sense of Sounds, 4th International Symposium, CMMR 2007, Copenhagen, Denmark, August 27-31, 2007. Revised Papers , 2008, CMMR.