Data-based melody generation through multi-objective evolutionary computation

Genetic-based composition algorithms are able to explore an immense space of possibilities, but the main difficulty has always been the implementation of the selection process. In this work, sets of melodies are utilized for training a machine learning approach to compute fitness, based on different metrics. The fitness of a candidate is provided by combining the metrics, but their values can range through different orders of magnitude and evolve in different ways, which makes it hard to combine these criteria. In order to solve this problem, a multi-objective fitness approach is proposed, in which the best individuals are those in the Pareto front of the multi-dimensional fitness space. Melodic trees are also proposed as a data structure for chromosomic representation of melodies and genetic operators are adapted to them. Some experiments have been carried out using a graphical interface prototype that allows one to explore the creative capabilities of the proposed system. An Online Supplement is provided and can be accessed at http://dx.doi.org/10.1080/17459737.2016.1188171, where the reader can find some technical details, information about the data used, generated melodies, and additional information about the developed prototype and its performance.

[1]  Rodney Waschka.  Avoiding the Fitness "Bottleneck": Using Genetic Algorithms to Compose Orchestral Music , 1999, ICMC.

[2]  Shumeet Baluja,et al.  Towards Automated Artificial Evolution for Computer-generated Images , 1993, Connect. Sci..

[3]  Carlos Henggeler Antunes,et al.  Evolutionary Multi-Criterion Optimization , 2015, Lecture Notes in Computer Science.

[4]  Andrea Klug.  Beyond Midi The Handbook Of Musical Codes , 2016 .

[5]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[6]  Makoto Fukumoto,et al.  A Creation of Music-Like Melody by Interactive Genetic Algorithm with User's Intervention , 2014, HCI.

[7]  John A. Biles,et al.  GenJam: A Genetic Algorithm for Generating Jazz Solos , 1994, ICMC.

[8]  Emilios Cambouropoulos,et al.  The Local Boundary Detection Model (LBDM) and its Application in the Study of Expressive Timing , 2001, ICMC.

[9]  Peter M. Todd,et al.  Putting some (artificial) life into models of musical creativity , 2002 .

[10]  Wang Xiao-peng.  Pareto genetic algorithm for multi-objective optimization design , 2003 .

[11]  Penousal Machado,et al.  Power to the Critics - A Framework for the Development of Artificial Art Critics , 2003 .

[12]  Andrew Hugill,et al.  Genetic Approaches for Evolving Form in Musical Composition , 2005, Artificial Intelligence and Applications.

[13]  P.P. de Leon,et al.  Pattern Recognition Approach for Music Style Identification Using Shallow Statistical Descriptors , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[14]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[15]  Kenneth Sörensen,et al.  Sampling the extrema from statistical models of music with variable neighbourhood search , 2014, ICMC.

[16]  J. Iñesta,et al.  A cooperative approach to style-oriented music composition , 2022 .

[17]  I. Xenakis,et al.  Formalized Music: Thought and Mathematics in Composition , 1971 .

[18]  David M. Hofmann.  A Genetic Programming Approach to Generating Musical Compositions , 2015, EvoMUSART.

[19]  Martin Dostál,et al.  Evolutionary Music Composition , 2013, Handbook of Optimization.

[20]  Gerhard Nierhaus,et al.  Algorithmic Composition: Paradigms of Automated Music Generation , 2008 .

[21]  Somnuk Phon-Amnuaisuk,et al.  Evolutionary methods for musical composition , 1998 .

[22]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[23]  Jeffrey Putnam.  A Grammar-Based Genetic Programming Technique Applied to Music Generation , 1996, Evolutionary Programming.

[24]  T. Willingham.  The harmonic implications of the non-harmonic tones in the four-part chorales of Johann Sebastian Bach , 2013 .

[25]  Zhen Wang,et al.  Emotional Music Generation Using Interactive Genetic Algorithm , 2008, 2008 International Conference on Computer Science and Software Engineering.

[26]  Timothy Weale,et al.  EVOC: A Music Generating System using Genetic Algorithms , 2003, IJCAI.

[27]  P. Laine,et al.  Genetic algorithms in musical style oriented generation , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[28]  Dan Klein,et al.  Faster and Smaller N-Gram Language Models , 2011, ACL.

[29]  Eduardo Miranda,et al.  Evolutionary Computer Music , 2007 .

[30]  Pedro Ponce de Len,et al.  Pattern Recognition Approach for Music Style Identification Using Shallow Statistical Descriptors , 2007, IEEE Trans. Syst. Man Cybern. Part C.

[31]  Nao and Iba Hitoshi Tokui,et al.  Music Composition with Interactive Evolutionary Computation , 2000 .

[32]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[33]  Peter M. Todd,et al.  Frankensteinian methods for evolutionary music composition , 1999 .

[34]  Stefan M. Rüger,et al.  Robust Polyphonic Music Retrieval with N-grams , 2003, Journal of Intelligent Information Systems.

[35]  Igor Vatolkin,et al.  Measuring the Performance of Evolutionary Multi-Objective Feature Selection for Prediction of Musical Genres and Styles , 2013, GI-Jahrestagung.

[36]  Somnuk Phon-Amnuaisuk,et al.  Evolving Music Generation with SOM-Fitness Genetic Programming , 2009, EvoWorkshops.

[37]  Masami Takata,et al.  A Music Composition Model with Genetic Programming , 2010, PDPTA.

[38]  José Manuel Iñesta Quereda,et al.  Interactive Melodic Analysis , 2016, Computational Music Analysis.

[39]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[40]  Artemis Moroni,et al.  Vox Populi: An Interactive Evolutionary System for Algorithmic Music Composition , 2000, Leonardo Music Journal.

[41]  Leonard M. Isaacson,et al.  Experimental Music. Composition with an Electronic Computer , 1959 .

[42]  Mohammad Teshnehlab,et al.  Music Composition Using Combination of Genetic Algorithms and Recurrent Neural Networks , 2008, 2008 Eighth International Conference on Hybrid Intelligent Systems.

[43]  Ender Özcan,et al.  A Genetic Algorithm for Generating Improvised Music , 2007, Artificial Evolution.

[44]  Penousal Machado,et al.  The Art of Artificial Evolution , 2008 .

[45]  Ying-Ping Chen,et al.  Evolutionary interactive music composition , 2006, GECCO.

[46]  David Cope,et al.  Computers and Musical Style , 1993 .

[47]  Manuel Cebrián,et al.  A simple genetic algorithm for music generation by means of algorithmic information theory , 2007, 2007 IEEE Congress on Evolutionary Computation.

[48]  David Rizo Valero.  Symbolic music comparison with tree data structures , 2011 .

[49]  Hermann Ney,et al.  Improved backing-off for M-gram language modeling , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[50]  Lee Spector,et al.  Induction and Recapitulation of Deep Musical Structure , 1995, IJCAI 1995.

[51]  Penousal Machado,et al.  The Art of Artificial Evolution: A Handbook on Evolutionary Art and Music , 2007 .

[52]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[53]  Paul Pigg,et al.  Music Composition Using Genetic Algorithms (GA) and Multilayer Perceptrons (MLP) , 2005, ICNC.

[54]  Tomasz Michal Oliwa,et al.  Genetic algorithms and the abc music notation language for rock music composition , 2008, GECCO '08.

[55]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[56]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[57]  Simon M. Lucas,et al.  N-gram fitness function with a constraint in a musical evolutionary system , 2007, 2007 IEEE Congress on Evolutionary Computation.

[58]  Chien-Hung Liu,et al.  Music pattern mining for chromosome representation in evolutionary composition , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).