Interactively Evolving Compositional Sound Synthesis Networks

While the success of electronic music often relies on the uniqueness and quality of selected timbres, many musicians struggle with complicated and expensive equipment and techniques to create their desired sounds. Instead, this paper presents a technique for producing novel timbres that are evolved by the musician through interactive evolutionary computation. Each timbre is produced by an oscillator, which is represented by a special type of artificial neural network (ANN) called a compositional pattern producing network (CPPN). While traditional ANNs compute only sigmoid functions at their hidden nodes, CPPNs can theoretically compute any function and can build on those present in traditional synthesizers (e.g. square, sawtooth, triangle, and sine waves functions) to produce completely novel timbres. Evolved with NeuroEvolution of Augmenting Topologies (NEAT), the aim of this paper is to explore the space of potential sounds that can be generated through such compositional sound synthesis networks (CSSNs). To study the effect of evolution on subjective appreciation, participants in a listener study ranked evolved timbres by personal preference, resulting in preferences skewed toward the first and last generations. In the long run, the CSSN's ability to generate a variety of different and rich timbre opens up the intriguing possibility of evolving a complete CSSN-encoded synthesizer.

[1]  William M. Hartmann,et al.  Electronic and Computer Music , 2007 .

[2]  Kenneth O. Stanley,et al.  Compositional Pattern Producing Networks : A Novel Abstraction of Development , 2007 .

[3]  John M. Chowning,et al.  The Synthesis of Complex Audio Spectra by Means of Frequency Modulation , 1973 .

[4]  Kenneth O. Stanley,et al.  A Proposed Infrastructure for Adding Online Interaction to Any Evolutionary Domain , 2014, ArXiv.

[5]  Kenneth O. Stanley,et al.  Evolving content in the Galactic Arms Race video game , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[6]  James W. Beauchamp,et al.  Machine Tongues XVI: Genetic Algorithms and Their Application to FM Matching Synthesis , 1993 .

[7]  Ricardo A. Garcia Growing Sound Synthesizers using Evolutionary Methods , 2001 .

[8]  Hideyuki Takagi,et al.  Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation , 2001, Proc. IEEE.

[9]  Palle Dahlstedt,et al.  Creating and Exploring Huge Parameter Spaces: Interactive Evolution as a Tool for Sound Generation , 2001, ICMC.

[10]  Philippe Pasquier,et al.  Automatic design of sound synthesizers as pure data patches using coevolutionary mixed-typed cartesian genetic programming , 2014, GECCO.

[11]  José Fornari,et al.  The evolutionary sound synthesis method , 2001, MULTIMEDIA '01.

[12]  Kenneth O. Stanley,et al.  Steps Toward a Modular Library for Turning Any Evolutionary Domain into an Online Interactive Platform , 2014 .

[13]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[14]  Colin G. Johnson,et al.  Exploring Sound-Space with Interactive Genetic Algorithms , 2003, Leonardo.

[15]  Kenneth O. Stanley,et al.  Functional Scaffolding for Composing Additional Musical Voices , 2014, Computer Music Journal.

[16]  Clive Richards,et al.  The Blind Watchmaker , 1987, Bristol Medico-Chirurgical Journal.

[17]  Shyh-Kang Jeng,et al.  AUTOMATED OPTIMIZATION OF PARAMETERS FOR FM SOUND SYNTHESIS WITH GENETIC ALGORITHMS , 2006 .

[18]  Kenneth O. Stanley,et al.  Picbreeder: A Case Study in Collaborative Evolutionary Exploration of Design Space , 2011, Evolutionary Computation.

[19]  Joel Lehman,et al.  Petalz: Search-Based Procedural Content Generation for the Casual Gamer , 2016, IEEE Transactions on Computational Intelligence and AI in Games.

[20]  Fernando José Von Zuben,et al.  Interactive Control of Evolution Applied to Sound Synthesis , 2005, FLAIRS.

[21]  Antonios Liapis,et al.  AudioInSpace: Exploring the Creative Fusion of Generative Audio, Visuals and Gameplay , 2015, EvoMUSART.

[22]  Joel Lehman,et al.  Combining Search-Based Procedural Content Generation and Social Gaming in the Petalz Video Game , 2012, AIIDE.

[23]  Mark Jenkins Analog Synthesizers: Understanding, Performing, Buying- from the legacy of Moog to software synthesis , 2007 .

[24]  Palle Dahlstedt Evolution in Creative Sound Design , 2007 .