An exploration of evolutionary computation applied to frequency modulation audio synthesis parameter optimisation

With the ever-increasing complexity of sound synthesisers, there is a growing demand for automated parameter estimation and sound space navigation techniques. This thesis explores the potential for evolutionary computation to automatically map known sound qualities onto the parameters of frequency modulation synthesis. Within this exploration are original contributions in the domain of synthesis parameter estimation and, within the developed system, evolutionary computation, in the form of the evolutionary algorithms that drive the underlying optimisation process. Based upon the requirement for the parameter estimation system to deliver multiple search space solutions, existing evolutionary algorithmic architectures are augmented to enable niching, while maintaining the strengths of the original algorithms. Two novel evolutionary algorithms are proposed in which cluster analysis is used to identify and maintain species within the evolving populations. A conventional evolution strategy and cooperative coevolution strategy are defined, with cluster-orientated operators that enable the simultaneous optimisation of multiple search space solutions at distinct optima. A test methodology is developed that enables components of the synthesis matching problem to be identified and isolated, enabling the performance of different optimisation techniques to be compared quantitatively. A system is consequently developed that evolves sound matches using conventional frequency modulation synthesis models, and the effectiveness of different evolutionary algorithms is assessed and compared in application to both static and timevarying sound matching problems. Performance of the system is then evaluated by interview with expert listeners. The thesis is closed with a reflection on the algorithms and systems which have been developed, discussing possibilities for the future of automated synthesis parameter estimation techniques, and how they might be employed.

[1]  L. Darrell Whitley,et al.  GENITOR II: a distributed genetic algorithm , 1990, J. Exp. Theor. Artif. Intell..

[2]  Thomas Bäck,et al.  An Overview of Evolutionary Algorithms for Parameter Optimization , 1993, Evolutionary Computation.

[3]  Seth Bullock,et al.  Caring versus Sharing: How to Maintain Engagement and Diversity in Coevolving Populations , 2003, ECAL.

[4]  Remco C. Veltkamp,et al.  A Survey of Music Information Retrieval Systems , 2005, ISMIR.

[5]  Andrew Horner Spectral matching of musical instrument tones , 1993 .

[6]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[7]  Ofer M. Shir,et al.  Niching in evolution strategies , 2005, GECCO '05.

[8]  R. Paul Wiegand,et al.  Improving Coevolutionary Search for Optimal Multiagent Behaviors , 2003, IJCAI.

[9]  Bernard Manderick,et al.  Fine-Grained Parallel Genetic Algorithms , 1989, ICGA.

[10]  F. Harris On the use of windows for harmonic analysis with the discrete Fourier transform , 1978, Proceedings of the IEEE.

[11]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[12]  George Tzanetakis,et al.  Audio Analysis using the Discrete Wavelet Transform , 2001 .

[13]  Günter Rudolph,et al.  Global Optimization by Means of Distributed Evolution Strategies , 1990, PPSN.

[14]  F. Alajaji,et al.  c ○ Copyright by , 1998 .

[15]  I. Brace,et al.  Questionnaire Design: How to Plan, Structure and Write Survey Material for Effective Market Research , 2004 .

[16]  Kenneth A. De Jong,et al.  The Coevolution of Antibodies for Concept Learning , 1998, PPSN.

[17]  John J. Grefenstette,et al.  Optimization of Control Parameters for Genetic Algorithms , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[18]  Thomas Bäck,et al.  Evolutionary computation: comments on the history and current state , 1997, IEEE Trans. Evol. Comput..

[19]  J. Stephen Downie,et al.  A sample of music information retrieval approaches , 2004, J. Assoc. Inf. Sci. Technol..

[20]  Martina Gorges-Schleuter,et al.  ASPARAGOS An Asynchronous Parallel Genetic Optimization Strategy , 1989, ICGA.

[21]  Rudolf Paul Wiegand,et al.  An analysis of cooperative coevolutionary algorithms , 2004 .

[22]  Andrew Horner A comparison of wavetable and FM parameter spaces , 1997 .

[23]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[24]  A. A. Torn Cluster Analysis Using Seed Points and Density-Determined Hyperspheres as an Aid to Global Optimization , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[25]  Arthur C. Sanderson,et al.  Multimodal Function Optimization Using Minimal Representation Size Clustering and Its Application to Planning Multipaths , 1997, Evolutionary Computation.

[26]  Phil Husbands,et al.  Don't Just Play it, Grow it! : Breeding Sound Synthesis and Performance Mappings , 2004, NIME.

[27]  Ricardo A. Garcia Growing Sound Synthesizers using Evolutionary Methods , 2001 .

[28]  Bondhan Winduratna,et al.  FM Analysis/Synthesis-Based Audio Coding , 1998 .

[29]  W. Daniel Hillis,et al.  Co-evolving parasites improve simulated evolution as an optimization procedure , 1990 .

[30]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[31]  H. Muhlenbein,et al.  Asynchronous parallel search by the parallel genetic algorithm , 1991, Proceedings of the Third IEEE Symposium on Parallel and Distributed Processing.

[32]  Xin Yao,et al.  Fast Evolution Strategies , 1997, Evolutionary Programming.

[33]  Ali S. Hadi,et al.  Finding Groups in Data: An Introduction to Chster Analysis , 1991 .

[34]  Steven B. Smith,et al.  Digital Signal Processing: A Practical Guide for Engineers and Scientists , 2002 .

[35]  Mark Harman,et al.  Genetic and Evolutionary Computation (GECCO) , 2003 .

[36]  Richard K. Belew,et al.  New Methods for Competitive Coevolution , 1997, Evolutionary Computation.

[37]  Reiko Tanese,et al.  Distributed Genetic Algorithms , 1989, ICGA.

[38]  Elena Popovici,et al.  Understanding Competitive Co-Evolutionary Dynamics via Fitness Landscapes , 2004, AAAI Technical Report.

[39]  M. Narasimha Murty,et al.  Genetic K-means algorithm , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[40]  Colin G. Johnson Exploring the sound-space of synthesis algorithms using interactive genetic algorithms , 1999 .

[41]  Hui Zhang,et al.  An evolutionary K-means algorithm for clustering time series data , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[42]  Hans-Paul Schwefel,et al.  Evolutionary Programming and Evolution Strategies: Similarities and Differences , 1993 .

[43]  Günter Rudolph,et al.  Contemporary Evolution Strategies , 1995, ECAL.

[44]  S. Safavi-Naeini,et al.  A global optimization algorithm based on combined evolutionary programming/cluster analysis , 2003, CCECE 2003 - Canadian Conference on Electrical and Computer Engineering. Toward a Caring and Humane Technology (Cat. No.03CH37436).

[45]  Colin G. Johnson,et al.  Timbre interfaces using adjectives and adverbs , 2006, NIME.

[46]  David Mautner Himmelblau,et al.  Applied Nonlinear Programming , 1972 .

[47]  Shane Legg,et al.  Tournament versus fitness uniform selection , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[48]  Alan C. Schultz,et al.  Heterogeneity in the Coevolved Behaviors of Mobile Robots: The Emergence of Specialists , 2001, IJCAI.

[49]  J. Grey Timbre discrimination in musical patterns. , 1978, The Journal of the Acoustical Society of America.

[50]  Luigi Barone,et al.  An evolution strategy with probabilistic mutation for multi-objective optimisation , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[51]  James W. Beauchamp,et al.  Methods for multiple wavetable synthesis of musical instrument tones , 1993 .

[52]  Kenneth A. De Jong,et al.  Genetic Algorithms are NOT Function Optimizers , 1992, FOGA.

[53]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[54]  Larry Bull,et al.  Evolutionary computing in multi-agent environments: Partners , 1997 .

[55]  Jim Smith,et al.  Self adaptation of mutation rates in a steady state genetic algorithm , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[56]  C.-Y. Lin,et al.  HYBRID MULTIMODAL OPTIMIZATION WITH CLUSTERING GENETIC STRATEGIES , 1998 .

[57]  L. Darrell Whitley,et al.  Fundamental Principles of Deception in Genetic Search , 1990, FOGA.

[58]  R. Paul Wiegand,et al.  Spatial Embedding and Loss of Gradient in Cooperative Coevolutionary Algorithms , 2004, PPSN.

[59]  Andrew Horner,et al.  Perceptual Wavetable Matching for Synthesis of Musical Instrument Tones , 2001, ICMC.

[60]  Sewall Wright,et al.  Variability within and among natural populations , 1978 .

[61]  Zbigniew Michalewicz,et al.  Evolutionary Computation 1 , 2018 .

[62]  Ricardo A. Garcia,et al.  Automatic Design of Sound Synthesis Techniques by means of Genetic Programming , 2002 .

[63]  T. Mitchell,et al.  A comparison of evolution-strategy based methods for frequency modulated musical tone timbre matching , 2006 .

[64]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[65]  R. Paul Wiegand,et al.  An empirical analysis of collaboration methods in cooperative coevolutionary algorithms , 2001 .

[66]  Shigeyoshi Tsutsui,et al.  Forking Genetic Algorithm with Blocking and Shrinking Modes (fGA) , 1993, ICGA.

[67]  Michael O'Neill,et al.  Timbral, Perceptual, And Statistical Attributes for Synthesized Sound , 2006, ICMC.

[68]  Heinz Mühlenbein,et al.  Predictive Models for the Breeder Genetic Algorithm I. Continuous Parameter Optimization , 1993, Evolutionary Computation.

[69]  Matti Karjalainen,et al.  Plucked-string models: From the Karplus-Strong algorithm to digital waveguides and beyond , 1998 .

[70]  Larry J. Eshelman,et al.  The CHC Adaptive Search Algorithm: How to Have Safe Search When Engaging in Nontraditional Genetic Recombination , 1990, FOGA.

[71]  William M. Spears,et al.  A Generalized Graph-Based Method for Engineering Swarm Solutions to Multiagent Problems , 2006, PPSN.

[72]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[73]  Kalyanmoy Deb,et al.  Self-Adaptive Genetic Algorithms with Simulated Binary Crossover , 2001, Evolutionary Computation.

[74]  Palle Dahlstedt,et al.  Creating and Exploring the Huge Space Called Sound: Interactive Evolution as a Composition Tool , 2001 .

[75]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[76]  H. L. Le Roy,et al.  Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; Vol. IV , 1969 .

[77]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[78]  Michael J. Shaw,et al.  Genetic algorithms with dynamic niche sharing for multimodal function optimization , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[79]  Hans-Georg Beyer Toward a Theory of Evolution Strategies: On the Benefit of Sex - the (mu/mu, lambda)-Theory. , 1995 .

[80]  Andrew Horner,et al.  Auto-Programmable FM and Wavetable Synthesizers , 2003 .

[81]  Phil Husbands,et al.  Simulated Co-Evolution as the Mechanism for Emergent Planning and Scheduling , 1991, ICGA.

[82]  Phil Husbands,et al.  Distributed Coevolutionary Genetic Algorithms for Multi-Criteria and Multi-Constraint Optimisation , 1994, Evolutionary Computing, AISB Workshop.

[83]  Richard K. Belew,et al.  Methods for Competitive Co-Evolution: Finding Opponents Worth Beating , 1995, ICGA.

[84]  L. Darrell Whitley,et al.  Island Model genetic Algorithms and Linearly Separable Problems , 1997, Evolutionary Computing, AISB Workshop.

[85]  Bill Punch,et al.  SeaWave: A System for Musical Timbre Description , 1994 .

[86]  Hans-Georg Beyer,et al.  The Theory of Evolution Strategies , 2001, Natural Computing Series.

[87]  Nathalie Delprat,et al.  Global frequency modulation laws extraction from the Gabor transform of a signal: a first study of the interacting components case , 1997, IEEE Trans. Speech Audio Process..

[88]  James Mandelis,et al.  Genophone: Evolving Sounds and Integral Performance Parameter Mappings , 2003, Int. J. Artif. Intell. Tools.

[89]  C.-Y. Lin,et al.  Cluster Identification Techniques in Genetic Algorithms for Multimodal Optimization , 1998 .

[90]  Ingo Rechenberg,et al.  Evolutionsstrategie : Optimierung technischer Systeme nach Prinzipien der biologischen Evolution , 1973 .

[91]  Marcus Hutter,et al.  Fitness uniform selection to preserve genetic diversity , 2001, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[92]  C. Darwin On the Origin of Species by Means of Natural Selection: Or, The Preservation of Favoured Races in the Struggle for Life , 2019 .

[93]  James Mandelis,et al.  Adaptive Hyperinstruments: Applying Evolutionary Techniques to Sound Synthesis and Performance , 2002, NIME.

[94]  Xiaodong Yin,et al.  A Fast Genetic Algorithm with Sharing Scheme Using Cluster Analysis Methods in Multimodal Function Optimization , 1993 .

[95]  Thomas Bäck,et al.  Empirical Investigation of Multiparent Recombination Operators in Evolution Strategies , 1997, Evolutionary Computation.

[96]  S. M. Lim,et al.  Performance of the Genetic Annealing Algorithm in DFM Synthesis of Dynamic Musical Sound Samples , 1999 .

[97]  S. M. Lim,et al.  Automated Parameter Optimization of Double Frequency Modulation Synthesis Using the Genetic Annealing Algorithm , 1996 .

[98]  Alden H. Wright,et al.  Genetic Algorithms for Real Parameter Optimization , 1990, FOGA.

[99]  David E. Goldberg,et al.  Genetic Algorithms, Tournament Selection, and the Effects of Noise , 1995, Complex Syst..

[100]  Andrew Horner,et al.  Wavetable Matching Synthesis of Dynamic Instruments with Genetic Algorithms , 1995 .

[101]  Alex A. Freitas,et al.  Evolutionary Computation , 2002 .

[102]  Voula C. Georgopoulos,et al.  Wigner Distribution Representation and Analysis of Audio Signals: An Illustrated Tutorial Review , 1999 .

[103]  Roel Vertegaal,et al.  ISEE: An Intuitive Sound Editing Environment , 1994 .

[104]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[105]  Man Lan,et al.  Initialization of cluster refinement algorithms: a review and comparative study , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[106]  Darrell Whitley,et al.  A genetic algorithm tutorial , 1994, Statistics and Computing.

[107]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[108]  M. Preuss,et al.  On the extinction of sub-populations on multimodal landscapes , 2004 .

[109]  Pedro Larrañaga,et al.  An empirical comparison of four initialization methods for the K-Means algorithm , 1999, Pattern Recognit. Lett..

[110]  J. Justice,et al.  Analytic signal processing in music computation , 1979 .

[111]  Franz Rothlauf,et al.  Applications of Evolutionary Computing, EvoWorkshops 2005: EvoBIO, EvoCOMNET, EvoHOT, EvoIASP, EvoMUSART, and EvoSTOC, Lausanne, Switzerland, March 30 - April 1, 2005, Proceedings , 2005, EvoWorkshops.

[112]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[113]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[114]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[115]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.

[116]  Michael L. Mauldin,et al.  Maintaining Diversity in Genetic Search , 1984, AAAI.

[117]  R. Paul Wiegand,et al.  Biasing Coevolutionary Search for Optimal Multiagent Behaviors , 2006, IEEE Transactions on Evolutionary Computation.

[118]  Sankar K. Pal,et al.  Fuzzy models for pattern recognition : methods that search for structures in data , 1992 .

[119]  Keith E. Mathias,et al.  The Effects of Control Parameters and Restarts on Search Stagnation in Evolutionary Programming , 1998, PPSN.

[120]  Kaare Wehn,et al.  Using Ideas from Natural Selection to Evolve Synthesized Sounds , 1998 .

[121]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[122]  Cheng Yang,et al.  Music Database Retrieval Based on Spectral Similarity , 2001 .

[123]  Kenneth A. De Jong,et al.  A Dynamical Systems Analysis of Collaboration Methods in Cooperative Co-evolution , 2005, AAAI Fall Symposium: Coevolutionary and Coadaptive Systems.

[124]  Yuval Davidor,et al.  Epistasis Variance: A Viewpoint on GA-Hardness , 1990, FOGA.

[125]  P Willett,et al.  Comparison of algorithms for dissimilarity-based compound selection. , 1997, Journal of molecular graphics & modelling.

[126]  Vesa Välimäki,et al.  Parameter Estimation of a Plucked String Synthesis Model Using a Genetic Algorithm with Perceptual Fitness Calculation , 2003, EURASIP J. Adv. Signal Process..

[127]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[128]  Mitchell A. Potter,et al.  The design and analysis of a computational model of cooperative coevolution , 1997 .

[129]  李幼升,et al.  Ph , 1989 .

[130]  Andrew Horner Nested modulator and feedback FM matching of instrument tones , 1998, IEEE Trans. Speech Audio Process..

[131]  Aimo Törn,et al.  CLUSTERING METHODS IN GLOBAL OPTIMIZATION , 1986 .

[132]  Russell G. Payne,et al.  A Microcomputer-Based Analysis/Resynthesis Scheme for Processing Sampled Sounds using FM , 1987, ICMC.

[133]  Andreas Zell,et al.  A Clustering Based Niching EA for Multimodal Search Spaces , 2003, Artificial Evolution.

[134]  Jordan B. Pollack,et al.  On identifying global optima in cooperative coevolution , 2005, GECCO '05.

[135]  Judith C. Brown Calculation of a constant Q spectral transform , 1991 .

[136]  James W. Beauchamp,et al.  Error metrics for predicting discrimination of original and spectrally altered musical instrument sounds , 2003 .

[137]  Kalmanje Krishnakumar,et al.  Micro-Genetic Algorithms For Stationary And Non-Stationary Function Optimization , 1990, Other Conferences.

[138]  Francisco Herrera,et al.  Tackling Real-Coded Genetic Algorithms: Operators and Tools for Behavioural Analysis , 1998, Artificial Intelligence Review.

[139]  James W. Beauchamp,et al.  A Search for Best Error Metrics to Predict Discrimination of Original and Spectrally Altered Musical Instrument Sounds , 2006, ICMC.

[140]  T. J. Mitchell,et al.  Evolutionary Sound Matching: A Test Methodology and Comparative Study , 2007, ICMLA 2007.

[141]  Michael O'Neill,et al.  Toward User-Directed Evolution of Sound Synthesis Parameters , 2005, EvoWorkshops.

[142]  Jinn-Moon Yang,et al.  Integrating adaptive mutations and family competition into genetic algorithms as function optimizer , 2000, Soft Comput..

[143]  Eduardo Miranda,et al.  Computer Sound Design : Synthesis techniques and programming , 2002 .

[144]  Darrell Whitley,et al.  Genitor: a different genetic algorithm , 1988 .

[145]  Andrew W. Moore,et al.  X-means: Extending K-means with Efficient Estimation of the Number of Clusters , 2000, ICML.

[146]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[147]  Michael Nikolaou,et al.  A hybrid approach to global optimization using a clustering algorithm in a genetic search framework , 1998 .

[148]  C.-Y. Lin,et al.  Niche identification techniques in multimodal genetic search with sharing scheme , 2002 .

[149]  James E. Baker,et al.  Adaptive Selection Methods for Genetic Algorithms , 1985, International Conference on Genetic Algorithms.

[150]  Stephan M. Winkler,et al.  GA-Selection Revisited from an ES-Driven Point of View , 2005, IWINAC.

[151]  Colin G. Johnson,et al.  Exploring Sound-Space with Interactive Genetic Algorithms , 2003, Leonardo.

[152]  Jonathan E. Rowe,et al.  An Evolution Strategy Using a Continuous Version of the Gray-Code Neighbourhood Distribution , 2004, GECCO.

[153]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[154]  Thomas Jansen,et al.  The Cooperative Coevolutionary (11) EA , 2004, Evolutionary Computation.

[155]  Rajarshi Das,et al.  A Study of Control Parameters Affecting Online Performance of Genetic Algorithms for Function Optimization , 1989, ICGA.

[156]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[157]  Curtis Roads,et al.  The Computer Music Tutorial , 1996 .

[158]  R. Paul Wiegand,et al.  A Sensitivity Analysis of a Cooperative Coevolutionary Algorithm Biased for Optimization , 2004, GECCO.

[159]  Stephen A. Brewster,et al.  Designing Sound: Towards a System for Designing Audio Interfaces using Timbre Spaces , 2004, ICAD.

[160]  Samir W. Mahfoud Niching methods for genetic algorithms , 1996 .

[161]  R. K. Ursem Multinational evolutionary algorithms , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[162]  Anthony G. Pipe,et al.  Convergence Synthesis of Dynamic Frequency Modulation Tones Using an Evolution Strategy , 2005, EvoWorkshops.

[163]  J. Sprave LINEAR NEIGHBORHOOD EVOLUTION STRATEGY , 1999 .

[164]  John M. Chowning,et al.  The Synthesis of Complex Audio Spectra by Means of Frequency Modulation , 1973 .

[165]  Thomas Bäck,et al.  Intelligent Mutation Rate Control in Canonical Genetic Algorithms , 1996, ISMIS.

[166]  Mike Preuss,et al.  Counteracting genetic drift and disruptive recombination in (μpluskommaλ)-EA on multimodal fitness landscapes , 2005, GECCO '05.

[167]  S. H. Tang,et al.  Real-Time Implementation of Double Frequency Modulation (DFM) Synthesis , 1994 .

[168]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[169]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .