Automatic Calibration of Modified FM Synthesis to Harmonic Sounds using Genetic Algorithms

Many audio synthesis techniques have been successful in reproducing the sounds of musical instruments. Several of these techniques require parameters calibration. However, this task can be difficult and time-consuming especially when there is not intuitive correspondence between a parameter value and the change in the produced sound. Searching the parameter space for a given synthesis technique is, therefore, a task more naturally suited to an automatic optimization scheme. Genetic algorithms (GA) have been used rather extensively for this purpose, and in particular for calibrating Classic FM (ClassicFM) synthesis to mimic recorded harmonic sounds. In this work, we use GA to further explore its modified counterpart, Modified FM (ModFM), which has not been used as widely, and its ability to produce musical sounds not as fully explored. We completely automize the calibration of a ModFM synthesis model for the reconstruction of harmonic instrument tones using GA. In this algorithm, we refine parameters and operators such as crossover probability or mutation operator for closer match. As an evaluation, we show that GA system automatically generates harmonic musical instrument sounds closely matching the target recordings, a match comparable to the application of GA to ClassicFM synthesis.

[1]  John M. Chowning,et al.  The Synthesis of Complex Audio Spectra by Means of Frequency Modulation , 1973 .

[2]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[3]  Bernard A. Hutchins The Frequency Modulation Spectrum of an Exponential Voltage-Controlled Oscillator , 1975 .

[4]  J.A. Moorer,et al.  Signal processing aspects of computer music: A survey , 1977, Proceedings of the IEEE.

[5]  J. Justice,et al.  Analytic signal processing in music computation , 1979 .

[6]  James W. Beauchamp,et al.  Synthesis by Spectral Amplitude and "Brightness" Matching of Analyzed Musical Instrument Tones , 1981 .

[7]  James W. Beauchamp,et al.  Machine Tongues XVI: Genetic Algorithms and Their Application to FM Matching Synthesis , 1993 .

[8]  John A. Biles,et al.  GenJam: A Genetic Algorithm for Generating Jazz Solos , 1994, ICMC.

[9]  Ichiro Fujinaga,et al.  Genetic Algorithms as a Method for Granular Synthesis Regulation , 1994, International Conference on Mathematics and Computing.

[10]  James W. Beauchamp,et al.  Piecewise-linear approximation of additive synthesis envelopes: A comparison of various methods , 1996 .

[11]  Andrew Horner Nested modulator and feedback FM matching of instrument tones , 1998, IEEE Trans. Speech Audio Process..

[12]  Keiichi Tokuda,et al.  Simultaneous modeling of spectrum, pitch and duration in HMM-based speech synthesis , 1999, EUROSPEECH.

[13]  Jason D. Lohn,et al.  A circuit representation technique for automated circuit design , 1999, IEEE Trans. Evol. Comput..

[14]  Ronen Barzel,et al.  Audio Anecdotes II: Tools, Tips, and Techniques for Digital Audio , 2004 .

[15]  John Wawrzynek,et al.  Subtractive Synthesis without Filters , 2007 .

[16]  Andrew Horner,et al.  Evolution in Digital Audio Technology , 2007 .

[17]  Joseph Timoney,et al.  New Methods of Formant Analysis-Synthesis for Musical Applications , 2009, ICMC.

[18]  Jörn Loviscach,et al.  Automatic Cloning of Recorded Sounds by Software Synthesizers , 2009 .

[19]  Victor Lazzarini,et al.  Theory and Practice of Modified Frequency Modulation Synthesis , 2010 .

[20]  Eduardo Reck Miranda,et al.  Evolutionary Sound Synthesis: Rendering Spectrograms from Cellular Automata Histograms , 2010, EvoApplications.

[21]  Matthew Yee-King,et al.  A Comparison of Parametric Optimization Techniques for Musical Instrument Tone Matching , 2011 .