Functional Scaffolding for Composing Additional Musical Voices

Many tools for computer-assisted composition contain built-in music-theoretical assumptions that may constrain the output to particular styles. In contrast, this article presents a new musical representation that contains almost no built-in knowledge, but that allows even musically untrained users to generate polyphonic textures that are derived from the user's own initial compositions. This representation, called functional scaffolding for musical composition (FSMC), exploits a simple yet powerful property of multipart compositions: The pattern of notes and rhythms in different instrumental parts of the same song are functionally related. That is, in principle, one part can be expressed as a function of another. Music in FSMC is represented accordingly as a functional relationship between an existing human composition, or scaffold, and a generated set of one or more additional musical voices. A human user without any musical expertise can then explore how the generated voice (or voices) should relate to the scaffold through an interactive evolutionary process akin to animal breeding. By inheriting from the intrinsic style and texture of the piece provided by the user, this approach can generate additional voices for potentially any style of music without the need for extensive musical expertise.

[1]  David Cope.  An Expert System for Computer-Assisted Composition , 1987 .

[2]  Hod Lipson,et al.  Upload any object and evolve it: Injecting complex geometric patterns into CPPNS for further evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[3]  R. Dawkins.  The Blind Watchmaker , 1986 .

[4]  Artemis Moroni,et al.  Vox Populi: An Interactive Evolutionary System for Algorithmic Music Composition , 2000, Leonardo Music Journal.

[5]  R. Keller,et al.  A Computational Framework Enhancing Jazz Creativity , 2006 .

[6]  Nao and Iba Hitoshi Tokui,et al.  Music Composition with Interactive Evolutionary Computation , 2000 .

[7]  Kenneth O. Stanley,et al.  GENERATING MUSICAL ACCOMPANIMENT THROUGH FUNCTIONAL SCAFFOLDING , 2011 .

[8]  Brad Johanson,et al.  GP-Music: An Interactive Genetic Programming System for Music Generation with Automated Fitness Raters , 2007 .

[9]  Robert M. Keller,et al.  A Grammatical Approach to Automatic Improvisation , 2007 .

[10]  C. Chuan.  Supporting Compositional Creativity Using Automatic Style-Specific Accompaniment , 2008 .

[11]  G. L. Nelson.  Sonomorphs: An application of genetic algorithms to the growth and development of musical organisms , 1993 .

[12]  Rolf Drechsler,et al.  Applications of Evolutionary Computing, EvoWorkshops 2008: EvoCOMNET, EvoFIN, EvoHOT, EvoIASP, EvoMUSART, EvoNUM, EvoSTOC, and EvoTransLog, Naples, Italy, March 26-28, 2008. Proceedings , 2008, EvoWorkshops.

[13]  J. Mccormack.  Grammar-based music composition , 1996 .

[14]  Kenneth O. Stanley,et al.  Exploiting functional relationships in musical composition , 2009, Connect. Sci..

[15]  Nicholas Cook,et al.  Music, Imagination, And Culture , 1991 .

[16]  Bob L. Sturm,et al.  Proceedings of the International Computer Music Conference , 2011 .

[17]  Kenneth O. Stanley,et al.  Generating a Complete Multipart Musical Composition from a Single Monophonic Melody with Functional Scaffolding , 2012, ICCC.

[18]  Darrell Conklin,et al.  Music Generation from Statistical Models , 2003 .

[19]  François Pachet,et al.  The Continuator: Musical Interaction With Style , 2003, ICMC.

[20]  J. Clune,et al.  Evolving 3D objects with a generative encoding inspired by developmental biology , 2011, SEVO.

[21]  Eduardo Miranda,et al.  Readings in Music and Artificial Intelligence , 2000, Readings in Music and Artificial Intelligence.

[22]  Alan Marsden,et al.  Music, Intelligence and Artificiality , 2000, Readings in Music and Artificial Intelligence.

[23]  James Kippen,et al.  MODELLING MUSIC WITH GRAMMARS: FORMAL LANGUAGE REPRESENTATION IN THE BOL PROCESSOR , 1992 .

[24]  Karl Sims,et al.  Artificial evolution for computer graphics , 1991, SIGGRAPH.

[25]  Chris Mellish,et al.  Statistical Learning of Harmonic Movement , 1999 .

[26]  J. Biles.  Improvizing with Genetic Algorithms: GenJam , 2007 .

[27]  D. Temperley.  The Cognition of Basic Musical Structures , 2001 .

[28]  Dan Morris,et al.  MySong: automatic accompaniment generation for vocal melodies , 2008, CHI.

[29]  S. R. Holtzman,et al.  Using Generative Grammars for Music Composition , 1981 .

[30]  John A. Biles,et al.  GenJam: A Genetic Algorithm for Generating Jazz Solos , 1994, ICMC.

[31]  Robert M. Keller,et al.  LEARNING JAZZ GRAMMARS , 2009 .

[32]  Palle Dahlstedt,et al.  A Generative Representation for the Evolution of Jazz Solos , 2008, EvoWorkshops.

[33]  Kenneth O. Stanley,et al.  Interactively evolving harmonies through functional scaffolding , 2011, GECCO '11.

[34]  Eduardo Miranda,et al.  Evolutionary Computer Music , 2007 .

[35]  Thomas Noll,et al.  Mathematics and Computation in Music , 2009 .

[36]  Daniel Müllensiefen,et al.  Bayesian Model Selection for Harmonic Labelling , 2007 .

[37]  Kenneth O. Stanley,et al.  Scaffolding for Interactively Evolving Novel Drum Tracks for Existing Songs , 2008, EvoWorkshops.

[38]  Robert M. Keller,et al.  Machine Learning of Jazz Grammars , 2010, Computer Music Journal.

[39]  Alan Marsden,et al.  Computer representations and models in music , 1992 .

[40]  Peter M. Todd,et al.  Frankensteinian methods for evolutionary music composition , 1999 .

[41]  D. Levitin.  This Is Your Brain on Music , 2006 .

[42]  Kenneth O. Stanley,et al.  Compositional Pattern Producing Networks : A Novel Abstraction of Development , 2007 .

[43]  Robert M. Keller,et al.  Automating the Explanation of Jazz Chord Progressions Using Idiomatic Analysis , 2013, Computer Music Journal.

[44]  Hideyuki Takagi,et al.  Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation , 2001, Proc. IEEE.

[45]  David Zicarelli,et al.  M and Jam Factory , 1987 .

[46]  P. Todd,et al.  Musical networks: Parallel distributed perception and performance , 1999 .

[47]  Kenneth O. Stanley,et al.  Picbreeder: A Case Study in Collaborative Evolutionary Exploration of Design Space , 2011, Evolutionary Computation.

[48]  Hideki Koike,et al.  ImprovGenerator: Online Grammatical Induction for On-the-Fly Improvisation Accompaniment , 2010, NIME.

[49]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.