Developing and evaluating computational models of musical style

Abstract Stylistic composition is a creative musical activity, in which students as well as renowned composers write according to the style of another composer or period. We describe and evaluate two computational models of stylistic composition, called Racchman-Oct2010 (random constrained chain of Markovian nodes, October 2010) and Racchmaninof-Oct2010 (Racchman with inheritance of form). The former is a constrained Markov model, and the latter embeds this model in an analogy-based design system. Racchmaninof-Oct2010 applies a pattern discovery algorithm called SIACT and a perceptually validated formula for rating pattern importance, to guide the generation of a new target design from an existing source design. A listening study is reported concerning human judgments of music excerpts that are, to varying degrees, in the style of mazurkas by Frédéric Chopin (1810–1849). The listening study acts as an evaluation of the two computational models and a third, benchmark system, called Experiments in Musical Intelligence. Judges' responses indicate that some aspects of musical style, such as phrasing and rhythm, are being modeled effectively by our algorithms. Judgments are also used to identify areas for future improvements. We discuss the broader implications of this work for the fields of engineering and design, where there is potential to make use of our models of hierarchical repetitive structure.

[1]  C. Stevens,et al.  Sweet Anticipation: Music and the Psychology of Expectation, by David Huron . Cambridge, Massachusetts: MIT Press, 2006 , 2007 .

[2]  John S. Gero,et al.  Modeling Creativity and Knowledge-Based Creative Design , 1993 .

[3]  Geraint A. Wiggins Computer Models of Musical Creativity: A Review of Computer Models of Musical Creativity by David Cope , 2007, Lit. Linguistic Comput..

[4]  John Rink,et al.  Tonal architecture in the early music , 1992 .

[5]  David Meredith,et al.  The ps13 pitch spelling algorithm , 2006 .

[6]  Scott J. Simon Computer models of musical creativity , 2007, J. Assoc. Inf. Sci. Technol..

[7]  Alan Smaill,et al.  Chorale harmonization: A view from a search control perspective , 2006 .

[8]  Ashok K. Goel,et al.  Structure, behavior, and function of complex systems: The structure, behavior, and function modeling language , 2008, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[9]  Mark Lindley,et al.  The New Grove Dictionary of Music and Musicians , 2001 .

[10]  Geraint A. Wiggins,et al.  Evaluating Cognitive Models of Musical Composition , 2007 .

[11]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[12]  Geraint A. Wiggins,et al.  Algorithms for discovering repeated patterns in multidimensional representations of polyphonic music , 2002 .

[13]  D. Gareth Loy,et al.  Musimathics : the mathematical foundations of music , 2006 .

[14]  Deborah L Thurston,et al.  A formal method for subjective design evaluation with multiple attributes , 1991 .

[15]  Robin C. Laney,et al.  A Comparative Evaluation of Algorithms for Discovering Translational Patterns in Baroque Keyboard Works , 2010, ISMIR.

[16]  Geraint A. Wiggins,et al.  Development of Techniques for the Computational Modelling of Harmony , 2010, ICCC.

[17]  Craig Stuart Sapp Visual hierarchical key analysis , 2005, CIE.

[18]  Andrew Gartland-Jones,et al.  The Suitability of Genetic Algorithms for Musical Composition , 2003 .

[19]  S. Hedges DICE MUSIC IN THE EIGHTEENTH CENTURY , 1978 .

[20]  Anja Volk The Study of Syncopation Using Inner Metric Analysis: Linking Theoretical and Experimental Analysis of Metre in Music , 2008 .

[21]  Charles Rosen,et al.  The Romantic Generation , 1996 .

[22]  David Cope,et al.  Experiments In Musical Intelligence , 1996 .

[23]  Ian H. Witten,et al.  Multiple viewpoint systems for music prediction , 1995 .

[24]  Ted Pedersen,et al.  Empiricism Is Not a Matter of Faith , 2008, Computational Linguistics.

[25]  Margaret A. Boden,et al.  The Creative Mind - Myths and Mechanisms (2. ed.) , 2003 .

[26]  RockOn Team,et al.  Re: Attenuation compensation in single-photon emission tomography: a comparative evaluation. , 1983, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[27]  François Pachet,et al.  Enforcing Meter in Finite-Length Markov Sequences , 2013, AAAI.

[28]  Stephan M. Schwanauer,et al.  Machine Models of Music , 1993 .

[29]  David C. Brown,et al.  Developing computational design creativity systems , 2013 .

[30]  Lee Spector,et al.  Introduction to the Special Issue on genetic programming for human-competitive designs , 2008, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[31]  Nicholas Cook,et al.  A guide to musical analysis , 1987 .

[32]  Robert M. Keller,et al.  A Creative Improvisational Companion Based on Idiomatic Harmonic Bricks , 2012, ICCC.

[33]  Tom Collins,et al.  Improved methods for pattern discovery in music, with applications in automated stylistic composition , 2011 .

[34]  John S. Gero,et al.  Function–behavior–structure paths and their role in analogy-based design , 1996, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[35]  Nick Collins,et al.  Musical Form and Algorithmic Composition , 2009 .

[36]  Graeme Ritchie,et al.  Some Empirical Criteria for Attributing Creativity to a Computer Program , 2007, Minds and Machines.

[37]  Darrell Conklin,et al.  Discovery of distinctive patterns in music , 2010, Intell. Data Anal..

[38]  M. Minsky The Emotion Machine: Commonsense Thinking, Artificial Intelligence, and the Future of the Human Mind , 2006 .

[39]  Nicolas Gold,et al.  Plus ça change: analyzing performances of Chopin’s Mazurka Op. 24 No. 2 , 2008 .

[40]  M. Boden The creative mind : myths & mechanisms , 1991 .

[41]  David Cope,et al.  Composer's Underscoring Environment (CUE) , 1997, ICMC.

[42]  David Huron,et al.  Does Higher Music Tend to Move Faster? Evidence For A Pitch-Speed Relationship , 2012 .

[43]  Chris Mellish,et al.  Statistical Learning of Harmonic Movement , 1999 .

[44]  D. Vere-Jones Markov Chains , 1972, Nature.

[45]  Robin C. Laney,et al.  Modeling pattern importance in Chopin's mazurkas , 2011 .

[46]  Geraint A. Wiggins,et al.  Towards A Framework for the Evaluation of Machine Compositions , 2001 .

[47]  François Couperin,et al.  Les baricades mistérieuses , 2010 .

[48]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[49]  Mathieu Bergeron,et al.  Feature Set Patterns in Music , 2008, Computer Music Journal.

[50]  François Pachet Interacting with a Musical Learning System: The Continuator , 2002, ICMAI.

[51]  CopeDavid The well-programmed clavier , 2013 .

[52]  Mira Balaban,et al.  Understanding music with AI: perspectives on music cognition , 1992 .

[53]  Tom Collins,et al.  FreshJam: Suggesting Continuations of Melodic Fragments in a Specific Style , 2012, MUME@AIIDE.

[54]  Jose D. Fernández,et al.  AI Methods in Algorithmic Composition: A Comprehensive Survey , 2013, J. Artif. Intell. Res..

[55]  GoelAshok k.,et al.  Structure, behavior, and function of complex systems , 2009 .

[56]  Eduardo Reck Miranda,et al.  Constraint Application with Higher-Order Programming for Modeling Music Theories , 2010, Computer Music Journal.

[57]  Arne Eigenfeldt,et al.  Realtime Generation of Harmonic Progressions Using Constrained Markov Selection , 2010, ICCC.

[58]  Gareth Loy Musimathics: The Mathematical Foundations of Music, Volume 1 , 2006 .

[59]  François Pachet,et al.  Markov constraints: steerable generation of Markov sequences , 2010, Constraints.

[60]  Matthew Crosby,et al.  Association for the Advancement of Artificial Intelligence , 2014 .

[61]  D. Cope Virtual Music: Computer Synthesis of Musical Style , 2001 .

[62]  Garry Ellard University of Edinburgh School of Informatics The Speckled Tango Dancers : Real-time Motion Capture of Two-body interactions using on-body Wireless Sensor Networks , 2009 .

[63]  Marcus T. Pearce,et al.  The construction and evaluation of statistical models of melodic structure in music perception and composition , 2005 .

[64]  Geraint A. Wiggins,et al.  A preliminary framework for description, analysis and comparison of creative systems , 2006, Knowl. Based Syst..

[65]  Wendy Ju,et al.  The Design of Implicit Interactions: Making Interactive Systems Less Obnoxious , 2008, Design Issues.

[66]  Ashok K. Goel,et al.  Compound Analogical Design: Interaction between Problem Decomposition and Analogical Transfer in Biologically Inspired Design , 2008 .

[67]  Charles Ames,et al.  The Markov Process as a Compositional Model: A Survey and Tutorial , 2017 .

[68]  Darrell Conklin,et al.  Music Generation from Statistical Models , 2003 .

[69]  Kemal Ebcioglu,et al.  An Expert System for Harmonizing Chorales in the Style of J. S. Bach , 1990, J. Log. Program..

[70]  Man-Kwan Shan,et al.  Algorithmic compositions based on discovered musical patterns , 2009, Multimedia Tools and Applications.

[71]  Gerhard Nierhaus,et al.  Algorithmic Composition: Paradigms of Automated Music Generation , 2008 .

[72]  Geraint A. Wiggins,et al.  Motivations and Methodologies for Automation of the Compositional Process , 2002 .

[73]  Steven M. Smith,et al.  Metrics for measuring ideation effectiveness , 2003 .

[74]  David W. Rosen,et al.  Refined metrics for measuring ideation effectiveness , 2009 .

[75]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[76]  William P. Birmingham,et al.  Algorithms for Chordal Analysis , 2002, Computer Music Journal.

[77]  Moray Allan,et al.  Harmonising Chorales in the Style of Johann Sebastian Bach , 2002 .

[78]  M. Lorenzen Creativity in context : Content, cost, chance and collection in the organization of the film industry , 2009 .

[79]  Sharon Bailin CREATIVITY IN CONTEXT , 2002 .

[80]  Anders Friberg,et al.  Algorithmic Composition of Popular Music , 2012 .

[81]  Ian Cross,et al.  A n-gram approach to fugal exposition composition ∗ , 2003 .

[82]  Barney Childs,et al.  Experimental Music , 1975 .