Learning to Create Jazz Melodies Using Deep Belief Nets

We describe an unsupervised learning technique to facilitate automated creation of jazz melodic improvisation over chord sequences. Specifically we demonstrate training an artificial improvisation algorithm based on unsupervised learning using deep belief nets, a form of probabilistic neural network based on restricted Boltzmann machines. We present a musical encoding scheme and specifics of a learning and creational method. Our approach creates novel jazz licks, albeit not yet in real-time. The present work should be regarded as a feasibility study to determine whether such networks could be used at all. We do not claim superiority of this approach for pragmatically creating jazz.

[1]  Louis P. DiPalma,et al.  Music and Connectionism , 1991 .

[2]  D. Eck,et al.  Learning Musical Structure Directly from Sequences of Music , 2006 .

[3]  John A. Biles,et al.  GenJam: A Genetic Algorithm for Generating Jazz Solos , 1994, ICMC.

[4]  Geoffrey E. Hinton,et al.  Generating Facial Expressions with Deep Belief Nets , 2008 .

[5]  Robert M. Keller,et al.  LEARNING JAZZ GRAMMARS , 2009 .

[6]  Geoffrey E. Hinton,et al.  To recognize shapes, first learn to generate images. , 2007, Progress in brain research.

[7]  Peter M. Todd,et al.  Frankensteinian methods for evolutionary music composition , 1999 .

[8]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[9]  John F. Kalaska,et al.  Computational neuroscience : theoretical insights into brain function , 2007 .

[10]  Robert M. Keller,et al.  A Grammatical Approach to Automatic Improvisation , 2007 .

[11]  Scott J. Simon Computer models of musical creativity , 2007, J. Assoc. Inf. Sci. Technol..

[12]  Matthew I. Bellgard,et al.  Harmonizing Music the Boltzmann Way , 1994, Connect. Sci..

[13]  Michael C. Mozer,et al.  Neural Network Music Composition by Prediction: Exploring the Benefits of Psychoacoustic Constraints and Multi-scale Processing , 1994, Connect. Sci..

[14]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[15]  Paul Smolensky,et al.  Information processing in dynamical systems: foundations of harmony theory , 1986 .

[16]  Geoffrey E. Hinton,et al.  Restricted Boltzmann machines for collaborative filtering , 2007, ICML '07.

[17]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.