Spontaneous organisation, pattern models, and music

Pattern theory provides a set of principles for constructing generative models of the information contained in natural signals, such as images or sound. Consequently, it also represents a useful language within which to develop generative systems of art. A pattern theory inspired framework and set of algorithms for interactive computer music composition are presented in the form of a self-organising hidden Markov model – a modular, graphical approach to the representation and spontaneous organisation of sound events in time and in parameter space. The result constitutes a system for composing stochastic music which incorporates creative and structural ideas such as uncertainty, variability, hierarchy and complexity, and which bears a strong relationship to realistic models of statistical physics or perceptual systems. The pattern theory approach to composition provides an elegant set of organisational principles for the production of sound by computer. Further, its machine learning underpinnings suggest many interesting applications to emergent tasks concerning the learning and creative modification of musical forms.

[1]  Brian Whitman,et al.  MUSICALLY EXPRESSIVE SOUND TEXTURES FROM GENERALIZED AUDIO , 2003 .

[2]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[3]  J. Cardy.  Scaling and Renormalization in Statistical Physics , 1996 .

[4]  Ulf Grenander.  Pattern synthesis , 1976, Lectures in pattern theory / U. Grenander.

[5]  P. Todd,et al.  Musical networks: Parallel distributed perception and performance , 1999 .

[6]  U. Grenander.  Elements of Pattern Theory , 1996 .

[7]  Diemo Schwarz,et al.  A SYSTEM FOR DATA-DRIVEN CONCATENATIVE SOUND SYNTHESIS , 2000 .

[8]  Geraint A. Wiggins,et al.  AI Methods for Algorithmic Composition: A Survey, a Critical View and Future Prospects , 1999 .

[9]  Perry R. Cook,et al.  MOSIEVIUS: FEATURE DRIVEN INTERACTIVE AUDIO MOSAICING , 2003 .

[10]  Shlomo Dubnov,et al.  Using Machine-Learning Methods for Musical Style Modeling , 2003, Computer.

[11]  Nicola Orio,et al.  An Automatic Accompanist Based on Hidden Markov Models , 2001, AI*IA.

[12]  William H. Press,et al.  Numerical recipes in C , 2002 .

[13]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[14]  Xavier Rodet,et al.  Tracking of partials for additive sound synthesis using hidden Markov models , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[15]  Matthew Wright,et al.  Open SoundControl: A New Protocol for Communicating with Sound Synthesizers , 1997, ICMC.

[16]  Tristan Jehan,et al.  Perceptual Synthesis Engine: An Audio-Driven Timbre Generator , 2001 .

[17]  F. Pachet,et al.  MUSICAL MOSAICING , 2001 .

[18]  David Zicarelli,et al.  M and Jam Factory , 1987 .

[19]  Neil Gershenfeld,et al.  Probabilistic characterization and synthesis of complex driven systems , 2000 .

[20]  Philip C. Woodland,et al.  A hidden Markov-model-based trainable speech synthesizer , 1999, Comput. Speech Lang..

[21]  Klaus Obermayer,et al.  Computing auditory perception , 2000, Organised Sound.

[22]  Christopher Raphael.  A Bayesian Network for Real-Time Musical Accompaniment , 2001, NIPS.

[23]  Keiichi Tokuda,et al.  Simultaneous modeling of spectrum, pitch and duration in HMM-based speech synthesis , 1999, EUROSPEECH.

[24]  Nicola Orio,et al.  Score Following Using Spectral Analysis and Hidden Markov Models , 2001, ICMC.

[25]  Michael A. Casey,et al.  General sound classification and similarity in MPEG-7 , 2001, Organised Sound.

[26]  Iannis Xenakis,et al.  Determinacy and indeterminacy , 1996, Organised Sound.

[27]  Peter M. Todd,et al.  Musical networks , 1999 .

[28]  Steve Young,et al.  The HTK hidden Markov model toolkit: design and philosophy , 1993 .

[29]  David Mumford,et al.  Pattern Theory: the Mathematics of Perception , 2002, math/0212400.

[30]  Lawrence K. Saul,et al.  Markov Processes on Curves , 2000, Machine Learning.

[31]  J. Grey.  Multidimensional perceptual scaling of musical timbres. , 1977, The Journal of the Acoustical Society of America.

[32]  Jeremy S. De Bonet,et al.  Multiresolution sampling procedure for analysis and synthesis of texture images , 1997, SIGGRAPH.

[33]  Stan Z. Li,et al.  Markov Random Field Modeling in Computer Vision , 1995, Computer Science Workbench.

[34]  William P. Birmingham,et al.  The MusArt Music-Retrieval System: An Overview: D-lib Magazine , 2002 .

[35]  D. Kersten,et al.  Pattern inference theory : A probabilistic approach to human vision ∗ , 1999 .

[36]  Eric Tkaczyk,et al.  Pressure Hallucinations and Patterns in the Brain , 2001 .

[37]  Darrell Conklin,et al.  Music Generation from Statistical Models , 2003 .