Tonal Emergence: An agent-based model of tonal coordination

Humans have a remarkable capacity for coordination. Our ability to interact and act jointly in groups is crucial to our success as a species. Joint Action (JA) research has often concerned itself with simplistic behaviors in highly constrained laboratory tasks. But there has been a growing interest in understanding complex coordination in more open-ended contexts. In this regard, collective music improvisation has emerged as a fascinating model domain for studying basic JA mechanisms in an unconstrained and highly sophisticated setting. A number of empirical studies have begun to elucidate coordination mechanisms underlying joint musical improvisation, but these findings have yet to be cached out in a working computational model. The present work fills this gap by presenting Tonal Emergence, an idealized agent-based model of improvised musical coordination. Tonal Emergence models the coordination of notes played by improvisers to generate harmony (i.e., tonality), by simulating agents that stochastically generate notes biased towards maximizing harmonic consonance given their partner's previous notes. The model replicates an interesting empirical result from a previous study of professional jazz pianists: feedback loops of mutual adaptation between interacting agents support the production of consonant harmony. The model is further explored to show how complex tonal dynamics, such as the production and dissolution of stable tonal centers, are supported by agents that are characterized by (i) a tendency to strive toward consonance, (ii) stochasticity, and (iii) a limited memory for previously played notes. Tonal Emergence thus provides a grounded computational model to simulate and probe the coordination mechanisms underpinning one of the more remarkable feats of human cognition: collective music improvisation.

[1]  Graham Neubig,et al.  Few-shot Language Coordination by Modeling Theory of Mind , 2021, ICML.

[2]  Robert L. Goldstone,et al.  Coordination and Consonance Between Interacting, Improvising Musicians , 2020, Open Mind.

[3]  Rajesh P. N. Rao,et al.  Modeling other minds: Bayesian inference explains human choices in group decision-making , 2019, Science Advances.

[4]  R. Dow,et al.  Wellbeing and Integration through Community Music: The Role of Improvisation in a Music Group of Refugees, Asylum Seekers and Local Community Members , 2019, Contemporary Music Review.

[5]  Caroline Palmer,et al.  Staying Together: A Bidirectional Delay-Coupled Approach to Joint Action , 2019, Cogn. Sci..

[6]  Tom Froese,et al.  Embodied Dyadic Interaction Increases Complexity of Neural Dynamics: A Minimal Agent-Based Simulation Model , 2019, Front. Psychol..

[7]  A. Chemero,et al.  Musical creativity and the embodied mind , 2018 .

[8]  Andrew M. Dai,et al.  Music Transformer: Generating Music with Long-Term Structure , 2018, ICLR.

[9]  Douglas Eck,et al.  This time with feeling: learning expressive musical performance , 2018, Neural Computing and Applications.

[10]  Oliver Bown,et al.  Biologically-Inspired and Agent-Based Algorithms for Music , 2018, The Oxford Handbook of Algorithmic Music.

[11]  P. Loui,et al.  White Matter Connectivity Reflects Success in Musical Improvisation , 2017, bioRxiv.

[12]  Anna Zamm,et al.  Interactions in Ensemble Music Performance : Empirical and Mathematical Accounts , 2017 .

[13]  Gaëtan Hadjeres,et al.  Deep Learning Techniques for Music Generation - A Survey , 2017, ArXiv.

[14]  D. Miell,et al.  The Routledge Companion to Embodied Music Interaction , 2017 .

[15]  Jon McCormack,et al.  Using Autonomous Agents to Improvise Music Compositions in Real-Time , 2017, EvoMUSART.

[16]  Jean-Julien Aucouturier,et al.  Musical friends and foes: The social cognition of affiliation and control in improvised interactions , 2017, Cognition.

[17]  Chris L. Baker,et al.  Rational quantitative attribution of beliefs, desires and percepts in human mentalizing , 2017, Nature Human Behaviour.

[18]  Marcelo M. Wanderley,et al.  The Unresponsive Partner: Roles of Social Status, Auditory Feedback, and Animacy in Coordination of Joint Music Performance , 2017, Front. Psychol..

[19]  S. Rush Free Jazz, Harmolodics, and Ornette Coleman , 2016 .

[20]  Elaine Chew,et al.  Tension ribbons: Quantifying and visualising tonal tension. , 2016 .

[21]  Uri Hasson,et al.  Mirroring and beyond: coupled dynamics as a generalized framework for modelling social interactions , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[22]  John Corbett,et al.  A Listener's Guide to Free Improvisation , 2016 .

[23]  P. N. Kugler,et al.  Information, Natural Law, and the Self-Assembly of Rhythmic Movement , 2015 .

[24]  Sergi Valverde,et al.  Punctuated equilibrium in the large-scale evolution of programming languages† , 2015, Journal of The Royal Society Interface.

[25]  Anthony Chemero,et al.  Improvisation and the self-organization of multiple musical bodies , 2015, Front. Psychol..

[26]  Thomas T. Hills,et al.  Exploration versus exploitation in space, mind, and society , 2015, Trends in Cognitive Sciences.

[27]  Holger Hennig,et al.  Synchronization in human musical rhythms and mutually interacting complex systems , 2014, Proceedings of the National Academy of Sciences.

[28]  Michael J. Richardson,et al.  Self-Organization and Semiosis in Jazz Improvisation , 2014, Int. J. Signs Semiot. Syst..

[29]  David Malvinni Grateful Dead and the Art of Rock Improvisation , 2013 .

[30]  Geraint A. Wiggins,et al.  Auditory Expectation: The Information Dynamics of Music Perception and Cognition , 2012, Top. Cogn. Sci..

[31]  Matthijs Baas,et al.  Working Memory Benefits Creative Insight, Musical Improvisation, and Original Ideation Through Maintained Task-Focused Attention , 2012, Personality & social psychology bulletin.

[32]  S. Garrod,et al.  Brain-to-brain coupling: a mechanism for creating and sharing a social world , 2012, Trends in Cognitive Sciences.

[33]  U. Alon,et al.  The mirror game as a paradigm for studying the dynamics of two people improvising motion together , 2011, Proceedings of the National Academy of Sciences.

[34]  Peter E. Keller,et al.  Practice Makes Too Perfect: Fluctuations in Loudness Indicate Spontaneity in Musical Improvisation , 2011 .

[35]  Nicolas B. Garnier,et al.  A Model for Collective Free Improvisation , 2011, MCM.

[36]  Arne Eigenfeldt,et al.  A Sonic Eco-System of Self-Organising Musical Agents , 2011, EvoApplications.

[37]  Peter E. Keller,et al.  The Perception of Musical Spontaneity in Improvised and Imitated Jazz Performances , 2011, Front. Psychology.

[38]  Bruno Nettl,et al.  Musical Improvisation: Art, Education, and Society , 2010 .

[39]  Aaron L. Berkowitz,et al.  The improvising mind: Cognition and creativity in the musical moment , 2010 .

[40]  C. Palmer,et al.  Synchronization of Timing and Motion Among Performing Musicians , 2009 .

[41]  Simon Garrod,et al.  Joint Action, Interactive Alignment, and Dialog , 2009, Top. Cogn. Sci..

[42]  David J. Hargreaves,et al.  An experimental study of the effects of improvisation on the development of children's creative thinking in music , 2009 .

[43]  Simon J. Greenhill,et al.  Languages Evolve in Punctuational Bursts , 2008, Science.

[44]  James Harley,et al.  Sync or Swarm: Improvising Music in a Complex Age , 2007 .

[45]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[46]  Elaine Chew,et al.  Regards on two regards by Messiaen: Post-tonal music segmentation using pitch context distances in the spiral array , 2005 .

[47]  M. Pickering,et al.  Toward a mechanistic psychology of dialogue , 2004, Behavioral and Brain Sciences.

[48]  Peter J. Bentley,et al.  Improvised music with swarms , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[49]  Philip N. Johnson-Laird,et al.  How Jazz Musicians Improvise , 2002 .

[50]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[51]  Jonathan Foote,et al.  Automatic audio segmentation using a measure of audio novelty , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[52]  R. Beer Dynamical approaches to cognitive science , 2000, Trends in Cognitive Sciences.

[53]  T. Gelder,et al.  The dynamical hypothesis in cognitive science , 1998, Behavioral and Brain Sciences.

[54]  S. Bikhchandani,et al.  Learning from the behavior of others : conformity, fads, and informational cascades , 1998 .

[55]  Randall D. Beer,et al.  The brain has a body: adaptive behavior emerges from interactions of nervous system, body and environment , 1997, Trends in Neurosciences.

[56]  David Hirshleifer,et al.  You have printed the following article : A Theory of Fads , Fashion , Custom , and Cultural Change as Informational Cascades , 2007 .

[57]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[58]  D. Norman,et al.  Strength models and serial position in short-term recognition memory ☆ , 1966 .

[59]  Michael J. Richardson,et al.  Creating Time: Social Collaboration in Music Improvisation , 2018, Top. Cogn. Sci..

[60]  A. Chemero,et al.  Musical creativity and the embodied mind: Exploring the possibilities of 4E cognition and dynamical systems theory , 2018 .

[61]  Michael J. Richardson,et al.  Ecological Psychology: Six Principles for an Embodied–Embedded Approach to Behavior , 2008 .

[62]  Arne Eigenfeldt,et al.  An Agent-based System for Robotic Musical Performance , 2008, NIME.

[63]  Peter Beyls,et al.  Interaction and Self-organisation in a Society of Musical Agents , 2007 .

[64]  Tim Blackwell,et al.  Swarming and Music , 2007 .

[65]  Dmitri Tymoczko The Cambridge History of Western Music Theory , 2003 .

[66]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[67]  W. Mathieu Harmonic Experience: Tonal Harmony from Its Natural Origins to Its Modern Expression , 1997 .

[68]  Randall D. Beer,et al.  A Dynamical Systems Perspective on Agent-Environment Interaction , 1995, Artif. Intell..

[69]  Gayathri Rajapur Kassebaum Improvisation in Alapana Performance: A Comparative View of Raga Shankarabharana , 1987, Yearbook for Traditional Music.

[70]  Carl Schachter,et al.  Harmony And Voice Leading , 1978 .

[71]  S. Gould,et al.  Punctuated equilibria: an alternative to phyletic gradualism , 1972 .

[72]  Habib Hassan Touma,et al.  The Maqam Phenomenon: An Improvisation Technique in the Music of the Middle East , 1971 .