A Robust Parser-Interpreter for Jazz Chord Sequences

Abstract Hierarchical structure similar to that associated with prosody and syntax in language can be identified in the rhythmic and harmonic progressions that underlie Western tonal music. Analysing such musical structure resembles natural language parsing: it requires the derivation of an underlying interpretation from an unstructured sequence of highly ambiguous elements—in the case of music, the notes. The task here is not merely to decide whether the sequence is grammatical, but rather to decide which among a large number of analyses it has. An analysis of this sort is a part of the cognitive processing performed by listeners familiar with a musical idiom, whether musically trained or not. Our focus is on the analysis of the structure of expectations and resolutions created by harmonic progressions. Building on previous work, we define a theory of tonal harmonic progression, which plays a role analogous to semantics in language. Our parser uses a formal grammar of jazz chord sequences, of a kind widely used for natural language processing (NLP), to map music, in the form of chord sequences used by performers, onto a representation of the structured relationships between chords. It uses statistical modelling techniques used for wide-coverage parsing in NLP to make practical parsing feasible in the face of considerable ambiguity in the grammar. Using machine learning over a small corpus of jazz chord sequences annotated with harmonic analyses, we show that grammar-based musical interpretation using simple statistical parsing models is more accurate than a baseline HMM. The experiment demonstrates that statistical techniques adapted from NLP can be profitably applied to the analysis of harmonic structure.

[1]  J. Hawkins,et al.  Language and Music as Cognitive Systems , 2011 .

[2]  James R. Curran,et al.  Wide-Coverage Efficient Statistical Parsing with CCG and Log-Linear Models , 2007, Computational Linguistics.

[3]  L. Bernstein,et al.  The Unanswered Question: Six Talks at Harvard , 1977 .

[4]  Dmitri Tymoczko,et al.  The Geometry of Musical Chords , 2006, Science.

[5]  B. Lindblom,et al.  Towards a generative theory of melody , 2007 .

[6]  R. Carlson,et al.  Music, language, speech and brain : proceedings of an international symposium at the Wenner-Gren Center, Stockholm, 5-8 September 1990 , 1991 .

[7]  P. van Kranenburg,et al.  International Society for Music Information Retrieval , 2014 .

[8]  Rens Bod,et al.  Memory-Based Models of Melodic Analysis: Challenging the Gestalt Principles , 2002 .

[9]  Martin Kay,et al.  Syntactic Process , 1979, ACL.

[10]  Remco C. Veltkamp,et al.  Modeling Harmonic Similarity Using a Generative Grammar of Tonal Harmony , 2009, ISMIR.

[11]  Barbara Tillmann,et al.  The Relative Importance of Local and Global Structures in Music Perception , 2004 .

[12]  H. C. Longuet-Higgins,et al.  Perception of melodies , 1976, Nature.

[13]  François Pachet,et al.  Computer Analysis of Jazz Chord Sequence: Is Solar a Blues? , 2000, Readings in Music and Artificial Intelligence.

[14]  W. L. Windsor Music and Probability , 2009 .

[15]  E. Chew Towards a mathematical model of tonality , 2000 .

[16]  Mark Steedman,et al.  On Interpreting Bach , 1987 .

[17]  Jonas Schreiber The Sign In Music And Literature , 2016 .

[18]  The Bohlen-Pierce scale , 1989 .

[19]  Martin Rohrmeier,et al.  Towards a generative syntax of tonal harmony , 2011 .

[20]  Srinivas Bangalore,et al.  The Institute For Research In Cognitive Science Disambiguation of Super Parts of Speech ( or Supertags ) : Almost Parsing by Aravind , 1995 .

[21]  Satoshi Tojo,et al.  Implementing “A Generative Theory of Tonal Music” , 2006 .

[22]  Michael J. Fischer,et al.  The String-to-String Correction Problem , 1974, JACM.

[23]  E. Margulis A Model of Melodic Expectation , 2005 .

[24]  Geraint A. Wiggins,et al.  EXPECTATION IN MELODY: THE INFLUENCE OF CONTEXT AND LEARNING , 2006 .

[25]  W. Dowling Emotion and Meaning in Music , 2008 .

[26]  SEDLEY TAYLOR,et al.  Die Lehre von den Tonempfindimgen , 1871, Nature.

[27]  Ian Cross,et al.  Introduction: Language and music as cognitive systems , 2011 .

[28]  Robert O. Gjerdingen,et al.  The Cognition of Basic Musical Structures , 2004 .

[29]  L. Hall The language of music , 2006 .

[30]  Jean Philippe Rameau,et al.  Traité de l'harmonie , 1992 .

[31]  S. Jeong Harmony , 2012, SIGGRAPH '12.

[32]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[33]  Alan Marsden,et al.  Schenkerian Analysis by Computer: A Proof of Concept , 2010 .

[34]  Stephen Schwanauer,et al.  Pattern in Music , 1993 .

[35]  P. Johnson-Laird Jazz Improvization: A Theory at the Computational Level , 1991 .

[36]  鐘期 坂本,et al.  Tonal Pitch Space を用いた楽曲の和声解析 , 2009 .

[37]  Mark Steedman,et al.  Generative Models for Statistical Parsing with Combinatory Categorial Grammar , 2002, ACL.

[38]  Ian Cross,et al.  Tacit tonality - Implicit learning of context-free harmonic structure , 2009 .

[39]  Morris Halle,et al.  Grouping in the stressing of words, in metrical verse, and in music , 2011 .

[40]  S. Koelsch,et al.  The Influence of Different Structural Features on Felt Musical Tension in Two Piano Pieces by Mozart and Mendelssohn , 2013 .

[41]  Jonah Katz,et al.  The Identity Thesis for Language and Music , 2011 .

[42]  Alain Daniélou The Ragas of Northern Indian music , 1968 .

[43]  Allan KElLER,et al.  BERNSTEIN'S THE UNANSWERED QUESTION AND THE PROBLEM OF MUSICAL COMPETENCE , 1978 .

[44]  William Drabkin,et al.  THE CONCEPT OF MUSICAL GRAMMAR , 1983 .

[45]  Rens Bod,et al.  Convexity and the well-formedness of musical objects , 2005 .

[46]  J. Rothgeb Beyond Schenkerism , 1978 .

[47]  Matthias Abend Cognitive Foundations Of Musical Pitch , 2016 .

[48]  Andrew Choi,et al.  Jazz Harmonic Analysis as Optimal Tonality Segmentation , 2011, Computer Music Journal.

[49]  Adam Lopez,et al.  Training a Log-Linear Parser with Loss Functions via Softmax-Margin , 2011, EMNLP.

[50]  Terry Winograd,et al.  Linguistics and the computer analysis of tonal harmony , 1968 .

[51]  Stephen W. Smoliar Music Programs: An Approach to Music Theory through Computational Linguistics , 1976 .

[52]  Mark Steedman,et al.  A Generative Grammar for Jazz Chord Sequences , 1984 .

[53]  R. Carlson,et al.  Music, Language, Speech and Brain , 1991 .

[54]  Mark Steedman The Blues and the Abstract Truth: Music and Mental Models , 2009 .

[55]  Yuan Chang Leong,et al.  On Musical Dissonance , 2012 .

[56]  R. Jackendoff,et al.  A Generative Theory of Tonal Music , 1985 .

[57]  Grosvenor W. Cooper,et al.  The Rhythmic Structure of Music , 1971 .

[58]  Dmitri Tymoczko A Geometry of Music: Harmony and Counterpoint in the Extended Common Practice , 2011 .

[59]  P. Kirby Science and music , 1954 .