An Energy-based Generative Sequence Model for Testing Sensory Theories of Western Harmony

The relationship between sensory consonance and Western harmony is an important topic in music theory and psychology. We introduce new methods for analysing this relationship, and apply them to large corpora representing three prominent genres of Western music: classical, popular, and jazz music. These methods centre on a generative sequence model with an exponential-family energy-based form that predicts chord sequences from continuous features. We use this model to investigate one aspect of instantaneous consonance (harmonicity) and two aspects of sequential consonance (spectral distance and voice-leading distance). Applied to our three musical genres, the results generally support the relationship between sensory consonance and harmony, but lead us to question the high importance attributed to spectral distance in the psychological literature. We anticipate that our methods will provide a useful platform for future work linking music psychology to music theory.

[1]  Yoshua Bengio,et al.  Modeling Temporal Dependencies in High-Dimensional Sequences: Application to Polyphonic Music Generation and Transcription , 2012, ICML.

[2]  David Huron,et al.  Tonal Consonance versus Tonal Fusion in Polyphonic Sonorities , 1991 .

[3]  Naftali Tishby,et al.  An Information Theoretic Approach to Chord Categorization and Functional Harmony , 2015 .

[4]  D. Purves,et al.  A biological rationale for musical consonance , 2015, Proceedings of the National Academy of Sciences.

[5]  D. Shanahan,et al.  Diachronic Changes in Jazz Harmony: A Cognitive Perspective , 2013 .

[6]  Erwin R. Jacobi,et al.  Treatise on Harmony , 1971 .

[7]  Hans Strasburger,et al.  Applying Psychoacoustics in Composition: "Harmonic" Progressions of "Nonharmonic" Sonorities , 1994 .

[8]  M. Besson,et al.  Different Brain Mechanisms Mediate Sensitivity to Sensory Consonance and Harmonic Context: Evidence from Auditory Event-Related Brain Potentials , 2001, Journal of Cognitive Neuroscience.

[9]  Jean-François Paiement,et al.  A Probabilistic Model for Chord Progressions , 2005, ISMIR.

[10]  Josh H. McDermott,et al.  Individual Differences Reveal the Basis of Consonance , 2010, Current Biology.

[11]  M. Leman.  An auditory model of the role of short-term memory in probe-tone ratings. , 2000 .

[12]  Robin C. Laney,et al.  A Spectral Pitch Class Model of the Probe Tone Data and Scalic Tonality , 2015 .

[13]  A. Milne,et al.  Empirically testing Tonnetz, voice-leading, and spectral models of perceived triadic distance , 2016 .

[14]  Gaëtan Hadjeres,et al.  Style Imitation and Chord Invention in Polyphonic Music with Exponential Families , 2016, ArXiv.

[15]  Laurel J. Trainor,et al.  Preference for Sensory Consonance in 2- and 4-Month-Old Infants , 2002 .

[16]  Geraint A. Wiggins,et al.  The Prediction of Merged Attributes with Multiple Viewpoint Systems , 2016 .

[17]  Robin C. Laney,et al.  Modelling the similarity of pitch collections with expectation tensors , 2011 .

[18]  Costas S. Iliopoulos,et al.  Markov Random Fields and Maximum Entropy Modeling for Music Information Retrieval , 2005, ISMIR.

[19]  John Burgoyne.  Stochastic processes and database-driven musicology , 2012 .

[20]  Justin London,et al.  Building a Representative Corpus of Classical Music , 2013 .

[21]  Barbara Tillmann,et al.  Empirical evidence for musical syntax processing? Computer simulations reveal the contribution of auditory short-term memory , 2014, Front. Syst. Neurosci..

[22]  R. Parncutt.  Harmony: A Psychoacoustical Approach , 1989 .

[23]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[24]  Ya-Xiang Yuan,et al.  Optimization Theory and Methods: Nonlinear Programming , 2010 .

[25]  C. Chuan.  Tone and Voice: A Derivation of the Rules of Voice-Leading from Perceptual Principles , 2001 .

[26]  Václav Vencovský,et al.  Roughness Prediction Based on a Model of Cochlear Hydrodynamics , 2016 .

[27]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[28]  Ernst Mach,et al.  Sensations of tone. , 1897 .

[29]  F. A. Gore Ouseley,et al.  A Treatise on Harmony , 2008 .

[30]  Dmitri Tymoczko.  Geometry of Music , 2016 .

[31]  P. Janata,et al.  A combined model of sensory and cognitive representations underlying tonal expectations in music: from audio signals to behavior. , 2014, Psychological review.

[32]  R. Parncutt,et al.  Consonance and dissonance in music theory and psychology : Disentangling dissonant dichotomies , 2012 .

[33]  Thore Graepel,et al.  Comparing Feature-Based Models of Harmony , 2012 .

[34]  E. Schellenberg,et al.  Sensory consonance and the perceptual similarity of complex-tone harmonic intervals: tests of adult and infant listeners. , 1996, The Journal of the Acoustical Society of America.

[35]  Dmitri Tymoczko,et al.  The Geometry of Musical Chords , 2006, Science.

[36]  Craig Stuart Sapp.  Online Database of Scores in the Humdrum File Format , 2005, ISMIR.

[37]  S. Baron,et al.  Origins of music , 2011 .

[38]  William P. Birmingham,et al.  Algorithms for Chordal Analysis , 2002, Computer Music Journal.

[39]  F. Lerdahl,et al.  Perception of musical tension in short chord sequences: The influence of harmonic function, sensory dissonance, horizontal motion, and musical training , 1996, Perception & psychophysics.

[40]  A. Milne.  A Computational Model of the Cognition of Tonality , 2013 .