Information-theoretic Modeling of Perceived Musical Complexity

What makes a piece of music appear complex to a listener? This research extends previous work by Eerola (2016), examining information content generated by a computational model of auditory expectation (IDyOM) based on statistical learning and probabilistic prediction as an empirical definition of perceived musical complexity. We systematically manipulated the melody, rhythm, and harmony of short polyphonic musical excerpts using the model to ensure that these manipulations systematically varied information content in the intended direction. Complexity ratings collected from 28 participants were found to positively correlate most strongly with melodic and harmonic information content, which corresponded to descriptive musical features such as the proportion of out-of-key notes and tonal ambiguity. When individual differences were considered, these explained more variance than the manipulated predictors. Musical background was not a significant predictor of complexity ratings. The results support information content, as implemented by IDyOM, as an information-theoretic measure of complexity as well as extending IDyOM9s range of applications to perceived complexity.

[1]  Elizabeth Hellmuth Margulis.  Toward A Better Understanding of Perceived Complexity in Music: A Commentary on Eerola (2016) , 2016 .

[2]  E. Schellenberg,et al.  Simplifying the Implication-Realization Model of Melodic Expectancy , 1997 .

[3]  Marcus T. Pearce,et al.  Information-Theoretic Properties of Auditory Sequences Dynamically Influence Expectation and Memory , 2018, Cogn. Sci..

[4]  M. Pearce,et al.  Tracking of pitch probabilities in congenital amusia , 2012, Neuropsychologia.

[5]  R. Zatorre,et al.  When the brain plays music: auditory–motor interactions in music perception and production , 2007, Nature Reviews Neuroscience.

[6]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[7]  Ian H. Witten,et al.  Multiple viewpoint systems for music prediction , 1995 .

[8]  D. Berlyne.  Studies in the New Experimental Aesthetics: Steps Toward an Objective Psychology of Aesthetic Appreciation, , 1974 .

[9]  W. Thompson,et al.  A Cross-Cultural Investigation of the Perception of Emotion in Music: Psychophysical and Cultural Cues , 1999 .

[10]  Peter M C Harrison,et al.  Uncertainty and Surprise Jointly Predict Musical Pleasure and Amygdala, Hippocampus, and Auditory Cortex Activity , 2019, Current Biology.

[11]  Sarah A. Sauvé,et al.  The effect of musical training on auditory grouping , 2014 .

[12]  Suzanne Bunton,et al.  Semantically Motivated Improvements for PPM Variants , 1997, Comput. J..

[13]  Geraint A. Wiggins,et al.  Linking melodic expectation to expressive performance timing and perceived musical tension. , 2016, Journal of experimental psychology. Human perception and performance.

[14]  Marcus T Pearce,et al.  A Set of 200 Musical Stimuli Varying in Balance, Contour, Symmetry, and Complexity: Behavioral and Computational Assessments , 2020, Behavior Research Methods.

[15]  Giorgio Vallortigara,et al.  Unsupervised statistical learning in newly hatched chicks , 2016, Current Biology.

[16]  Tuomas Eerola,et al.  Expectancy-Violation and Information-Theoretic Models of Melodic Complexity , 2016 .

[17]  Peter M C Harrison,et al.  Dissociating sensory and cognitive theories of harmony perception through computational modeling , 2018 .

[18]  Marcus T. Pearce,et al.  Effects of Pitch and Timing Expectancy on Musical Emotion , 2017, 1708.03687.

[19]  Carla L. Hudson Kam,et al.  Humans Rapidly Learn Grammatical Structure in a New Musical Scale. , 2010, Music perception.

[20]  M. Pearce,et al.  Predictive uncertainty in auditory sequence processing , 2014, Front. Psychol..

[21]  Geraint A. Wiggins,et al.  Probabilistic models of expectation violation predict psychophysiological emotional responses to live concert music , 2013, Cognitive, Affective, & Behavioral Neuroscience.

[22]  Ichiro Fujinaga,et al.  An Expert Ground Truth Set for Audio Chord Recognition and Music Analysis , 2011, ISMIR.

[23]  Adrian C. North,et al.  Subjective complexity, familiarity, and liking for popular music. , 1995 .

[24]  L. Blair.  A prediction. , 1995, Hospitals & health networks.

[25]  T. Eerola,et al.  Perceived complexity of western and African folk melodies by western and African listeners , 2006 .

[26]  M. Pearce,et al.  Electrophysiological correlates of melodic processing in congenital amusia , 2013, Neuropsychologia.

[27]  Andrew J. R. Simpson,et al.  Syncopation and the Score , 2013, PloS one.

[28]  Daniel Müllensiefen,et al.  The Musicality of Non-Musicians: An Index for Assessing Musical Sophistication in the General Population , 2014, PloS one.

[29]  E. Narmour.  The Analysis and Cognition of Melodic Complexity: The Implication-Realization Model , 1992 .

[30]  D. Barr,et al.  Random effects structure for confirmatory hypothesis testing: Keep it maximal. , 2013, Journal of memory and language.

[31]  Gerhard Widmer,et al.  A Complexity-based Approach to Melody Track Identification in MIDI Files ? , 2007 .

[32]  Marcus T. Pearce,et al.  The construction and evaluation of statistical models of melodic structure in music perception and composition , 2005 .

[33]  C. J. McGrath,et al.  Effect of exchange rate return on volatility spill-over across trading regions , 2012 .

[34]  Marcus T. Pearce,et al.  Compression-based Modelling of Musical Similarity Perception , 2017 .

[35]  M. Pearce.  Statistical learning and probabilistic prediction in music cognition: mechanisms of stylistic enculturation , 2018, Annals of the New York Academy of Sciences.

[36]  Dirk-Jan Povel,et al.  Complexity Measures of Musical Rhythms , 1998 .

[37]  Justyna Humięcka-Jakubowska,et al.  Sweet Anticipation : Music and , 2006 .

[38]  Maria A. G. Witek,et al.  Rhythmic complexity and predictive coding: a novel approach to modeling rhythm and meter perception in music , 2014, Front. Psychol..

[39]  Stephen McAdams,et al.  Simulating melodic and harmonic expectations for tonal cadences using probabilistic models , 2018 .

[40]  Geraint A. Wiggins,et al.  The Role of Expectation and Probabilistic Learning in Auditory Boundary Perception: A Model Comparison , 2010, Perception.

[41]  Ernest Mas-Herrero,et al.  Predictability and Uncertainty in the Pleasure of Music: A Reward for Learning? , 2019, The Journal of Neuroscience.

[42]  Mark A Schmuckler,et al.  Pitch and time, tonality and meter: how do musical dimensions combine? , 2009, Journal of experimental psychology. Human perception and performance.

[43]  Werner Lutzenberger,et al.  PERCEPTION OF MUSIC AND DIMENSIONAL COMPLEXITY OF BRAIN ACTIVITY , 1996 .

[44]  Edward W. Large,et al.  Tracking simple and complex sequences , 2002, Psychological research.

[45]  D. Bates,et al.  fitting linear mixed effects models using lme 4 arxiv , 2014 .

[46]  R. Jackendoff,et al.  A Generative Theory of Tonal Music , 1985 .

[47]  Michael J. Burke,et al.  Musical Preferences as a Function of Stimulus Complexity and Listeners' Sophistication , 1990 .

[48]  Eugene Narmour,et al.  The Analysis and Cognition of Basic Melodic Structures: The Implication-Realization Model , 1990 .

[49]  R. Zatorre,et al.  Moving on Time: Brain Network for Auditory-Motor Synchronization is Modulated by Rhythm Complexity and Musical Training , 2008, Journal of Cognitive Neuroscience.

[50]  Ran El-Yaniv,et al.  On Prediction Using Variable Order Markov Models , 2004, J. Artif. Intell. Res..

[51]  María Herrojo Ruiz,et al.  Unsupervised statistical learning underpins computational, behavioural, and neural manifestations of musical expectation , 2010, NeuroImage.