Predictability and Uncertainty in the Pleasure of Music: A Reward for Learning?

Music ranks among the greatest human pleasures. It consistently engages the reward system, and converging evidence implies it exploits predictions to do so. Both prediction confirmations and errors are essential for understanding one's environment, and music offers many of each as it manipulates interacting patterns across multiple timescales. Learning models suggest that a balance of these outcomes (i.e., intermediate complexity) optimizes the reduction of uncertainty to rewarding and pleasurable effect. Yet evidence of a similar pattern in music is mixed, hampered by arbitrary measures of complexity. In the present studies, we applied a well-validated information-theoretic model of auditory expectation to systematically measure two key aspects of musical complexity: predictability (operationalized as information content [IC]), and uncertainty (entropy). In Study 1, we evaluated how these properties affect musical preferences in 43 male and female participants; in Study 2, we replicated Study 1 in an independent sample of 27 people and assessed the contribution of veridical predictability by presenting the same stimuli seven times. Both studies revealed significant quadratic effects of IC and entropy on liking that outperformed linear effects, indicating reliable preferences for music of intermediate complexity. An interaction between IC and entropy further suggested preferences for more predictability during more uncertain contexts, which would facilitate uncertainty reduction. Repeating stimuli decreased liking ratings but did not disrupt the preference for intermediate complexity. Together, these findings support long-hypothesized optimal zones of predictability and uncertainty in musical pleasure with formal modeling, relating the pleasure of music listening to the intrinsic reward of learning. SIGNIFICANCE STATEMENT Abstract pleasures, such as music, claim much of our time, energy, and money despite lacking any clear adaptive benefits like food or shelter. Yet as music manipulates patterns of melody, rhythm, and more, it proficiently exploits our expectations. Given the importance of anticipating and adapting to our ever-changing environments, making and evaluating uncertain predictions can have strong emotional effects. Accordingly, we present evidence that listeners consistently prefer music of intermediate predictive complexity, and that preferences shift toward expected musical outcomes in more uncertain contexts. These results are consistent with theories that emphasize the intrinsic reward of learning, both by updating inaccurate predictions and validating accurate ones, which is optimal in environments that present manageable predictive challenges (i.e., reducible uncertainty).

[1]  R. Shepard,et al.  Tonal Schemata in the Perception of Music in Bali and in the West , 1984 .

[2]  Eckart Altenmüller,et al.  How Does Music Arouse “Chills”? , 2005, Annals of the New York Academy of Sciences.

[3]  Rinus G. Verdonschot,et al.  Neural mechanisms underlying the induction and relief of perceptual curiosity , 2012, Front. Behav. Neurosci..

[4]  M. Kringelbach,et al.  The Pleasure of Making Sense of Music , 2010 .

[5]  C. Krumhansl Tonal Hierarchies and Rare Intervals in Music Cognition , 1990 .

[6]  Stefan Bode,et al.  The neural encoding of information prediction errors during non-instrumental information seeking , 2017, Scientific Reports.

[7]  A. Rodríguez-Fornells,et al.  Intrinsically regulated learning is modulated by synaptic dopamine signaling , 2018, eLife.

[8]  A. Zuur,et al.  Mixed Effects Modelling for Nested Data , 2009 .

[9]  Geraint A. Wiggins,et al.  The Role of Expectation and Probabilistic Learning in Auditory Boundary Perception: A Model Comparison , 2010, Perception.

[10]  M. Lopes,et al.  Intrinsically motivated oculomotor exploration guided by uncertainty reduction and conditioned reinforcement in non-human primates , 2016, Scientific Reports.

[11]  Pierre-Yves Oudeyer,et al.  Eye movements reveal epistemic curiosity in human observers , 2015, Vision Research.

[12]  M. Csíkszentmihályi,et al.  The Importance of Challenge for the Enjoyment of Intrinsically Motivated, Goal-Directed Activities , 2012, Personality & social psychology bulletin.

[13]  C. Darwin The Descent of Man and Selection in Relation to Sex: INDEX , 1871 .

[14]  Pierre-Yves Oudeyer,et al.  Information-seeking, curiosity, and attention: computational and neural mechanisms , 2013, Trends in Cognitive Sciences.

[15]  Samuel M. McClure,et al.  The Wick in the Candle of Learning , 2009, Psychological science.

[16]  D. Berlyne,et al.  Aesthetics and Psychobiology , 1975 .

[17]  Marcus T. Pearce,et al.  Effects of Pitch and Timing Expectancy on Musical Emotion , 2017, 1708.03687.

[18]  G. Schlaug,et al.  Amygdala activity can be modulated by unexpected chord functions during music listening , 2008, Neuroreport.

[19]  Stefan Koelsch,et al.  The Role of Harmonic Expectancy Violations in Musical Emotions: Evidence from Subjective, Physiological, and Neural Responses , 2006, Journal of Cognitive Neuroscience.

[20]  R. Kopiez,et al.  Listening To Music As A Re-Creative Process: Physiological, Psychological, And Psychoacoustical Correlates Of Chills And Strong Emotions , 2007 .

[21]  Marcus T. Pearce,et al.  Melodic pitch expectation interacts with neural responses to syntactic but not semantic violations , 2013, Cortex.

[22]  R. Zajonc Attitudinal effects of mere exposure. , 1968 .

[23]  Geraint A. Wiggins,et al.  EXPECTATION IN MELODY: THE INFLUENCE OF CONTEXT AND LEARNING , 2006 .

[24]  C. Barbaranelli,et al.  The "big five questionnaire": A new questionnaire to assess the five factor model , 1993 .

[25]  L. Cuddy,et al.  Responsiveness of Western adults to pitch-distributional information in melodic sequences , 1995, Psychological research.

[26]  P. Diggle Analysis of Longitudinal Data , 1995 .

[27]  M. Pearce,et al.  Electrophysiological correlates of melodic processing in congenital amusia , 2013, Neuropsychologia.

[28]  N. Chater,et al.  Simplicity: a unifying principle in cognitive science? , 2003, Trends in Cognitive Sciences.

[29]  M. Pearce Effects of expertise on the cognitive and neural processes involved in musical appreciation , 2015 .

[30]  ダーウィン チャールス,et al.  The descent of man and selection in relation to sex , 1907 .

[31]  Wouter De Baene,et al.  Cognitive vs. affective listening modes and judgments of music – An ERP study , 2010, Biological Psychology.

[32]  Geraint A. Wiggins,et al.  Probabilistic models of expectation violation predict psychophysiological emotional responses to live concert music , 2013, Cognitive, Affective, & Behavioral Neuroscience.

[33]  Matthew P. Spackman,et al.  The Effects of Repeated Exposure on Liking and Judgments of Musical Unity of Intact and Patchwork Compositions , 2006 .

[34]  H. Heinze,et al.  The Role of Reward in Word Learning and Its Implications for Language Acquisition , 2014, Current Biology.

[35]  R. Zatorre,et al.  Individual Differences in Music Reward Experiences , 2013 .

[36]  R. Zatorre,et al.  Musical reward prediction errors engage the nucleus accumbens and motivate learning , 2019, Proceedings of the National Academy of Sciences.

[37]  M. Pearce Statistical learning and probabilistic prediction in music cognition: mechanisms of stylistic enculturation , 2018, Annals of the New York Academy of Sciences.

[38]  Ethan S. Bromberg-Martin,et al.  Dopamine in Motivational Control: Rewarding, Aversive, and Alerting , 2010, Neuron.

[39]  E. Glenn Schellenberg,et al.  Interactive effects of personality and frequency of exposure on liking for music , 2011 .

[40]  M. Pearce,et al.  Predictive uncertainty in auditory sequence processing , 2014, Front. Psychol..

[41]  Elvira Brattico,et al.  Subjective Appraisal of Music , 2009, Annals of the New York Academy of Sciences.

[42]  W. Dowling Scale and contour: Two components of a theory of memory for melodies. , 1978 .

[43]  Pierre-Yves Oudeyer,et al.  Intrinsic motivation, curiosity, and learning: Theory and applications in educational technologies. , 2016, Progress in brain research.

[44]  M. Frank,et al.  Pleasurable music affects reinforcement learning according to the listener , 2013, Front. Psychol..

[45]  W. Wundt,et al.  Principles of physiological psychology , 2015 .

[46]  Carla L. Hudson Kam,et al.  Humans Rapidly Learn Grammatical Structure in a New Musical Scale. , 2010, Music perception.

[47]  W. Dowling Emotion and Meaning in Music , 2008 .

[48]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[49]  R. Zatorre,et al.  Anatomically distinct dopamine release during anticipation and experience of peak emotion to music , 2011, Nature Neuroscience.

[50]  Emery Schubert,et al.  Back to the inverted-U for music preference: A review of the literature , 2017 .

[51]  Helen Creighton,et al.  Songs and Ballads from Nova Scotia , 1964 .

[52]  Karl J. Friston,et al.  Behavioral / Systems / Cognitive Striatal Prediction Error Modulates Cortical Coupling , 2010 .

[53]  J. Sloboda Music Structure and Emotional Response: Some Empirical Findings , 1991 .

[54]  Mihaly Csikszentmihalyi,et al.  Attentional involvement and intrinsic motivation , 2012 .

[55]  D. Berlyne Studies in the New Experimental Aesthetics: Steps Toward an Objective Psychology of Aesthetic Appreciation, , 1974 .

[56]  Marcus T. Pearce,et al.  Compression-based Modelling of Musical Similarity Perception , 2017 .

[57]  C. Krumhansl,et al.  Tonal hierarchies in the music of north India. , 1984, Journal of experimental psychology. General.

[58]  R. Zatorre,et al.  Interactions Between the Nucleus Accumbens and Auditory Cortices Predict Music Reward Value , 2013, Science.

[59]  Marcus T. Pearce,et al.  The construction and evaluation of statistical models of melodic structure in music perception and composition , 2005 .

[60]  Eric Clarke,et al.  Ways of Listening: An Ecological Approach to the Perception of Musical Meaning , 2005 .

[61]  Talma Hendler,et al.  Surprise-related activation in the nucleus accumbens interacts with music-induced pleasantness , 2019, Social cognitive and affective neuroscience.

[62]  Daniel Müllensiefen,et al.  The Experience of Music in Congenital Amusia , 2012 .

[63]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[64]  N. Anderson,et al.  Combining visual and verbal information in an impression-formation task. , 1968, Journal of personality and social psychology.

[65]  Ethan S. Bromberg-Martin,et al.  Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards , 2009, Neuron.

[66]  M. Grube,et al.  Weighting of neural prediction error by rhythmic complexity: A predictive coding account using mismatch negativity , 2019, The European journal of neuroscience.

[67]  Karl J. Friston,et al.  Predictive Processes and the Peculiar Case of Music , 2019, Trends in Cognitive Sciences.

[68]  C. Stevens,et al.  Sweet Anticipation: Music and the Psychology of Expectation, by David Huron . Cambridge, Massachusetts: MIT Press, 2006 , 2007 .

[69]  Richard N Aslin,et al.  The Goldilocks effect in infant auditory attention. , 2014, Child development.

[70]  Daniel Müllensiefen,et al.  The Musicality of Non-Musicians: An Index for Assessing Musical Sophistication in the General Population , 2014, PloS one.

[71]  M. Kringelbach,et al.  Ever-changing cycles of musical pleasure: The role of dopamine and anticipation. , 2012 .

[72]  R. MacDonald,et al.  How do People Communicate using Music , 2005 .