Effects of Pitch and Timing Expectancy on Musical Emotion

Pitch and timing information work hand in hand to create a coherent piece of music, but what happens when this information goes against the norm? Relationships between musical expectancy and emotional responses were investigated in a study conducted with 40 participants: 20 musicians and 20 nonmusicians. Participants took part in one of two behavioral paradigms measuring continuous expectancy or emotional responses (arousal and valence) while listening to folk melodies that exhibited either high or low pitch predictability and high- or low- onset predictability. The causal influence of pitch predictability was investigated in an additional condition in which pitch was artificially manipulated and a comparison was conducted between original and manipulated forms; the dynamic correlative influence of pitch and timing information and its perception on emotional change during listening was evaluated using cross-sectional time series analysis. The results indicate that pitch and onset predictability are consistent predictors of perceived expectancy and emotional response, with onset carrying more weight than pitch. In addition, musicians and nonmusicians do not differ in their responses possibly due to shared cultural background and knowledge. The results demonstrate in a controlled lab-based setting a precise, quantitative relationship between the predictability of musical structure, expectation, and emotional response.

[1]  M. R. Jones,et al.  Dynamic attending and responses to time. , 1989, Psychological review.

[2]  Frank A. Russo,et al.  Seeing music performance: Visual influences on perception and experience , 2005 .

[3]  E. Margulis Sweet Anticipation: Music and the Psychology of Expectation. By David Huron. Cambridge, Massachusetts: The MIT Press, 2006, xii + 462 pages , 2012 .

[4]  D. Västfjäll,et al.  Emotional responses to music: the need to consider underlying mechanisms. , 2008, The Behavioral and brain sciences.

[5]  E. Schellenberg,et al.  Effects of Musical Tempo and Mode on Arousal, Mood, and Spatial Abilities , 2002 .

[6]  C. Krumhansl,et al.  Melodic Expectation in Finnish Spiritual Folk Hymns: Convergence of Statistical, Behavioral, and Computational Approaches , 1999 .

[7]  F. Dick,et al.  Generality and specificity in the effects of musical expertise on perception and cognition , 2015, Cognition.

[8]  E. Narmour The Top-down and Bottom-up Systems of Musical Implication: Building on Meyer's Theory of Emotional Syntax , 1991 .

[9]  Geraint A. Wiggins,et al.  Linking melodic expectation to expressive performance timing and perceived musical tension. , 2016, Journal of experimental psychology. Human perception and performance.

[10]  María Herrojo Ruiz,et al.  Unsupervised statistical learning underpins computational, behavioural, and neural manifestations of musical expectation , 2010, NeuroImage.

[11]  J. Kleijnen,et al.  Context Effects , 2003 .

[12]  P. Juslin Emotional Responses to Music , 2008 .

[13]  Matthias Abend Cognitive Foundations Of Musical Pitch , 2016 .

[14]  Daniel Västfjäll,et al.  How does music evoke emotions? Exploring the underlying mechanisms. , 2010 .

[15]  W. Dowling Emotion and Meaning in Music , 2008 .

[16]  G. Schlaug,et al.  Amygdala activity can be modulated by unexpected chord functions during music listening , 2008, Neuroreport.

[17]  Stefan Koelsch,et al.  The Role of Harmonic Expectancy Violations in Musical Emotions: Evidence from Subjective, Physiological, and Neural Responses , 2006, Journal of Cognitive Neuroscience.

[18]  A. Damasio,et al.  Music, feelings, and the human brain. , 2014 .

[19]  N. Mackintosh A Theory of Attention: Variations in the Associability of Stimuli with Reinforcement , 1975 .

[20]  Robin C. Laney,et al.  Modeling pattern importance in Chopin's mazurkas , 2011 .

[21]  D. Barr,et al.  Random effects structure for confirmatory hypothesis testing: Keep it maximal. , 2013, Journal of memory and language.

[22]  F. Lerdahl Atonal prolongational structure , 1989 .

[23]  E. Hannon,et al.  Familiarity overrides complexity in rhythm perception: a cross-cultural comparison of American and Turkish listeners. , 2012, Journal of experimental psychology. Human perception and performance.

[24]  D. Ellsworth,et al.  Recreational music-making alters gene expression pathways in patients with coronary heart disease , 2013, Medical science monitor : international medical journal of experimental and clinical research.

[25]  R. Kakigi,et al.  Musical Training Enhances Automatic Encoding of Melodic Contour and Interval Structure , 2004, Journal of Cognitive Neuroscience.

[26]  Elvira Brattico,et al.  Context Effects on Pitch Perception in Musicians and Nonmusicians: Evidence from Event-Related-Potential Recordings , 2001 .

[27]  J. Sloboda,et al.  Music and emotion: Theory and research , 2001 .

[28]  C Palmer,et al.  Pitch and temporal contributions to musical phrase perception: Effects of harmony, performance timing, and familiarity , 1987, Perception & psychophysics.

[29]  James C. Carlsen Some factors which influence melodic expectancy , 1981 .

[30]  Elizabeth K. Johnson,et al.  Statistical learning of tone sequences by human infants and adults , 1999, Cognition.

[31]  E. Schellenberg,et al.  Expectancy in melody: tests of the implication-realization model , 1996, Cognition.

[32]  J. Russell Core affect and the psychological construction of emotion. , 2003, Psychological review.

[33]  Peter E. Keller,et al.  The importance of integration and top-down salience when listening to complex multi-part musical stimuli , 2013, NeuroImage.

[34]  Mark A Schmuckler,et al.  Pitch and time, tonality and meter: how do musical dimensions combine? , 2009, Journal of experimental psychology. Human perception and performance.

[35]  C. Pelletier The effect of music on decreasing arousal due to stress: a meta-analysis. , 2004, Journal of music therapy.

[36]  C. Krumhansl,et al.  Cross-modal interactions in the perception of musical performance , 2006, Cognition.

[37]  Geraint A. Wiggins,et al.  Probabilistic models of expectation violation predict psychophysiological emotional responses to live concert music , 2013, Cognitive, Affective, & Behavioral Neuroscience.

[38]  S. Trehub,et al.  A comparison of infants' and adults' sensitivity to western musical structure. , 1992, Journal of experimental psychology. Human perception and performance.

[39]  D. Kincaid The Musical Experience , 1969 .

[40]  C. Krumhansl,et al.  Mental representations for musical meter. , 1990, Journal of experimental psychology. Human perception and performance.

[41]  M. Jones,et al.  Temporal Aspects of Stimulus-Driven Attending in Dynamic Arrays , 2002, Psychological science.

[42]  E. Donchin,et al.  Do Re Mi Fa Sol La Ti——Constraints, Congruity, and Musical Training: An Event-Related Brain Potentials Study of Musical Expectancies , 2002 .

[43]  William T. M. Dunsmuir,et al.  Time series analysis of real-time music perception: approaches to the assessment of individual and expertise differences in perception of expressed affect , 2014 .

[44]  Schellenberg Eg Expectancy in melody: tests of the implication-realization model , 1996 .

[45]  Nicola Dibben The Perception of Structural Stability in Atonal Music: The Influence of Salience, Stability, Horizontal Motion, Pitch Commonality, and Dissonance , 1999 .

[46]  J. Sloboda,et al.  Handbook of Music and Emotion: Theory, Research, Applications , 2011 .

[47]  Ben Duane Auditory Streaming Cues in Eighteenth- and Early Nineteenth-Century String Quartets: A Corpus-Based Study , 2013 .

[48]  R. Jackendoff,et al.  A Generative Theory of Tonal Music , 1985 .

[49]  M. Mayoral,et al.  Effects of music therapy on depression compared with psychotherapy , 2010 .

[50]  Max Schoen,et al.  The Effects of Music , 1927 .

[51]  S. Khalfa,et al.  Event-related skin conductance responses to musical emotions in humans , 2002, Neuroscience Letters.

[52]  Marilyn Gail Boltz,et al.  The Processing of Melodic and Temporal Information: Independent or Unified Dimensions? , 1999 .

[53]  N. Mackintosh,et al.  Two theories of attention: a review and a possible integration , 2010 .

[54]  C Palmer,et al.  Independent temporal and pitch structures in determination of musical phrases. , 1987, Journal of experimental psychology. Human perception and performance.

[55]  Laura K. Cirelli,et al.  Measuring Neural Entrainment to Beat and Meter in Infants: Effects of Music Background , 2016, Front. Neurosci..

[56]  Guillem R. Esber,et al.  Reconciling the influence of predictiveness and uncertainty on stimulus salience: a model of attention in associative learning , 2011, Proceedings of the Royal Society B: Biological Sciences.

[57]  M. Pearce,et al.  Predictive uncertainty in auditory sequence processing , 2014, Front. Psychol..

[58]  I. Peretz,et al.  Effects of Relaxing Music on Salivary Cortisol Level after Psychological Stress , 2003, Annals of the New York Academy of Sciences.

[59]  S. Gosling,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES The Do Re Mi’s of Everyday Life: The Structure and Personality Correlates of Music Preferences , 2003 .

[60]  Freya Bailes,et al.  Shared and distinct mechanisms of individual and expertise-group perception of expressed arousal in four works , 2014 .

[61]  Anna-Katharina R. Bauer,et al.  The auditory dynamic attending theory revisited: A closer look at the pitch comparison task , 2015, Brain Research.

[62]  J. Pearce,et al.  A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. , 1980, Psychological review.

[63]  P. Juslin Emotional responses to music: The need to consider underlying mechanisms , 2008, Behavioral and Brain Sciences.

[64]  C. Stevens,et al.  Sweet Anticipation: Music and the Psychology of Expectation, by David Huron . Cambridge, Massachusetts: MIT Press, 2006 , 2007 .

[65]  Robert F. Potter,et al.  Effects of Music on Physiological Arousal: Explorations into Tempo and Genre , 2007 .

[66]  Geraint A. Wiggins,et al.  EXPECTATION IN MELODY: THE INFLUENCE OF CONTEXT AND LEARNING , 2006 .

[67]  S. Trehub,et al.  Tuning in to musical rhythms: infants learn more readily than adults. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[68]  S. Trehub,et al.  Metrical Categories in Infancy and Adulthood , 2005, Psychological science.

[69]  M R Jones,et al.  Controlled attending as a function of melodic and temporal context , 1982, Perception & psychophysics.