The Perception of Musical Spontaneity in Improvised and Imitated Jazz Performances

The ability to evaluate spontaneity in human behavior is called upon in the esthetic appreciation of dramatic arts and music. The current study addresses the behavioral and brain mechanisms that mediate the perception of spontaneity in music performance. In a functional magnetic resonance imaging experiment, 22 jazz musicians listened to piano melodies and judged whether they were improvised or imitated. Judgment accuracy (mean 55%; range 44–65%), which was low but above chance, was positively correlated with musical experience and empathy. Analysis of listeners’ hemodynamic responses revealed that amygdala activation was stronger for improvisations than imitations. This activation correlated with the variability of performance timing and intensity (loudness) in the melodies, suggesting that the amygdala is involved in the detection of behavioral uncertainty. An analysis based on the subjective classification of melodies according to listeners’ judgments revealed that a network including the pre-supplementary motor area, frontal operculum, and anterior insula was most strongly activated for melodies judged to be improvised. This may reflect the increased engagement of an action simulation network when melodic predictions are rendered challenging due to perceived instability in the performer's actions. Taken together, our results suggest that, while certain brain regions in skilled individuals may be generally sensitive to objective cues to spontaneity in human behavior, the ability to evaluate spontaneity accurately depends upon whether an individual's action-related experience and perspective taking skills enable faithful internal simulation of the given behavior.

[1]  A. Braun,et al.  Neural Substrates of Spontaneous Musical Performance: An fMRI Study of Jazz Improvisation , 2008, PloS one.

[2]  Peter E. Keller,et al.  Joint action in music performance , 2008 .

[3]  M. Tervaniemi,et al.  Sound processing in amateur musicians and nonmusicians: event-related potential and behavioral indices , 2006, Neuroreport.

[4]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[5]  J. Rauschecker,et al.  Brain Activation during Anticipation of Sound Sequences , 2009, The Journal of Neuroscience.

[6]  Niels Birbaumer,et al.  Overt and imagined singing of an Italian aria , 2007, NeuroImage.

[7]  Michael Davis,et al.  The amygdala: vigilance and emotion , 2001, Molecular Psychiatry.

[8]  R. Zatorre,et al.  Listening to musical rhythms recruits motor regions of the brain. , 2008, Cerebral cortex.

[9]  Issidoros C. Sarinopoulos,et al.  Uncertainty during anticipation modulates neural responses to aversion in human insula and amygdala. , 2010, Cerebral cortex.

[10]  Bruno Nettl,et al.  In the course of performance : studies in the world of musical improvisation , 1999 .

[11]  K. Amunts,et al.  Cytoarchitectonic mapping of the human amygdala, hippocampal region and entorhinal cortex: intersubject variability and probability maps , 2005, Anatomy and Embryology.

[12]  P. Haggard Human volition: towards a neuroscience of will , 2008, Nature Reviews Neuroscience.

[13]  E. Koechlin,et al.  Anterior Prefrontal Function and the Limits of Human Decision-Making , 2007, Science.

[14]  G. Knoblich,et al.  The case for motor involvement in perceiving conspecifics. , 2005, Psychological bulletin.

[15]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[16]  B H Repp,et al.  Detectability of duration and intensity increments in melody tones: A partial connection between music perception and performance , 1995, Perception & psychophysics.

[17]  Jennifer Urbano Blackford,et al.  A unique role for the human amygdala in novelty detection , 2010, NeuroImage.

[18]  Mark H. Davis,et al.  A Multidimensional Approach to Individual Differences in Empathy , 1980 .

[19]  E. Saltzman,et al.  Action Representation of Sound: Audiomotor Recognition Network While Listening to Newly Acquired Actions , 2007, The Journal of Neuroscience.

[20]  Michael J. Martinez,et al.  The song system of the human brain. , 2004, Brain research. Cognitive brain research.

[21]  Ingrid S. Johnsrude,et al.  Interleaved silent steady state (ISSS) imaging: A new sparse imaging method applied to auditory fMRI , 2006, NeuroImage.

[22]  Marcel Brass,et al.  When doing nothing is an option: The neural correlates of deciding whether to act or not , 2009, NeuroImage.

[23]  Peter E. Keller,et al.  Differences Between Intention-Based and Stimulus-Based Actions , 2006 .

[24]  M. Trimble,et al.  The Human Amygdala , 2010 .

[25]  Stefan Koelsch,et al.  Cognitive priming in sung and instrumental music: Activation of inferior frontal cortex , 2006, NeuroImage.

[26]  J. Grafman,et al.  The Human Amygdala: An Evolved System for Relevance Detection , 2003, Reviews in the neurosciences.

[27]  Jessica A. Grahn,et al.  Feeling the Beat: Premotor and Striatal Interactions in Musicians and Nonmusicians during Beat Perception , 2009, The Journal of Neuroscience.

[28]  W. Prinz,et al.  Dissociating What and When of Intentional Actions , 2009, Front. Hum. Neurosci..

[29]  Lutz Jäncke,et al.  The Neural Correlate of Speech Rhythm as Evidenced by Metrical Speech Processing , 2008, Journal of Cognitive Neuroscience.

[30]  Aaron L. Berkowitz,et al.  Generation of novel motor sequences: The neural correlates of musical improvisation , 2008, NeuroImage.

[31]  Jeff Pressing,et al.  Improvisation: Methods and models. , 1988 .

[32]  Andreas Schulze-Bonhage,et al.  Response Properties of Human Amygdala Subregions: Evidence Based on Functional MRI Combined with Probabilistic Anatomical Maps , 2007, PloS one.

[33]  Eckart Altenmüller,et al.  TEMPORAL INFORMATION PROCESSING IN MUSICIANS AND NONMUSICIANS , 2006 .

[34]  Fredrik Ullén,et al.  Cortical Regions Involved in the Generation of Musical Structures during Improvisation in Pianists , 2007, Journal of Cognitive Neuroscience.

[35]  J. Rauschecker,et al.  Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing , 2009, Nature Neuroscience.

[36]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[37]  Joseph E LeDoux Emotion circuits in the brain. , 2009, Annual review of neuroscience.

[38]  Colin Camerer,et al.  Neural Systems Responding to Degrees of Uncertainty in Human Decision-Making , 2005, Science.

[39]  G. Aschersleben,et al.  Intention-based and stimulus-based mechanisms in action selection , 2005, Experimental Brain Research.

[40]  Peter E. Keller,et al.  Practice Makes Too Perfect: Fluctuations in Loudness Indicate Spontaneity in Musical Improvisation , 2011 .

[41]  Michael J. Martinez,et al.  Activation of premotor vocal areas during musical discrimination , 2007, Brain and Cognition.

[42]  G. Aschersleben,et al.  The Theory of Event Coding (TEC): a framework for perception and action planning. , 2001, The Behavioral and brain sciences.

[43]  A. Lüthi,et al.  Processing of Temporal Unpredictability in Human and Animal Amygdala , 2007, The Journal of Neuroscience.

[44]  Christopher I. Wright,et al.  Novelty responses and differential effects of order in the amygdala, substantia innominata, and inferior temporal cortex , 2003, NeuroImage.

[45]  C. Keysers,et al.  Empathy and the Somatotopic Auditory Mirror System in Humans , 2006, Current Biology.

[46]  R. Zatorre,et al.  When the brain plays music: auditory–motor interactions in music perception and production , 2007, Nature Reviews Neuroscience.

[47]  G. Rizzolatti,et al.  Hearing Sounds, Understanding Actions: Action Representation in Mirror Neurons , 2002, Science.

[48]  Karine Sergerie,et al.  The role of the amygdala in emotional processing: A quantitative meta-analysis of functional neuroimaging studies , 2008, Neuroscience & Biobehavioral Reviews.

[49]  Tanaka The role of , 2000, Journal of insect physiology.

[50]  R. Zatorre,et al.  When that tune runs through your head: a PET investigation of auditory imagery for familiar melodies. , 1999, Cerebral cortex.

[51]  Andreas Schulze-Bonhage,et al.  A Rapid Sound-Action Association Effect in Human Insular Cortex , 2007, PloS one.

[52]  R. Schubotz Prediction of external events with our motor system: towards a new framework , 2007, Trends in Cognitive Sciences.

[53]  P. Whalen Fear, Vigilance, and Ambiguity , 1998 .

[54]  B. Repp Sensorimotor synchronization: A review of the tapping literature , 2005, Psychonomic bulletin & review.

[55]  G. Schlaug,et al.  Amygdala activity can be modulated by unexpected chord functions during music listening , 2008, Neuroreport.

[56]  H. Critchley,et al.  A common role of insula in feelings, empathy and uncertainty , 2009, Trends in Cognitive Sciences.

[57]  O. A. Andreassen,et al.  The human amygdala is involved in general behavioral relevance detection: Evidence from an event-related functional magnetic resonance imaging Go-NoGo task , 2008, Neuroscience.

[58]  G. Rizzolatti,et al.  A unifying view of the basis of social cognition , 2004, Trends in Cognitive Sciences.

[59]  S. Koelsch Neural substrates of processing syntax and semantics in music , 2005, Current Opinion in Neurobiology.

[60]  I. Johnsrude,et al.  A common neural substrate for the analysis of pitch and duration pattern in segmented sound? , 1999, Neuroreport.

[61]  Andreas Schulze-Bonhage,et al.  A Rapid Sound-Action Association Effect in Human Insular Cortex , 2007 .

[62]  Natalie Sebanz,et al.  Prediction in Joint Action: What, When, and Where , 2009, Top. Cogn. Sci..

[63]  P. Alperson,et al.  On Musical Improvisation , 1984 .

[64]  Robert J. Zatorre,et al.  Mental Concerts: Musical Imagery and Auditory Cortex , 2005, Neuron.

[65]  Anne Springer,et al.  Predicting and memorizing observed action: Differential premotor cortex involvement , 2011, Human brain mapping.

[66]  D. Berlyne Uncertainty and conflict: a point of contact between information-theory and behavior-theory concepts. , 1957, Psychological review.

[67]  Hans-Jochen Heinze,et al.  Shared networks for auditory and motor processing in professional pianists: Evidence from fMRI conjunction , 2006, NeuroImage.