Action Representation of Sound: Audiomotor Recognition Network While Listening to Newly Acquired Actions

The discovery of audiovisual mirror neurons in monkeys gave rise to the hypothesis that premotor areas are inherently involved not only when observing actions but also when listening to action-related sound. However, the whole-brain functional formation underlying such “action–listening” is not fully understood. In addition, previous studies in humans have focused mostly on relatively simple and overexperienced everyday actions, such as hand clapping or door knocking. Here we used functional magnetic resonance imaging to ask whether the human action-recognition system responds to sounds found in a more complex sequence of newly acquired actions. To address this, we chose a piece of music as a model set of acoustically presentable actions and trained non-musicians to play it by ear. We then monitored brain activity in subjects while they listened to the newly acquired piece. Although subjects listened to the music without performing any movements, activation was found bilaterally in the frontoparietal motor-related network (including Broca's area, the premotor region, the intraparietal sulcus, and the inferior parietal region), consistent with neural circuits that have been associated with action observations, and may constitute the human mirror neuron system. Presentation of the practiced notes in a different order activated the network to a much lesser degree, whereas listening to an equally familiar but motorically unknown music did not activate this network. These findings support the hypothesis of a “hearing–doing” system that is highly dependent on the individual's motor repertoire, gets established rapidly, and consists of Broca's area as its hub.

[1]  R. Veit,et al.  Differential cerebral activation during observation of expressive gestures and motor acts , 2006, Neuropsychologia.

[2]  Gottfried Schlaug,et al.  Shared and distinct neural correlates of singing and speaking , 2006, NeuroImage.

[3]  Eckart Altenmüller,et al.  Classical conditioned responses to absent tones , 2006, BMC Neuroscience.

[4]  E Altenmüller,et al.  Cross‐modal plasticity of the motor cortex while listening to a rehearsed musical piece , 2006, The European journal of neuroscience.

[5]  Giovanni Buccino,et al.  The role of ventral premotor cortex in action execution and action understanding , 2006, Journal of Physiology-Paris.

[6]  Hans-Jochen Heinze,et al.  Shared networks for auditory and motor processing in professional pianists: Evidence from fMRI conjunction , 2006, NeuroImage.

[7]  J. Mazziotta,et al.  Lateralization of the Human Mirror Neuron System , 2006, The Journal of Neuroscience.

[8]  F Pulvermüller,et al.  The sound of actions as reflected by mismatch negativity: rapid activation of cortical sensory–motor networks by sounds associated with finger and tongue movements , 2006, The European journal of neuroscience.

[9]  Ian M. Thornton,et al.  Action Perception: Seeing the World through a Moving Body , 2006, Current Biology.

[10]  S. Swinnen,et al.  Learning and transfer of bimanual multifrequency patterns: effector-independent and effector-specific levels of movement representation , 2006, Experimental Brain Research.

[11]  E. Saltzman,et al.  The Power of Listening: Auditory‐Motor Interactions in Musical Training , 2005, Annals of the New York Academy of Sciences.

[12]  Reyna L. Gordon,et al.  Musical and Linguistic Processing in Song Perception , 2005, Annals of the New York Academy of Sciences.

[13]  L. Jäncke,et al.  A Network for Sensory‐Motor Integration , 2005, Annals of the New York Academy of Sciences.

[14]  M. Iacoboni Neural mechanisms of imitation , 2005, Current Opinion in Neurobiology.

[15]  G. Orban,et al.  Observing Others: Multiple Action Representation in the Frontal Lobe , 2005, Science.

[16]  R. Passingham,et al.  Action observation and acquired motor skills: an FMRI study with expert dancers. , 2005, Cerebral cortex.

[17]  G. Rizzolatti,et al.  Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. , 2005, Brain research. Cognitive brain research.

[18]  J. Mazziotta,et al.  Functional segregation within pars opercularis of the inferior frontal gyrus: evidence from fMRI studies of imitation and action observation. , 2005, Cerebral cortex.

[19]  Takashi Hanakawa,et al.  Finger and face representations in the ipsilateral precentral motor areas in humans. , 2005, Journal of neurophysiology.

[20]  J. Mazziotta,et al.  Grasping the Intentions of Others with One's Own Mirror Neuron System , 2005, PLoS biology.

[21]  Peter Erhard,et al.  Transmodal Sensorimotor Networks during Action Observation in Professional Pianists , 2005, Journal of Cognitive Neuroscience.

[22]  Elizabeth Bates,et al.  Separate neural systems for processing action- or non-action-related sounds , 2005, NeuroImage.

[23]  S. Blakemore,et al.  Motor activation prior to observation of a predicted movement , 2004, Nature Neuroscience.

[24]  John F. Kalaska,et al.  Neural correlates of mental rehearsal in dorsal premotor cortex , 2004, Nature.

[25]  Á. Pascual-Leone,et al.  Modulation of premotor mirror neuron activity during observation of unpredictable grasping movements , 2004, The European journal of neuroscience.

[26]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[27]  M. Iacoboni,et al.  Listening to speech activates motor areas involved in speech production , 2004, Nature Neuroscience.

[28]  D Yves von Cramon,et al.  Sequences of Abstract Nonbiological Stimuli Share Ventral Premotor Cortex with Action Observation and Imagery , 2004, The Journal of Neuroscience.

[29]  J. Mazziotta,et al.  Left hemisphere motor facilitation in response to manual action sounds , 2004, The European journal of neuroscience.

[30]  F. Binkofski,et al.  Motor functions of the Broca’s region , 2004, Brain and Language.

[31]  G. Rizzolatti,et al.  Neural Circuits Underlying Imitation Learning of Hand Actions An Event-Related fMRI Study , 2004, Neuron.

[32]  Uta Frith,et al.  Your Own Action Influences How You Perceive Another Person's Action , 2004, Current Biology.

[33]  Scott T. Grafton,et al.  Localization of grasp representations in humans by positron emission tomography , 1996, Experimental Brain Research.

[34]  G. Rizzolatti,et al.  Neural Circuits Involved in the Recognition of Actions Performed by Nonconspecifics: An fMRI Study , 2004, Journal of Cognitive Neuroscience.

[35]  Paolo Manganotti,et al.  Modulation of motor cortex excitability in the left hemisphere during action observation: a single- and paired-pulse transcranial magnetic stimulation study of self- and non-self-action observation , 2003, Neuropsychologia.

[36]  M Lotze,et al.  The musician's brain: functional imaging of amateurs and professionals during performance and imagery , 2003, NeuroImage.

[37]  M. Bangert,et al.  Mapping perception to action in piano practice: a longitudinal DC-EEG study , 2003, BMC Neuroscience.

[38]  Lauren Stewart,et al.  Brain changes after learning to read and play music , 2003, NeuroImage.

[39]  L. Fogassi,et al.  Audiovisual mirror neurons and action recognition , 2003, Experimental Brain Research.

[40]  Scott T. Grafton,et al.  Swinging in the brain: shared neural substrates for behaviors related to sequencing and music , 2003, Nature Neuroscience.

[41]  Volkmar Glauche,et al.  The human action recognition system and its relationship to Broca’s area: an fMRI study , 2003, NeuroImage.

[42]  Guillaume Thierry,et al.  Hemispheric Dissociation in Access to the Human Semantic System , 2003, Neuron.

[43]  R. E Passingham,et al.  Activations related to “mirror” and “canonical” neurones in the human brain: an fMRI study , 2003, NeuroImage.

[44]  Y. Paulignan,et al.  An Interference Effect of Observed Biological Movement on Action , 2003, Current Biology.

[45]  J. Mazziotta,et al.  The essential role of Broca's area in imitation , 2003, The European journal of neuroscience.

[46]  Alvaro Pascual-Leone,et al.  Language Acquisition: Do as You Hear , 2002, Current Biology.

[47]  Scott T. Grafton,et al.  Motor sequence learning with the nondominant left hand , 2002, Experimental Brain Research.

[48]  G. Rizzolatti,et al.  Hearing Sounds, Understanding Actions: Action Representation in Mirror Neurons , 2002, Science.

[49]  Jeff H. Duyn,et al.  Cortical Systems Associated with Covert Music Rehearsal , 2002, NeuroImage.

[50]  R. Zatorre,et al.  Structure and function of auditory cortex: music and speech , 2002, Trends in Cognitive Sciences.

[51]  G. Rizzolatti,et al.  Speech listening specifically modulates the excitability of tongue muscles: a TMS study , 2002, The European journal of neuroscience.

[52]  F. Pulvermüller Brain reflections of words and their meaning , 2001, Trends in Cognitive Sciences.

[53]  E Altenmüller,et al.  On Practice: How the Brain Connects Piano Keys and Piano Sounds , 2001, Annals of the New York Academy of Sciences.

[54]  A. Friederici,et al.  Musical syntax is processed in Broca's area: an MEG study , 2001, Nature Neuroscience.

[55]  J. Decety,et al.  Functional anatomy of execution, mental simulation, observation, and verb generation of actions: A meta‐analysis , 2001, Human brain mapping.

[56]  G. Rizzolatti,et al.  Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study , 2001, The European journal of neuroscience.

[57]  R. Hari,et al.  Temporal dynamics of cortical representation for action. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[58]  J. Mazziotta,et al.  Cortical mechanisms of human imitation. , 1999, Science.

[59]  Richard S. J. Frackowiak,et al.  A Blueprint for Movement: Functional and Anatomical Representations in the Human Motor System , 1999, The Journal of Neuroscience.

[60]  J. Decety,et al.  Neural mechanisms subserving the perception of human actions , 1999, Trends in Cognitive Sciences.

[61]  R. Passingham,et al.  The Preparation, Execution and Suppression of Copied Movements in the Human Brain , 1996 .

[62]  M. Arbib,et al.  Language within our grasp , 1998, Trends in Neurosciences.

[63]  Richard S. J. Frackowiak,et al.  The structural components of music perception. A functional anatomical study. , 1997, Brain : a journal of neurology.

[64]  M. Diamond,et al.  Primary Motor and Sensory Cortex Activation during Motor Performance and Motor Imagery: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[65]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[66]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[67]  A. P. Georgopoulos,et al.  Functional magnetic resonance imaging of motor cortex: hemispheric asymmetry and handedness. , 1993, Science.

[68]  Alan C. Evans,et al.  Lateralization of phonetic and pitch discrimination in speech processing. , 1992, Science.

[69]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.