Tracking the Time Course of Action Priming on Object Recognition: Evidence for Fast and Slow Influences of Action on Perception

Perception and action are classically thought to be supported by functionally and neuroanatomically distinct mechanisms. However, recent behavioral studies using an action priming paradigm challenged this view and showed that action representations can facilitate object recognition. This study determined whether action representations influence object recognition during early visual processing stages, that is, within the first 150 msec. To this end, the time course of brain activation underlying such action priming effects was examined by recording ERPs. Subjects were sequentially presented with two manipulable objects (e.g., tools), which had to be named. In the congruent condition, both objects afforded similar actions, whereas dissimilar actions were afforded in the incongruent condition. In order to test the influence of the prime modality on action priming, the first object (prime) was presented either as picture or as word. We found an ERP effect of action priming over the central scalp as early as 100 msec after target onset for pictorial, but not for verbal primes. A later action priming effect on the N400 ERP component known to index semantic integration processes was obtained for both picture and word primes. The early effect was generated in a fronto-parietal motor network, whereas the late effect reflected activity in anterior temporal areas. The present results indicate that action priming influences object recognition through both fast and slow pathways: Action priming affects rapid visuomotor processes only when elicited by pictorial prime stimuli. However, it also modulates comparably slow conceptual integration processes independent of the prime modality.

[1]  O. Paulson,et al.  Perceptual differentiation and category effects in normal object recognition: a PET study. , 1999, Brain : a journal of neurology.

[2]  Olaf Hauk,et al.  Keep it simple: a case for using classical minimum norm estimation in the analysis of EEG and MEG data , 2004, NeuroImage.

[3]  S. Hillyard,et al.  Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. , 1991, Journal of experimental psychology. Human perception and performance.

[4]  Alex Martin,et al.  Semantic memory and the brain: structure and processes , 2001, Current Opinion in Neurobiology.

[5]  Markus Graf,et al.  Coordinate transformations in object recognition. , 2006, Psychological bulletin.

[6]  Eric L Amazeen,et al.  Psychophysical test for the independence of perception and action. , 2005, Journal of experimental psychology. Human perception and performance.

[7]  O Bertrand,et al.  A theoretical justification of the average reference in topographic evoked potential studies. , 1985, Electroencephalography and clinical neurophysiology.

[8]  Alex Martin,et al.  Representation of Manipulable Man-Made Objects in the Dorsal Stream , 2000, NeuroImage.

[9]  Olaf Hauk,et al.  Experience-dependent Plasticity of Conceptual Representations in Human Sensory-Motor Areas , 2007, Journal of Cognitive Neuroscience.

[10]  B. Bridgeman,et al.  Interaction of cognitive and sensorimotor maps of visual space , 1997, Perception & psychophysics.

[11]  Friedemann Pulvermüller,et al.  Brain Signatures of Meaning Access in Action Word Recognition , 2005, Journal of Cognitive Neuroscience.

[12]  M. Kiefer,et al.  Perceptual and semantic sources of category-specific effects: Event-related potentials during picture and word categorization , 2001, Memory & cognition.

[13]  J. Rodd,et al.  Anteromedial temporal cortex supports fine-grained differentiation among objects. , 2005, Cerebral cortex.

[14]  O. Hauk,et al.  Neurophysiological distinction of action words in the fronto‐central cortex , 2004, Human brain mapping.

[15]  F Pulvermüller,et al.  Nouns and verbs in the intact brain: evidence from event-related potentials and high-frequency cortical responses. , 1999, Cerebral cortex.

[16]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[17]  N. Kanwisher,et al.  Stages of processing in face perception: an MEG study , 2002, Nature Neuroscience.

[18]  M. Kutas,et al.  The Search for Common Sense: An Electrophysiological Study of the Comprehension of Words and Pictures in Reading , 1996, Journal of Cognitive Neuroscience.

[19]  S. Hillyard,et al.  Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. , 1991, Journal of experimental psychology. Human perception and performance.

[20]  T. Rogers,et al.  Where do you know what you know? The representation of semantic knowledge in the human brain , 2007, Nature Reviews Neuroscience.

[21]  Rolf A. Zwaan,et al.  The functional role of motor activation in language processing: Motor cortical oscillations support lexical-semantic retrieval , 2010, NeuroImage.

[22]  H. Huynh,et al.  Conditions under Which Mean Square Ratios in Repeated Measurements Designs Have Exact F-Distributions , 1970 .

[23]  G. McCarthy,et al.  Language-related field potentials in the anterior-medial temporal lobe: II. Effects of word type and semantic priming , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  Simon J. Thorpe,et al.  Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited , 2006, Vision Research.

[25]  Richard S. J. Frackowiak,et al.  Functional anatomy of a common semantic system for words and pictures , 1996, Nature.

[26]  Sarah H. Creem,et al.  Grasping objects by their handles: a necessary interaction between cognition and action. , 2001, Journal of experimental psychology. Human perception and performance.

[27]  G. Aschersleben,et al.  The Theory of Event Coding (TEC): a framework for perception and action planning. , 2001, The Behavioral and brain sciences.

[28]  M. Goodale Image and Brain: The Resolution of the Imagery Debate , 1995 .

[29]  J. Marotta,et al.  The specificity of learned associations in visuomotor and perceptual processing , 2008, Experimental Brain Research.

[30]  T. Paine Common Sense , 1995 .

[31]  Friedemann Pulvermüller,et al.  How the Camel Lost Its Hump: The Impact of Object Typicality on Event-related Potential Signals in Object Decision , 2007, Journal of Cognitive Neuroscience.

[32]  Glyn W. Humphreys,et al.  Perceptual and motor-based responses to hand actions on objects: evidence from ERPs , 2012, Experimental Brain Research.

[33]  C. C. Wood,et al.  Event-related potentials, lexical decision and semantic priming. , 1985, Electroencephalography and clinical neurophysiology.

[34]  J L Lancaster,et al.  Automated Talairach Atlas labels for functional brain mapping , 2000, Human brain mapping.

[35]  A. Ibanez,et al.  Motor-language coupling: Direct evidence from early Parkinson’s disease and intracranial cortical recordings , 2013, Cortex.

[36]  Friedemann Pulvermüller,et al.  Brain mechanisms linking language and action , 2005, Nature Reviews Neuroscience.

[37]  M. A. Goodale,et al.  Grasping after a Delay Shifts Size-Scaling from Absolute to Relative Metrics , 2000, Journal of Cognitive Neuroscience.

[38]  Don M. Tucker,et al.  A Cognitive-Anatomical Approach to Attention in Lexical Access , 1991, Journal of Cognitive Neuroscience.

[39]  R. Ellis,et al.  On the relations between seen objects and components of potential actions. , 1998, Journal of experimental psychology. Human perception and performance.

[40]  Bruno A Olshausen,et al.  Timecourse of neural signatures of object recognition. , 2003, Journal of vision.

[41]  M. Kiefer,et al.  The Sound of Concepts: Four Markers for a Link between Auditory and Conceptual Brain Systems , 2008, The Journal of Neuroscience.

[42]  A. Ellis Progress in the psychology of language , 1985 .

[43]  Markus Kiefer,et al.  Repetition-priming Modulates Category-related Effects on Event-related Potentials: Further Evidence for Multiple Cortical Semantic Systems , 2005, Journal of Cognitive Neuroscience.

[44]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[45]  Christian Gerlach,et al.  A Review of Functional Imaging Studies on Category Specificity , 2007, Journal of Cognitive Neuroscience.

[46]  Melvyn A Goodale,et al.  Interactions between the dorsal and ventral streams of visual processing. , 2003, Advances in neurology.

[47]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[48]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[49]  G. Humphreys,et al.  Recognition by action: dissociating visual and semantic routes to action in normal observers. , 1998, Journal of experimental psychology. Human perception and performance.

[50]  R. Desimone,et al.  Stimulus-selective properties of inferior temporal neurons in the macaque , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[51]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[52]  Glyn W. Humphreys,et al.  Cascade processes in picture identification , 1988 .

[53]  M. Kiefer,et al.  Conceptual representations in mind and brain: Theoretical developments, current evidence and future directions , 2012, Cortex.

[54]  H H Bülthoff,et al.  Orientation Congruency Effects for Familiar Objects , 2005, Psychological science.

[55]  Markus Kiefer,et al.  The limits of a distributed account of conceptual knowledge , 2001, Trends in Cognitive Sciences.

[56]  M. Goodale,et al.  The visual brain in action , 1995 .

[57]  Sergio E. Chaigneau,et al.  THE SIMILARITY-IN-TOPOGRAPHY PRINCIPLE: RECONCILING THEORIES OF CONCEPTUAL DEFICITS , 2003, Cognitive neuropsychology.

[58]  Markus Kiefer,et al.  Conceptual Flexibility in the Human Brain: Dynamic Recruitment of Semantic Maps from Visual, Motor, and Motion-related Areas , 2008, Journal of Cognitive Neuroscience.

[59]  Ellen Poliakoff,et al.  The effect of viewing graspable objects and actions in Parkinson's disease , 2007, Neuroreport.

[60]  R. Ilmoniemi,et al.  Interpreting magnetic fields of the brain: minimum norm estimates , 2006, Medical and Biological Engineering and Computing.

[61]  R. C. Oldfield THE ASSESSMENT AND ANALYSIS OF HANDEDNESS , 1971 .

[62]  Markus Graf,et al.  The role of action representations in visual object recognition , 2006, Experimental Brain Research.

[63]  M. Kiefer,et al.  Action observation can prime visual object recognition , 2009, Experimental Brain Research.

[64]  Karl J. Friston,et al.  Two distinct neural mechanisms for category-selective responses. , 2006, Cerebral cortex.

[65]  P. Pexman,et al.  An embodied semantic processing effect on eye gaze during sentence reading , 2012, Language and Cognition.

[66]  J C Mazziotta,et al.  Automated labeling of the human brain: A preliminary report on the development and evaluation of a forward‐transform method , 1997, Human brain mapping.

[67]  Antje S. Meyer,et al.  An MEG Study of Picture Naming , 1998, Journal of Cognitive Neuroscience.

[68]  Leslie G. Ungerleider,et al.  Neural correlates of category-specific knowledge , 1996, Nature.

[69]  K. Grill-Spector,et al.  The human visual cortex. , 2004, Annual review of neuroscience.

[70]  E. Warrington,et al.  Categories of knowledge. Further fractionations and an attempted integration. , 1987, Brain : a journal of neurology.

[71]  K. Fiedler,et al.  Mood states modulate activity in semantic brain areas during emotional word encoding. , 2007, Cerebral cortex.

[72]  I. Johnsrude,et al.  Somatotopic Representation of Action Words in Human Motor and Premotor Cortex , 2004, Neuron.

[73]  J. Fermaglich Electric Fields of the Brain: The Neurophysics of EEG , 1982 .

[74]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[75]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[76]  Markus Kiefer,et al.  Right Hemisphere Activation during Indirect Semantic Priming: Evidence from Event-Related Potentials , 1998, Brain and Language.

[77]  Piotr Jaskowski,et al.  On Why Left Events are the Right Ones: Neural Mechanisms Underlying the Left-hemifield Advantage in Rapid Serial Visual Presentation , 2009, Journal of Cognitive Neuroscience.

[78]  S Makeig,et al.  Blind separation of auditory event-related brain responses into independent components. , 1997, Proceedings of the National Academy of Sciences of the United States of America.