From perception to conception: how meaningful objects are processed over time.

To recognize visual objects, our sensory perceptions are transformed through dynamic neural interactions into meaningful representations of the world but exactly how visual inputs invoke object meaning remains unclear. To address this issue, we apply a regression approach to magnetoencephalography data, modeling perceptual and conceptual variables. Key conceptual measures were derived from semantic feature-based models claiming shared features (e.g., has eyes) provide broad category information, while distinctive features (e.g., has a hump) are additionally required for more specific object identification. Our results show initial perceptual effects in visual cortex that are rapidly followed by semantic feature effects throughout ventral temporal cortex within the first 120 ms. Moreover, these early semantic effects reflect shared semantic feature information supporting coarse category-type distinctions. Post-200 ms, we observed the effects along the extent of ventral temporal cortex for both shared and distinctive features, which together allow for conceptual differentiation and object identification. By relating spatiotemporal neural activity to statistical feature-based measures of semantic knowledge, we demonstrate that qualitatively different kinds of perceptual and semantic information are extracted from visual objects over time, with rapid activation of shared object features followed by concomitant activation of distinctive features that together enable meaningful visual object recognition.

[1]  Morgan D. Barense,et al.  The human medial temporal lobe processes online representations of complex objects , 2007, Neuropsychologia.

[2]  A. Dale,et al.  Improved Localizadon of Cortical Activity by Combining EEG and MEG with MRI Cortical Surface Reconstruction: A Linear Approach , 1993, Journal of Cognitive Neuroscience.

[3]  J. Dien A tale of two recognition systems: Implications of the fusiform face area and the visual word form area for lateralized object recognition models , 2009, Neuropsychologia.

[4]  Murray Grossman,et al.  The neural basis of semantic memory , 2013 .

[5]  J. Hegdé Time course of visual perception: Coarse-to-fine processing and beyond , 2008, Progress in Neurobiology.

[6]  R. Salmelin,et al.  Dynamics of visual feature analysis and object-level processing in face versus letter-string perception. , 2002, Brain : a journal of neurology.

[7]  D. Tucker,et al.  Parametric analysis of event-related potentials in semantic comprehension: evidence for parallel brain mechanisms. , 2003, Brain research. Cognitive brain research.

[8]  L. Tyler,et al.  Neural Basis of Semantic Memory: The conceptual structure account: A cognitive model of semantic memory and its neural instantiation , 2007 .

[9]  Lisa M Saksida,et al.  The Perceptual-Mnemonic/Feature Conjunction Model of Perirhinal Cortex Function , 2005, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[10]  G. Humphreys,et al.  Hierarchies, similarity, and interactivity in object recognition: “Category-specific” neuropsychological deficits , 2001, Behavioral and Brain Sciences.

[11]  M. Farah,et al.  Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Jasna Martinovic,et al.  Induced Gamma Band Responses Predict Recognition Delays during Object Identification , 2007, Journal of Cognitive Neuroscience.

[13]  Michael J Cortese,et al.  Handbook of Psycholinguistics , 2011 .

[14]  R. Henson,et al.  Multiple levels of visual object constancy revealed by event-related fMRI of repetition priming , 2002, Nature Neuroscience.

[15]  Jasna Martinovic,et al.  Coding of Visual Object Features and Feature Conjunctions in the Human Brain , 2008, PloS one.

[16]  A. Mizuno,et al.  A change of the leading player in flow Visualization technique , 2006, J. Vis..

[17]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[18]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[19]  Ken McRae,et al.  Category - Specific semantic deficits , 2008 .

[20]  R. Poldrack,et al.  Recovering Meaning Left Prefrontal Cortex Guides Controlled Semantic Retrieval , 2001, Neuron.

[21]  J. Grainger,et al.  ERP Evidence for Ultra-Fast Semantic Processing in the Picture–Word Interference Paradigm , 2010, Front. Psychology.

[22]  J. Rodd,et al.  Clarifying the Nature of the Distinctiveness by Domain Interaction in Conceptual Structure: Comment on Cree, Mcnorgan, and Mcrae (2006) , 2022 .

[23]  Karl J. Friston,et al.  Canonical Source Reconstruction for MEG , 2007, Comput. Intell. Neurosci..

[24]  Michael A. Ford,et al.  Can I have a quick word? Early electrophysiological manifestations of psycholinguistic processes revealed by event-related regression analysis of the EEG , 2009, Biological Psychology.

[25]  S. Taulu,et al.  Applications of the signal space separation method , 2005, IEEE Transactions on Signal Processing.

[26]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[27]  L. Tyler,et al.  Towards a distributed account of conceptual knowledge , 2001, Trends in Cognitive Sciences.

[28]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[29]  Tom M. Mitchell,et al.  Quantitative modeling of the neural representation of objects: How semantic feature norms can account for fMRI activation , 2011, NeuroImage.

[30]  J. Rodd,et al.  Anteromedial temporal cortex supports fine-grained differentiation among objects. , 2005, Cerebral cortex.

[31]  J. Rodd,et al.  Distinctiveness and correlation in conceptual structure: behavioral and computational studies. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[32]  Nao Ninomiya,et al.  The 10th anniversary of journal of visualization , 2007, J. Vis..

[33]  Karl J. Friston,et al.  Multiple sparse priors for the M/EEG inverse problem , 2008, NeuroImage.

[34]  G. Kreiman,et al.  Timing, Timing, Timing: Fast Decoding of Object Information from Intracranial Field Potentials in Human Visual Cortex , 2009, Neuron.

[35]  Sébastien M. Crouzet,et al.  Fast saccades toward faces: face detection in just 100 ms. , 2010, Journal of vision.

[36]  Mark S. Seidenberg,et al.  On the nature and scope of featural representations of word meaning. , 1997, Journal of experimental psychology. General.

[37]  Arnold W. M. Smeulders,et al.  Brain responses strongly correlate with Weibull image statistics when processing natural images. , 2009, Journal of vision.

[38]  R. Leahy,et al.  EEG and MEG: forward solutions for inverse methods , 1999, IEEE Transactions on Biomedical Engineering.

[39]  P. Perona,et al.  What do we perceive in a glance of a real-world scene? , 2007, Journal of vision.

[40]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[41]  J. Bullier Integrated model of visual processing , 2001, Brain Research Reviews.

[42]  David J. Freedman,et al.  Categorical representation of visual stimuli in the primate prefrontal cortex. , 2001, Science.

[43]  J. Rodd,et al.  Processing Objects at Different Levels of Specificity , 2004, Journal of Cognitive Neuroscience.

[44]  David Badre,et al.  Semantic retrieval, mnemonic control, and prefrontal cortex. , 2002, Behavioral and cognitive neuroscience reviews.

[45]  S. Thorpe,et al.  The Time Course of Visual Processing: From Early Perception to Decision-Making , 2001, Journal of Cognitive Neuroscience.

[46]  Simon J. Thorpe,et al.  Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited , 2006, Vision Research.

[47]  Haline E. Schendan,et al.  Object knowledge during entry-level categorization is activated and modified by implicit memory after 200 ms , 2009, NeuroImage.

[48]  William D. Marslen-Wilson,et al.  The time course of visual word recognition as revealed by linear regression analysis of ERP data , 2006, NeuroImage.

[49]  G. Altmann,et al.  The Oxford Handbook of Psycholinguistics , 2007 .

[50]  L. Tyler,et al.  Binding crossmodal object features in perirhinal cortex. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[51]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[52]  S. Hochstein,et al.  View from the Top Hierarchies and Reverse Hierarchies in the Visual System , 2002, Neuron.

[53]  K I Taylor,et al.  Conceptual structure: Towards an integrated neurocognitive account , 2011, Language and cognitive processes.

[54]  P. Fletcher,et al.  Selecting among competing alternatives: selection and retrieval in the left inferior frontal gyrus. , 2005, Cerebral cortex.

[55]  Alex Clarke,et al.  The Evolution of Meaning: Spatio-temporal Dynamics of Visual Object Recognition , 2011, Journal of Cognitive Neuroscience.

[56]  G. Rousselet,et al.  Parametric study of EEG sensitivity to phase noise during face processing , 2008, BMC Neuroscience.

[57]  C. J. Marsolek Dissociable Neural Subsystems Underlie Abstract and Specific Object Recognition , 1999 .

[58]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[59]  L. Tyler,et al.  Conceptual Structure , 2006 .

[60]  George S. Cree,et al.  Distinctive features hold a privileged status in the computation of word meaning: Implications for theories of semantic memory. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[61]  Olivier R. Joubert,et al.  The Time-Course of Visual Categorizations: You Spot the Animal Faster than the Bird , 2009, PloS one.

[62]  Mark S. Seidenberg,et al.  Semantic feature production norms for a large set of living and nonliving things , 2005, Behavior research methods.

[63]  Keiji Tanaka,et al.  Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey , 2008, Neuron.

[64]  Leslie G. Ungerleider Two cortical visual systems , 1982 .