The Evolution of Meaning: Spatio-temporal Dynamics of Visual Object Recognition

Research on the spatio-temporal dynamics of visual object recognition suggests a recurrent, interactive model whereby an initial feedforward sweep through the ventral stream to prefrontal cortex is followed by recurrent interactions. However, critical questions remain regarding the factors that mediate the degree of recurrent interactions necessary for meaningful object recognition. The novel prediction we test here is that recurrent interactivity is driven by increasing semantic integration demands as defined by the complexity of semantic information required by the task and driven by the stimuli. To test this prediction, we recorded magnetoencephalography data while participants named living and nonliving objects during two naming tasks. We found that the spatio-temporal dynamics of neural activity were modulated by the level of semantic integration required. Specifically, source reconstructed time courses and phase synchronization measures showed increased recurrent interactions as a function of semantic integration demands. These findings demonstrate that the cortical dynamics of object processing are modulated by the complexity of semantic information required from the visual input.

[1]  Sergio E. Chaigneau,et al.  THE SIMILARITY-IN-TOPOGRAPHY PRINCIPLE: RECONCILING THEORIES OF CONCEPTUAL DEFICITS , 2003, Cognitive neuropsychology.

[2]  P. Fletcher,et al.  DO SEMANTIC CATEGORIES ACTIVATE DISTINCT CORTICAL REGIONS? EVIDENCE FOR A DISTRIBUTED NEURAL SEMANTIC SYSTEM , 2003, Cognitive neuropsychology.

[3]  J. Rodd,et al.  Distinctiveness and correlation in conceptual structure: behavioral and computational studies. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[4]  T. Rogers,et al.  Where do you know what you know? The representation of semantic knowledge in the human brain , 2007, Nature Reviews Neuroscience.

[5]  R. Ilmoniemi,et al.  Interpreting magnetic fields of the brain: minimum norm estimates , 2006, Medical and Biological Engineering and Computing.

[6]  J. Rodd,et al.  Processing Objects at Different Levels of Specificity , 2004, Journal of Cognitive Neuroscience.

[7]  T. Poggio,et al.  Hierarchical models of object recognition in cortex September 23 , 1999 , 1999 .

[8]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[9]  E. Rolls,et al.  Selective Perceptual Impairments After Perirhinal Cortex Ablation , 2001, The Journal of Neuroscience.

[10]  A. Dale,et al.  Distributed current estimates using cortical orientation constraints , 2006, Human brain mapping.

[11]  M. Vitkovitch,et al.  Sources of Disagreement in Object Naming , 1995 .

[12]  Jasna Martinovic,et al.  Priming of object categorization within and across levels of specificity , 2009 .

[13]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[14]  Amanda Parker,et al.  The von Restorff Effect in Visual Object Recognition Memory in Humans and Monkeys: The Role of Frontal/Perirhinal Interaction , 1998, Journal of Cognitive Neuroscience.

[15]  P. Goldman-Rakic,et al.  Preface: Cerebral Cortex Has Come of Age , 1991 .

[16]  Billi Randall,et al.  From perception to conception: how meaningful objects are processed over time. , 2013, Cerebral cortex.

[17]  M. Kutas,et al.  Neurophysiological evidence for two processing times for visual object identification , 2002, Neuropsychologia.

[18]  F. Varela,et al.  Perception's shadow: long-distance synchronization of human brain activity , 1999, Nature.

[19]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[20]  Y. Yamane,et al.  Complex objects are represented in macaque inferotemporal cortex by the combination of feature columns , 2001, Nature Neuroscience.

[21]  M. Bar,et al.  The effects of priming on frontal-temporal communication , 2008, Proceedings of the National Academy of Sciences.

[22]  E. Halgren,et al.  Top-down facilitation of visual recognition. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[23]  S Ullman,et al.  Sequence seeking and counter streams: a computational model for bidirectional information flow in the visual cortex. , 1995, Cerebral cortex.

[24]  Francisco Rodríguez-Quioñes Spanish researchers defeated by the system , 1999, Nature.

[25]  R. Ulrich,et al.  Effects of truncation on reaction time analysis. , 1994, Journal of experimental psychology. General.

[26]  Joseph T. Devlin,et al.  The emergence of category specific deficits in a distributed semantic system , 2002 .

[27]  S. Taulu,et al.  Applications of the signal space separation method , 2005, IEEE Transactions on Signal Processing.

[28]  J. Haxby,et al.  Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects , 1999, Nature Neuroscience.

[29]  Ken McRae,et al.  Category - Specific semantic deficits , 2008 .

[30]  Y. Miyashita,et al.  Top-down signal from prefrontal cortex in executive control of memory retrieval , 1999, Nature.

[31]  S. Edelman,et al.  Human Brain Mapping 6:316–328(1998) � A Sequence of Object-Processing Stages Revealed by fMRI in the Human Occipital Lobe , 2022 .

[32]  Haline E. Schendan,et al.  Object knowledge during entry-level categorization is activated and modified by implicit memory after 200 ms , 2009, NeuroImage.

[33]  Catherine Tallon-Baudry,et al.  The many faces of the gamma band response to complex visual stimuli , 2005, NeuroImage.

[34]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[35]  Matthias M. Müller,et al.  Brain electrical tomography (BET) analysis of induced gamma band responses during a simple object recognition task , 2006, NeuroImage.

[36]  Glyn W. Humphreys,et al.  From objects to names: A cognitive neuroscience approach , 1999, Psychological research.

[37]  O. Bertrand,et al.  Oscillatory gamma activity in humans and its role in object representation , 1999, Trends in Cognitive Sciences.

[38]  David J. Freedman,et al.  The prefrontal cortex: categories, concepts and cognition. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[39]  Y Miyashita,et al.  Feedback signal from medial temporal lobe mediates visual associative mnemonic codes of inferotemporal neurons. , 1996, Brain research. Cognitive brain research.

[40]  C. Stern,et al.  Where vision meets memory: prefrontal-posterior networks for visual object constancy during categorization and recognition. , 2008, Cerebral cortex.

[41]  G. Humphreys,et al.  An interactive activation approach to object processing: effects of structural similarity, name frequency, and task in normality and pathology. , 1995, Memory.

[42]  Thomas Serre,et al.  A feedforward architecture accounts for rapid categorization , 2007, Proceedings of the National Academy of Sciences.

[43]  Ana Raposo,et al.  The hierarchical organization of semantic memory: Executive function in the processing of superordinate concepts , 2012, NeuroImage.

[44]  L. Tyler,et al.  Unitary vs multiple semantics: PET studies of word and picture processing , 2004, Brain and Language.

[45]  M. Bar,et al.  Cortical Mechanisms Specific to Explicit Visual Object Recognition , 2001, Neuron.

[46]  Tomaso Poggio,et al.  Fast Readout of Object Identity from Macaque Inferior Temporal Cortex , 2005, Science.

[47]  Bruno A Olshausen,et al.  Timecourse of neural signatures of object recognition. , 2003, Journal of vision.

[48]  Matthias M. Müller,et al.  Directed Cortical Information Flow during Human Object Recognition: Analyzing Induced EEG Gamma-Band Responses in Brain's Source Space , 2007, PloS one.

[49]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[50]  F. Varela,et al.  Measuring phase synchrony in brain signals , 1999, Human brain mapping.

[51]  Pablo Varona,et al.  Instability, semantic dynamics and modeling brain data , 2012 .

[52]  Naska Winschiers-Goagoses,et al.  Design Democratization with Communities: Drawing Toward Locally Meaningful Design , 2012, Int. J. Sociotechnology Knowl. Dev..

[53]  Glyn W. Humphreys,et al.  Categorizing chairs and naming pears: Category differences in object processing as a function of task and priming , 1997, Memory & cognition.

[54]  W. Singer,et al.  Synchronization of Neural Activity across Cortical Areas Correlates with Conscious Perception , 2007, The Journal of Neuroscience.

[55]  S. Thorpe,et al.  Surfing a spike wave down the ventral stream , 2002, Vision Research.

[56]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[57]  J. Rodd,et al.  Clarifying the Nature of the Distinctiveness by Domain Interaction in Conceptual Structure: Comment on Cree, Mcnorgan, and Mcrae (2006) , 2022 .

[58]  M. Kiefer,et al.  Cognitive Neuroscience: Tracking the time course of object categorization using event-related potentials , 1999 .

[59]  Antonio R. Damasio,et al.  The Brain Binds Entities and Events by Multiregional Activation from Convergence Zones , 1989, Neural Computation.

[60]  Keiji Tanaka,et al.  Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. , 1994, Journal of neurophysiology.

[61]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[62]  Jasna Martinovic,et al.  Induced gamma-band activity is related to the time point of object identification , 2008, Brain Research.

[63]  M. Potter,et al.  Time to understand pictures and words , 1975, Nature.

[64]  Jennifer M. Rodd,et al.  The Emergence of Semantic Categories from Distributed Featural Representations , 2001 .

[65]  Mark D'Esposito,et al.  Searching for “the Top” in Top-Down Control , 2005, Neuron.

[66]  J. Bullier Integrated model of visual processing , 2001, Brain Research Reviews.

[67]  M. Bar A Cortical Mechanism for Triggering Top-Down Facilitation in Visual Object Recognition , 2003, Journal of Cognitive Neuroscience.

[68]  E. Halgren,et al.  Dynamic Statistical Parametric Mapping Combining fMRI and MEG for High-Resolution Imaging of Cortical Activity , 2000, Neuron.

[69]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[70]  L. Saksida,et al.  Perirhinal cortex resolves feature ambiguity in complex visual discriminations , 2002, The European journal of neuroscience.

[71]  L. Tyler,et al.  Towards a distributed account of conceptual knowledge , 2001, Trends in Cognitive Sciences.

[72]  G. Kreiman,et al.  Timing, Timing, Timing: Fast Decoding of Object Information from Intracranial Field Potentials in Human Visual Cortex , 2009, Neuron.

[73]  Mark S. Seidenberg,et al.  On the nature and scope of featural representations of word meaning. , 1997, Journal of experimental psychology. General.

[74]  M. Bar,et al.  Top-down predictions in the cognitive brain , 2007, Brain and Cognition.

[75]  L. Saksida,et al.  Impairments in visual discrimination after perirhinal cortex lesions: testing ‘declarative’ vs. ‘perceptual‐mnemonic’ views of perirhinal cortex function , 2003, The European journal of neuroscience.

[76]  J. Rodd,et al.  Anteromedial temporal cortex supports fine-grained differentiation among objects. , 2005, Cerebral cortex.

[77]  Thomas E. Nichols,et al.  Nonstationary cluster-size inference with random field and permutation methods , 2004, NeuroImage.

[78]  David J. Freedman,et al.  Categorical representation of visual stimuli in the primate prefrontal cortex. , 2001, Science.