The Rapid Extraction of Gist—Early Neural Correlates of High-level Visual Processing

The human cognitive system is highly efficient in extracting information from our visual environment. This efficiency is based on acquired knowledge that guides our attention toward relevant events and promotes the recognition of individual objects as they appear in visual scenes. The experience-based representation of such knowledge contains not only information about the individual objects but also about relations between them, such as the typical context in which individual objects co-occur. The present EEG study aimed at exploring the availability of such relational knowledge in the time course of visual scene processing, using oscillatory evoked gamma-band responses as a neural correlate for a currently activated cortical stimulus representation. Participants decided whether two simultaneously presented objects were conceptually coherent (e.g., mouse–cheese) or not (e.g., crown–mushroom). We obtained increased evoked gamma-band responses for coherent scenes compared with incoherent scenes beginning as early as 70 msec after stimulus onset within a distributed cortical network, including the right temporal, the right frontal, and the bilateral occipital cortex. This finding provides empirical evidence for the functional importance of evoked oscillatory activity in high-level vision beyond the visual cortex and, thus, gives new insights into the functional relevance of neuronal interactions. It also indicates the very early availability of experience-based knowledge that might be regarded as a fundamental mechanism for the rapid extraction of the gist of a scene.

[1]  R. D. Gordon Attentional allocation during the perception of scenes. , 2004, Journal of experimental psychology. Human perception and performance.

[2]  G. Kreiman,et al.  Timing, Timing, Timing: Fast Decoding of Object Information from Intracranial Field Potentials in Human Visual Cortex , 2009, Neuron.

[3]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[4]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[5]  J. Henderson,et al.  The effects of semantic consistency on eye movements during complex scene viewing , 1999 .

[6]  J. Rieger,et al.  Stimulus intensity affects early sensory processing: visual contrast modulates evoked gamma-band activity in human EEG. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[7]  O. Bertrand,et al.  Stimulus Frequency Dependence of the Transient Oscillatory Auditory Evoked Responses (40 Hz) Studied by Electric and Magnetic Recordings in Human , 1994 .

[8]  M. Potter Meaning in visual search. , 1975, Science.

[9]  C. Tallon-Baudry,et al.  Unconscious associative memory affects visual processing before 100 ms. , 2008, Journal of vision.

[10]  I. Biederman,et al.  Scene perception: Detecting and judging objects undergoing relational violations , 1982, Cognitive Psychology.

[11]  G. Pourtois,et al.  Effects of perceptual learning on primary visual cortex activity in humans , 2008, Vision Research.

[12]  D. Strüber,et al.  Reversal-rate dependent differences in the EEG gamma-band during multistable visual perception. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[13]  Wolf Singer,et al.  Neuronal Synchrony: A Versatile Code for the Definition of Relations? , 1999, Neuron.

[14]  Moshe Bar,et al.  Integrated Contextual Representation for Objects' Identities and Their Locations , 2008, Journal of Cognitive Neuroscience.

[15]  S. Thorpe,et al.  The Time Course of Visual Processing: From Early Perception to Decision-Making , 2001, Journal of Cognitive Neuroscience.

[16]  T. Elbert,et al.  Relationship of transient and steady-state auditory evoked fields. , 1993, Electroencephalography and clinical neurophysiology.

[17]  Ch. von der Malsburg,et al.  A neural cocktail-party processor , 1986, Biological Cybernetics.

[18]  Christoph M. Michel,et al.  Hemispheric specialization of human inferior temporal cortex during coarse-to-fine and fine-to-coarse analysis of natural visual scenes , 2005, NeuroImage.

[19]  Thomas Serre,et al.  A feedforward architecture accounts for rapid categorization , 2007, Proceedings of the National Academy of Sciences.

[20]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[21]  Herbert Schriefers,et al.  Semantic relatedness among objects promotes the activation of multiple phonological codes during object naming , 2010, Quarterly journal of experimental psychology.

[22]  Ingo Fründ,et al.  Human gamma-band activity: A review on cognitive and behavioral correlates and network models , 2010, Neuroscience & Biobehavioral Reviews.

[23]  J. Henderson,et al.  High-level scene perception. , 1999, Annual review of psychology.

[24]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[25]  Matthias M. Müller,et al.  Brain electrical tomography (BET) analysis of induced gamma band responses during a simple object recognition task , 2006, NeuroImage.

[26]  Matthias M. Müller,et al.  A cross-laboratory study of event-related gamma activity in a standard object recognition paradigm , 2006, NeuroImage.

[27]  Terry M. Peters,et al.  3D statistical neuroanatomical models from 305 MRI volumes , 1993, 1993 IEEE Conference Record Nuclear Science Symposium and Medical Imaging Conference.

[28]  Richard B. Ivry,et al.  Hemispheric Asymmetries , 2000, Encyclopedia of Personality and Individual Differences.

[29]  O. Bertrand,et al.  Oscillatory gamma activity in humans and its role in object representation , 1999, Trends in Cognitive Sciences.

[30]  A. Torralba,et al.  The role of context in object recognition , 2007, Trends in Cognitive Sciences.

[31]  Darren Price,et al.  Glutamatergic correlates of gamma-band oscillatory activity during cognition: A concurrent ER-MRS and EEG study , 2014, NeuroImage.

[32]  B. Rockstroh,et al.  Statistical control of artifacts in dense array EEG/MEG studies. , 2000, Psychophysiology.

[33]  O Bertrand,et al.  Combined EEG and MEG recordings of visual 40 Hz responses to illusory triangles in human , 1997, Neuroreport.

[34]  Richard S. J. Frackowiak,et al.  Where in the brain does visual attention select the forest and the trees? , 1996, Nature.

[35]  Jodi L. Davenport,et al.  Scene Consistency in Object and Background Perception , 2004, Psychological science.

[36]  M. Corbetta,et al.  The Reorienting System of the Human Brain: From Environment to Theory of Mind , 2008, Neuron.

[37]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[38]  Matthias M. Müller,et al.  Suppression of the auditory middle-latency response and evoked gamma-band response in a paired-click paradigm , 2001, Experimental Brain Research.

[39]  N. Trujillo-Barreto,et al.  3D Statistical Parametric Mapping of EEG Source Spectra by Means of Variable Resolution Electromagnetic Tomography (VARETA) , 2001, Clinical EEG.

[40]  H. Meeren,et al.  Early Category-Specific Cortical Activation Revealed by Visual Stimulus Inversion , 2008, PloS one.

[41]  N. Mackworth,et al.  Cognitive determinants of fixation location during picture viewing. , 1978, Journal of experimental psychology. Human perception and performance.

[42]  O. Bertrand,et al.  Oscillatory gamma-band (30-70 Hz) activity induced by a visual search task in humans. , 1997, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[43]  Burkhard Maess,et al.  Memory-matches evoke human gamma-responses , 2004, BMC Neuroscience.

[44]  E. Halgren,et al.  Top-down facilitation of visual recognition. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[45]  A. Oliva,et al.  From Blobs to Boundary Edges: Evidence for Time- and Spatial-Scale-Dependent Scene Recognition , 1994 .

[46]  Herbert Schriefers,et al.  Conceptual coherence affects phonological activation of context objects during object naming. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[47]  A. Keil,et al.  The influence of response competition on cerebral asymmetries for processing hierarchical stimuli revealed by ERP recordings , 2002, Experimental Brain Research.

[48]  Erich Schröger,et al.  Is My Mobile Ringing? Evidence for Rapid Processing of a Personally Significant Sound in Humans , 2010, The Journal of Neuroscience.

[49]  S. Hochstein,et al.  View from the Top Hierarchies and Reverse Hierarchies in the Visual System , 2002, Neuron.

[50]  W. Singer,et al.  Temporal binding and the neural correlates of sensory awareness , 2001, Trends in Cognitive Sciences.

[51]  BMC Neuroscience , 2003 .

[52]  P. Fries A mechanism for cognitive dynamics: neuronal communication through neuronal coherence , 2005, Trends in Cognitive Sciences.

[53]  M. Bar Visual objects in context , 2004, Nature Reviews Neuroscience.

[54]  Jasna Martinovic,et al.  Coding of Visual Object Features and Feature Conjunctions in the Human Brain , 2008, PloS one.

[55]  J. Pernier,et al.  Oscillatory γ-Band (30–70 Hz) Activity Induced by a Visual Search Task in Humans , 1997, The Journal of Neuroscience.

[56]  Stefan Debener,et al.  Size matters: effects of stimulus size, duration and eccentricity on the visual gamma-band response , 2004, Clinical Neurophysiology.

[57]  Nelson J. Trujillo-Barreto,et al.  Bayesian model averaging in EEG/MEG imaging , 2004, NeuroImage.

[58]  Karl J. Friston,et al.  A unified statistical approach for determining significant signals in images of cerebral activation , 1996, Human brain mapping.

[59]  B. Rosen,et al.  The associations between 40 Hz-EEG and the middle latency response of the auditory evoked potential. , 1987, The International journal of neuroscience.

[60]  Kenji Kawano,et al.  Global and fine information coded by single neurons in the temporal visual cortex , 1999, Nature.

[61]  A. Engel,et al.  Cognitive functions of gamma-band activity: memory match and utilization , 2004, Trends in Cognitive Sciences.

[62]  M. Bar A Cortical Mechanism for Triggering Top-Down Facilitation in Visual Object Recognition , 2003, Journal of Cognitive Neuroscience.