Category-Specific Visual Responses: An Intracranial Study Comparing Gamma, Beta, Alpha, and ERP Response Selectivity

The specificity of neural responses to visual objects is a major topic in visual neuroscience. In humans, functional magnetic resonance imaging (fMRI) studies have identified several regions of the occipital and temporal lobe that appear specific to faces, letter strings, scenes, or tools. Direct electrophysiological recordings in the visual cortical areas of epileptic patients have largely confirmed this modular organization, using either single-neuron peri-stimulus time-histogram or intracerebral event-related potentials (iERP). In parallel, a new research stream has emerged using high-frequency gamma-band activity (50–150 Hz) (GBR) and low-frequency alpha/beta activity (8–24 Hz) (ABR) to map functional networks in humans. An obvious question is now whether the functional organization of the visual cortex revealed by fMRI, ERP, GBR, and ABR coincide. We used direct intracerebral recordings in 18 epileptic patients to directly compare GBR, ABR, and ERP elicited by the presentation of seven major visual object categories (faces, scenes, houses, consonants, pseudowords, tools, and animals), in relation to previous fMRI studies. Remarkably both GBR and iERP showed strong category-specificity that was in many cases sufficient to infer stimulus object category from the neural response at single-trial level. However, we also found a strong discrepancy between the selectivity of GBR, ABR, and ERP with less than 10% of spatial overlap between sites eliciting the same category-specificity. Overall, we found that selective neural responses to visual objects were broadly distributed in the brain with a prominent spatial cluster located in the posterior temporal cortex. Moreover, the different neural markers (GBR, ABR, and iERP) that elicit selectivity toward specific visual object categories present little spatial overlap suggesting that the information content of each marker can uniquely characterize high-level visual information in the brain.

[1]  T. Allison,et al.  Human extrastriate visual cortex and the perception of faces, words, numbers, and colors. , 1994, Cerebral cortex.

[2]  R. Desimone,et al.  Columnar organization of directionally selective cells in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[3]  Yehezkel Yeshurun,et al.  Enhanced Category Tuning Revealed by Intracranial Electroencephalograms in High-Order Human Visual Areas , 2007, The Journal of Neuroscience.

[4]  J. Gallant,et al.  Identifying natural images from human brain activity , 2008, Nature.

[5]  Robert T. Knight,et al.  Five-dimensional neuroimaging: Localization of the time–frequency dynamics of cortical activity , 2008, NeuroImage.

[6]  G. Kreiman,et al.  Timing, Timing, Timing: Fast Decoding of Object Information from Intracranial Field Potentials in Human Visual Cortex , 2009, Neuron.

[7]  J. Pernier,et al.  Stimulus Specificity of Phase-Locked and Non-Phase-Locked 40 Hz Visual Responses in Human , 1996, The Journal of Neuroscience.

[8]  T. Allison,et al.  Word recognition in the human inferior temporal lobe , 1994, Nature.

[9]  J. Talairach,et al.  Referentially oriented cerebral MRI anatomy : an atlas of stereotaxic anatomical correlations for gray and white matter , 1993 .

[10]  R. Desimone,et al.  Modulation of Oscillatory Neuronal Synchronization by Selective Visual Attention , 2001, Science.

[11]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[12]  T. Allison,et al.  Electrophysiological studies of color processing in human visual cortex. , 1993, Electroencephalography and clinical neurophysiology.

[13]  N. Crone,et al.  High-frequency gamma oscillations and human brain mapping with electrocorticography. , 2006, Progress in brain research.

[14]  W. Singer,et al.  Dynamic predictions: Oscillations and synchrony in top–down processing , 2001, Nature Reviews Neuroscience.

[15]  R. Desimone,et al.  Stimulus-selective properties of inferior temporal neurons in the macaque , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  E. Halgren,et al.  Intracerebral potentials to rare target and distractor auditory and visual stimuli. III. Frontal cortex. , 1995, Electroencephalography and clinical neurophysiology.

[17]  G. McCarthy,et al.  Language-related field potentials in the anterior-medial temporal lobe: II. Effects of word type and semantic priming , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  T. Allison,et al.  Electrophysiological studies of human face perception. III: Effects of top-down processing on face-specific potentials. , 1999, Cerebral cortex.

[19]  Brian Litt,et al.  Gamma Oscillations Distinguish True From False Memories , 2007, Psychological science.

[20]  Robert Oostenveld,et al.  Visually induced gamma-band activity predicts speed of change detection in humans , 2010, NeuroImage.

[21]  O Bertrand,et al.  Silence is golden: transient neural deactivation in the prefrontal cortex during attentive reading. , 2008, Cerebral cortex.

[22]  Jayaram Chandrashekar,et al.  Sequential Processing of Lexical, Grammatical, and Phonological Information Within Broca's Area , 2009 .

[23]  O. Bertrand,et al.  Neural correlates of consolidation in working memory , 2007, Human brain mapping.

[24]  E. Fetz,et al.  Decoupling the Cortical Power Spectrum Reveals Real-Time Representation of Individual Finger Movements in Humans , 2009, The Journal of Neuroscience.

[25]  A. Mechelli,et al.  Neuroimaging Studies of Word and Pseudoword Reading: Consistencies, Inconsistencies, and Limitations , 2003, Journal of Cognitive Neuroscience.

[26]  E. Halgren,et al.  Intracerebral potentials to rare target and distractor auditory and visual stimuli. II. Medial, lateral and posterior temporal lobe. , 1995, Electroencephalography and clinical neurophysiology.

[27]  C. Koch,et al.  Sparse but not ‘Grandmother-cell’ coding in the medial temporal lobe , 2008, Trends in Cognitive Sciences.

[28]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  Brian Litt,et al.  Behavioral / Systems / Cognitive Hippocampal Gamma Oscillations Increase with Memory Load , 2010 .

[30]  C. Koch,et al.  Invariant visual representation by single neurons in the human brain , 2005, Nature.

[31]  J. Martinerie,et al.  Comparison of Hilbert transform and wavelet methods for the analysis of neuronal synchrony , 2001, Journal of Neuroscience Methods.

[32]  C. Tallon-Baudry,et al.  How Ongoing Fluctuations in Human Visual Cortex Predict Perceptual Awareness: Baseline Shift versus Decision Bias , 2009, The Journal of Neuroscience.

[33]  François Mauguière,et al.  Brain responses to success and failure: Direct recordings from human cerebral cortex , 2010, Human brain mapping.

[34]  J. Kaiser,et al.  Human gamma-frequency oscillations associated with attention and memory , 2007, Trends in Neurosciences.

[35]  E. Halgren,et al.  Intracerebral potentials to rare target and distractor auditory and visual stimuli. I. Superior temporal plane and parietal lobe. , 1995, Electroencephalography and clinical neurophysiology.

[36]  C. Koch,et al.  Category-specific visual responses of single neurons in the human medial temporal lobe , 2000, Nature Neuroscience.

[37]  A. Bruns Fourier-, Hilbert- and wavelet-based signal analysis: are they really different approaches? , 2004, Journal of Neuroscience Methods.

[38]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[39]  R. Oostenveld,et al.  Tactile Spatial Attention Enhances Gamma-Band Activity in Somatosensory Cortex and Reduces Low-Frequency Activity in Parieto-Occipital Areas , 2006, The Journal of Neuroscience.

[40]  S Lehéricy,et al.  The visual word form area: spatial and temporal characterization of an initial stage of reading in normal subjects and posterior split-brain patients. , 2000, Brain : a journal of neurology.

[41]  I. Fried,et al.  Neural “Ignition”: Enhanced Activation Linked to Perceptual Awareness in Human Ventral Stream Visual Cortex , 2009, Neuron.

[42]  R. Lesser,et al.  Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. II. Event-related synchronization in the gamma band. , 1998, Brain : a journal of neurology.

[43]  E. Halgren,et al.  Spatio-temporal stages in face and word processing. 2. Depth-recorded potentials in the human frontal and Rolandic cortices , 1994, Journal of Physiology-Paris.

[44]  Andrew D. Engell,et al.  Selective Attention Modulates Face-Specific Induced Gamma Oscillations Recorded from Ventral Occipitotemporal Cortex , 2010, The Journal of Neuroscience.

[45]  DH Hubel,et al.  Segregation of form, color, and stereopsis in primate area 18 , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  J. Martinerie,et al.  The brainweb: Phase synchronization and large-scale integration , 2001, Nature Reviews Neuroscience.

[47]  E. Halgren,et al.  Spatio-temporal stages in face and word processing. 1. Depth recorded potentials in the human occipital and parietal lobes , 1994, Journal of Physiology-Paris.

[48]  David J. Freedman,et al.  Categorical representation of visual stimuli in the primate prefrontal cortex. , 2001, Science.

[49]  T. Allison,et al.  Electrophysiological studies of human face perception. II: Response properties of face-specific potentials generated in occipitotemporal cortex. , 1999, Cerebral cortex.

[50]  R. Romo,et al.  Neuronal correlates of decision-making in secondary somatosensory cortex , 2002, Nature Neuroscience.

[51]  Philippe Kahane,et al.  Task‐related gamma‐band dynamics from an intracerebral perspective: Review and implications for surface EEG and MEG , 2009, Human brain mapping.

[52]  John-Dylan Haynes,et al.  Decoding visual consciousness from human brain signals , 2009, Trends in Cognitive Sciences.

[53]  Catherine Tallon-Baudry,et al.  Visual Grouping and the Focusing of Attention Induce Gamma-band Oscillations at Different Frequencies in Human Magnetoencephalogram Signals , 2006, Journal of Cognitive Neuroscience.

[54]  A. Parkin,et al.  Human memory , 1999, Current Biology.

[55]  Philippe Kahane,et al.  The neural bases of attentive reading , 2008, Human brain mapping.

[56]  N. Kanwisher,et al.  The fusiform face area: a cortical region specialized for the perception of faces , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[57]  Tomaso Poggio,et al.  Fast Readout of Object Identity from Macaque Inferior Temporal Cortex , 2005, Science.

[58]  Steven Pinker,et al.  Abstract Grammatical Processing of Nouns and Verbs in Broca's Area: Evidence from FMRI , 2006, Cortex.

[59]  S. Dehaene,et al.  Converging Intracranial Markers of Conscious Access , 2009, PLoS biology.

[60]  K. Grill-Spector,et al.  High-resolution imaging reveals highly selective nonface clusters in the fusiform face area , 2006, Nature Neuroscience.

[61]  Bijan Pesaran,et al.  Temporal structure in neuronal activity during working memory in macaque parietal cortex , 2000, Nature Neuroscience.

[62]  Karim Jerbi,et al.  Simultaneous MEG and intracranial EEG recordings during attentive reading , 2009, NeuroImage.

[63]  C. Elger,et al.  Human memory formation is accompanied by rhinal–hippocampal coupling and decoupling , 2001, Nature Neuroscience.

[64]  Robert Oostenveld,et al.  Localizing human visual gamma-band activity in frequency, time and space , 2006, NeuroImage.

[65]  M. Bar Visual objects in context , 2004, Nature Reviews Neuroscience.

[66]  Robert T. Knight,et al.  Hemicraniectomy: A New Model for Human Electrophysiology with High Spatio-temporal Resolution , 2010, Journal of Cognitive Neuroscience.

[67]  M. Berger,et al.  High Gamma Power Is Phase-Locked to Theta Oscillations in Human Neocortex , 2006, Science.

[68]  Jeffrey G. Ojemann,et al.  Power-Law Scaling in the Brain Surface Electric Potential , 2009, PLoS Comput. Biol..

[69]  O. Bertrand,et al.  Attention modulates gamma-band oscillations differently in the human lateral occipital cortex and fusiform gyrus. , 2005, Cerebral cortex.

[70]  Robert Oostenveld,et al.  Population activity in the human dorsal pathway predicts the accuracy of visual motion detection. , 2007, Journal of neurophysiology.

[71]  E. Halgren,et al.  Spatio-temporal stages in face and word processing. I. Depth-recorded potentials in the human occipital, temporal and parietal lobes [corrected]. , 1994, Journal of physiology, Paris.

[72]  Andreas K. Engel,et al.  Buildup of Choice-Predictive Activity in Human Motor Cortex during Perceptual Decision Making , 2009, Current Biology.

[73]  Jeremy R. Manning,et al.  Broadband Shifts in Local Field Potential Power Spectra Are Correlated with Single-Neuron Spiking in Humans , 2009, The Journal of Neuroscience.

[74]  Catherine Tallon-Baudry,et al.  The many faces of the gamma band response to complex visual stimuli , 2005, NeuroImage.

[75]  P. Fries Neuronal gamma-band synchronization as a fundamental process in cortical computation. , 2009, Annual review of neuroscience.

[76]  S. Thorpe,et al.  The Time Course of Visual Processing: From Early Perception to Decision-Making , 2001, Journal of Cognitive Neuroscience.

[77]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[78]  C. Tallon-Baudry,et al.  Neural Dissociation between Visual Awareness and Spatial Attention , 2008, The Journal of Neuroscience.

[79]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[80]  Michael J. Kahana,et al.  Neural Representations of Individual Stimuli in Humans Revealed by Gamma-Band Electrocorticographic Activity , 2009, The Journal of Neuroscience.