Object-sensitive activity reflects earlier perceptual and later cognitive processing of visual objects between 95 and 500ms

Object-sensitive areas have been defined using functional magnetic resonance imaging (fMRI), but the time course of this cortical activation is largely unknown. In a high-density, event-related brain potential (ERP) version of a prior fMRI study of object-sensitive areas, people categorized intact grayscale pictures of known objects and discriminated them from scrambled versions created by randomizing the phases of the spatial frequency spectrum; no object or parts can be discerned in scrambled versions. Both indirect functional and direct anatomical approaches were taken to integrate ERP and fMRI results. The two-state interactive account of visual object cognition predicts object-sensitivity (intact vs. scrambled) both before and after 200ms during early and later ERPs that index processes in posterior cortex critical to visual object perception and cognition. As predicted, findings from 57 participants revealed early object-sensitive activation during the P100 (95-140ms) and VPP/N170 (145-175ms), reflecting figure-ground segregation. After 200ms, activity was object-sensitive during the frontocentral N3 complex (200-500ms) implicated in cognitive decisions about visual objects, as well as a right occipitotemporal P200 (200-300ms) implicated in perceptual grouping. All effects localized to extrastriate occipitotemporal cortex. Altogether, the findings demonstrate the time course of object-sensitive activity, which is in cortical regions defined using fMRI, and indicate that processes of figure-ground segregation (95-175ms or longer), perceptual grouping (200-300ms), and object model selection for a cognitive decision (200-530ms) are achieved more for intact known objects than uncategorizable, phase scrambled versions.

[1]  G. McCarthy,et al.  Language-Related ERPs: Scalp Distributions and Modulation by Word Type and Semantic Priming , 1994, Journal of Cognitive Neuroscience.

[2]  Manfred Fuchs,et al.  Evaluation of sLORETA in the Presence of Noise and Multiple Sources , 2003, Brain Topography.

[3]  Antigona Martínez,et al.  Source analysis of event-related cortical activity during visuo-spatial attention. , 2003, Cerebral cortex.

[4]  E. Warrington.  Neuropsychological studies of object recognition. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[5]  E. Halgren,et al.  Spatiotemporal mapping of brain activity by integration of multiple imaging modalities , 2001, Current Opinion in Neurobiology.

[6]  John J. Foxe,et al.  Activation Timecourse of Ventral Visual Stream Object-recognition Areas: High Density Electrical Mapping of Perceptual Closure Processes , 2000, Journal of Cognitive Neuroscience.

[7]  L. Saksida,et al.  Visual perception and memory: a new view of medial temporal lobe function in primates and rodents. , 2007, Annual review of neuroscience.

[8]  Marta Kutas,et al.  Time Course of Processes and Representations Supporting Visual Object Identification and Memory , 2003, Journal of Cognitive Neuroscience.

[9]  S M Kosslyn,et al.  Identifying objects seen from different viewpoints. A PET investigation. , 1994, Brain : a journal of neurology.

[10]  Paul E. Downing,et al.  An event-related potential component sensitive to images of the human body , 2006, NeuroImage.

[11]  T. Allison,et al.  Electrophysiological studies of human face perception. III: Effects of top-down processing on face-specific potentials. , 1999, Cerebral cortex.

[12]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[13]  S J Luck,et al.  Direct and indirect integration of event‐related potentials, functional magnetic resonance images, and single‐unit recordings , 1999, Human brain mapping.

[14]  R. Ratcliff,et al.  Neural Representation of Task Difficulty and Decision Making during Perceptual Categorization: A Timing Diagram , 2006, The Journal of Neuroscience.

[15]  Aina Puce,et al.  Magnetoencephalographic study of occipitotemporal activity elicited by viewing mouth movements , 2004, Clinical Neurophysiology.

[16]  S. Hillyard,et al.  Cortical sources of the early components of the visual evoked potential , 2002, Human brain mapping.

[17]  G W Humphreys,et al.  Top-down processes in object identification: evidence from experimental psychology, neuropsychology and functional anatomy. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[18]  M. Banks,et al.  Sensitivity loss in odd-symmetric mechanisms and phase anomalies in peripheral vision , 1987, Nature.

[19]  Rafael Malach,et al.  Large-Scale Mirror-Symmetry Organization of Human Occipito-Temporal Object Areas , 2003, Neuron.

[20]  G. McCarthy,et al.  Language-related field potentials in the anterior-medial temporal lobe: II. Effects of word type and semantic priming , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[21]  S. Grossberg,et al.  View-invariant object category learning, recognition, and search: How spatial and object attention are coordinated using surface-based attentional shrouds , 2009, Cognitive Psychology.

[22]  S. Edelman,et al.  Differential Processing of Objects under Various Viewing Conditions in the Human Lateral Occipital Complex , 1999, Neuron.

[23]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Marta Kutas,et al.  Neurophysiological evidence for transfer appropriate processing of memory: Processing versus feature similarity , 2007, Psychonomic bulletin & review.

[25]  M. Kutas,et al.  Neurophysiological evidence for two processing times for visual object identification , 2002, Neuropsychologia.

[26]  Peter A. Robinson,et al.  Unified neurophysical model of EEG spectra and evoked potentials , 2002, Biological Cybernetics.

[27]  M. Riesenhuber,et al.  Categorization Training Results in Shape- and Category-Selective Human Neural Plasticity , 2007, Neuron.

[28]  H. E. Schendan,et al.  Visual object cognition precedes but also temporally overlaps mental rotation , 2009, Brain Research.

[29]  Pieter R Roelfsema,et al.  The role of primary visual cortex (V1) in visual awareness , 2000, Vision Research.

[30]  M. Farah.  Visual Agnosia: Disorders of Object Recognition and What They Tell Us about Normal Vision , 1990 .

[31]  G. Rousselet,et al.  Parametric study of EEG sensitivity to phase noise during face processing , 2008, BMC Neuroscience.

[32]  G. R. Mangun,et al.  Interactions between attention and perceptual grouping in human visual cortex , 2006, Brain Research.

[33]  John J. Foxe,et al.  Filling-in in schizophrenia: a high-density electrical mapping and source-analysis investigation of illusory contour processing. , 2005, Cerebral cortex.

[34]  G. Kreiman,et al.  Timing, Timing, Timing: Fast Decoding of Object Information from Intracranial Field Potentials in Human Visual Cortex , 2009, Neuron.

[35]  Anne-Catherine Bachoud-Lévi,et al.  Object memory effects on figure assignment: conscious object recognition is not necessary or sufficient , 2000, Vision Research.

[36]  A. Burton,et al.  Event-related brain potential evidence for a response of inferior temporal cortex to familiar face repetitions. , 2002, Brain research. Cognitive brain research.

[37]  D. Mumford,et al.  Neural activity in early visual cortex reflects behavioral experience and higher-order perceptual saliency , 2002, Nature Neuroscience.

[38]  Matthias M. Müller,et al.  Oscillatory brain activity in the human EEG during indirect and direct memory tasks , 2006, Brain Research.

[39]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[40]  Giorgio Ganis,et al.  Visual mental imagery and perception produce opposite adaptation effects on early brain potentials , 2008, NeuroImage.

[41]  C. Stern,et al.  Where vision meets memory: prefrontal-posterior networks for visual object constancy during categorization and recognition. , 2008, Cerebral cortex.

[42]  T. Hendler,et al.  Contrast sensitivity in human visual areas and its relationship to object recognition. , 2002, Journal of neurophysiology.

[43]  P. Sajda,et al.  Temporal characterization of the neural correlates of perceptual decision making in the human brain. , 2006, Cerebral cortex.

[44]  T. Allison,et al.  Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. , 1999, Cerebral cortex.

[45]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[46]  E. Harth,et al.  Electric Fields of the Brain: The Neurophysics of Eeg , 2005 .

[47]  N. Kanwisher,et al.  Discrimination Training Alters Object Representations in Human Extrastriate Cortex , 2006, The Journal of Neuroscience.

[48]  M. Kutas,et al.  An electrophysiological study of scene effects on object identification. , 2003, Brain research. Cognitive brain research.

[49]  N. Kanwisher,et al.  Domain specificity in visual cortex. , 2006, Cerebral cortex.

[50]  Karl J. Friston,et al.  Dynamic causal modeling of evoked responses in EEG and MEG , 2006, NeuroImage.

[51]  B. Rossion,et al.  Task modulation of brain activity related to familiar and unfamiliar face processing: an ERP study , 1999, Clinical Neurophysiology.

[52]  S. Luck.  An Introduction to the Event-Related Potential Technique , 2005 .

[53]  Haline E. Schendan,et al.  Object knowledge during entry-level categorization is activated and modified by implicit memory after 200 ms , 2009, NeuroImage.

[54]  K. Grill-Spector,et al.  The human visual cortex. , 2004, Annual review of neuroscience.

[55]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[56]  Clara D. Martin,et al.  Controlling for interstimulus perceptual variance abolishes N170 face selectivity , 2007, Nature Neuroscience.

[57]  P. Holcomb,et al.  An electrophysiological investigation of semantic priming with pictures of real objects. , 1999, Psychophysiology.

[58]  James W. Tanaka,et al.  A Reevaluation of the Electrophysiological Correlates of Expert Object Processing , 2006, Journal of Cognitive Neuroscience.

[59]  Jesse S. Husk,et al.  Time course and robustness of ERP object and face differences. , 2008, Journal of vision.

[60]  Bruno Rossion,et al.  Early lateralization and orientation tuning for face, word, and object processing in the visual cortex , 2003, NeuroImage.

[61]  M. D Rugg,et al.  The effect of repetition lag on electrophysiological and haemodynamic correlates of visual object priming , 2004, NeuroImage.

[62]  A. Young,et al.  Understanding face recognition. , 1986, British journal of psychology.

[63]  E. Halgren,et al.  Source estimates for MEG/EEG visual evoked responses constrained by multiple, retinotopically‐mapped stimulus locations , 2009, Human brain mapping.

[64]  S Ullman,et al.  Sequence seeking and counter streams: a computational model for bidirectional information flow in the visual cortex. , 1995, Cerebral cortex.

[65]  Matthias M. Müller,et al.  Brain electrical tomography (BET) analysis of induced gamma band responses during a simple object recognition task , 2006, NeuroImage.

[66]  Aina Puce,et al.  Category-sensitive excitatory and inhibitory processes in human extrastriate cortex. , 2002, Journal of neurophysiology.

[67]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[68]  A. Puce,et al.  The spatiotemporal dynamics of the face inversion effect: A magneto- and electro-encephalographic study , 2003, Neuroscience.

[69]  M M Mesulam,et al.  An electrophysiological index of stimulus unfamiliarity. , 2000, Psychophysiology.

[70]  Margot J. Taylor,et al.  Guidelines for using human event-related potentials to study cognition: recording standards and publication criteria. , 2000, Psychophysiology.

[71]  M. D’Esposito,et al.  An Area within Human Ventral Cortex Sensitive to “Building” Stimuli Evidence and Implications , 1998, Neuron.

[72]  D. V. van Essen,et al.  The Processing of Visual Shape in the Cerebral Cortex of Human and Nonhuman Primates: A Functional Magnetic Resonance Imaging Study , 2004, The Journal of Neuroscience.

[73]  K. Bötzel,et al.  Electric brain potentials evoked by pictures of faces and non-faces: a search for “face-specific” EEG-potentials , 2004, Experimental Brain Research.

[74]  A. Dale,et al.  The Representation of Illusory and Real Contours in Human Cortical Visual Areas Revealed by Functional Magnetic Resonance Imaging , 1999, The Journal of Neuroscience.

[75]  T. Allison,et al.  Human extrastriate visual cortex and the perception of faces, words, numbers, and colors. , 1994, Cerebral cortex.

[76]  L. Robertson.  Binding, spatial attention and perceptual awareness , 2003, Nature Reviews Neuroscience.

[77]  N. Kanwisher,et al.  Location and spatial profile of category‐specific regions in human extrastriate cortex , 2006, Human brain mapping.

[78]  Margot J. Taylor,et al.  Inversion and Contrast Polarity Reversal Affect both Encoding and Recognition Processes of Unfamiliar Faces: A Repetition Study Using ERPs , 2002, NeuroImage.

[79]  Eric Halgren,et al.  Cortical activation to illusory shapes as measured with magnetoencephalography , 2003, NeuroImage.

[80]  D. Heeger,et al.  Two Retinotopic Visual Areas in Human Lateral Occipital Cortex , 2006, The Journal of Neuroscience.

[81]  Chantal E. Stern,et al.  Mental rotation and object categorization share a common network of prefrontal and dorsal and ventral regions of posterior cortex , 2007, NeuroImage.

[82]  P. Sajda,et al.  EEG-Informed fMRI Reveals Spatiotemporal Characteristics of Perceptual Decision Making , 2007, The Journal of Neuroscience.

[83]  R D Pascual-Marqui,et al.  Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. , 2002, Methods and findings in experimental and clinical pharmacology.

[84]  Lihua Mao,et al.  Attentional modulation of perceptual grouping in human visual cortex: ERP studies , 2005, Human brain mapping.

[85]  Karl J. Friston,et al.  Modelling event-related responses in the brain , 2005, NeuroImage.

[86]  Barbara Anne Dosher,et al.  Visual perceptual learning , 2011, Neurobiology of Learning and Memory.

[87]  T. Allison,et al.  Word recognition in the human inferior temporal lobe , 1994, Nature.

[88]  P. Holcomb,et al.  Event-Related Brain Potentials Reflect Semantic Priming in an Object Decision Task , 1994, Brain and Cognition.

[89]  E. Halgren,et al.  Intracerebral potentials to rare target and distractor auditory and visual stimuli. I. Superior temporal plane and parietal lobe. , 1995, Electroencephalography and clinical neurophysiology.

[90]  Russell A. Epstein,et al.  Cortical correlates of face and scene inversion: A comparison , 2006, Neuropsychologia.

[91]  D. Lehmann,et al.  Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain. , 1994, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[92]  Bruno Rossion,et al.  Parametric design and correlational analyses help integrating fMRI and electrophysiological data during face processing , 2004, NeuroImage.

[93]  Alex R. Wade,et al.  Visual field maps and stimulus selectivity in human ventral occipital cortex , 2005, Nature Neuroscience.

[94]  Pejman Sehatpour,et al.  A human intracranial study of long-range oscillatory coherence across a frontal–occipital–hippocampal brain network during visual object processing , 2008, Proceedings of the National Academy of Sciences.

[95]  A. Treisman.  How the deployment of attention determines what we see , 2006, Visual cognition.

[96]  M. Kutas,et al.  Neurophysiological evidence for visual perceptual categorization of words and faces within 150 ms. , 1998, Psychophysiology.

[97]  M. Kutas,et al.  The Search for Common Sense: An Electrophysiological Study of the Comprehension of Words and Pictures in Reading , 1996, Journal of Cognitive Neuroscience.

[98]  C. B. Cave,et al.  The Role of Parts and Spatial Relations in Object Identification , 1993, Perception.

[99]  Stephen M. Kosslyn,et al.  Neuroimaging evidence for object model verification theory: Role of prefrontal control in visual object categorization , 2007, NeuroImage.

[100]  Jonathan R. Folstein,et al.  Multidimensional rule, unidimensional rule, and similarity strategies in categorization: event-related brain potential correlates. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[101]  Pejman Sehatpour,et al.  Spatiotemporal dynamics of human object recognition processing: An integrated high-density electrical mapping and functional imaging study of “closure” processes , 2006, NeuroImage.

[102]  R. Henson,et al.  Priming, response learning and repetition suppression , 2008, Neuropsychologia.

[103]  John J. Foxe,et al.  Parvocellular and Magnocellular Contributions to the Initial Generators of the Visual Evoked Potential: High-Density Electrical Mapping of the “C1” Component , 2008, Brain Topography.

[104]  D. Jeffreys.  Evoked Potential Studies of Face and Object Processing , 1996 .

[105]  M. Tarr,et al.  The N170 occipito‐temporal component is delayed and enhanced to inverted faces but not to inverted objects: an electrophysiological account of face‐specific processes in the human brain , 2000, Neuroreport.

[106]  H. Eichenbaum,et al.  The medial temporal lobe and recognition memory. , 2007, Annual review of neuroscience.

[107]  Yaoda Xu,et al.  Distinctive Neural Mechanisms Supporting Visual Object Individuation and Identification , 2009, Journal of Cognitive Neuroscience.

[108]  S. Edelman,et al.  Human Brain Mapping 6:316–328(1998) � A Sequence of Object-Processing Stages Revealed by fMRI in the Human Occipital Lobe , 2022 .

[109]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[110]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[111]  Marta Kutas,et al.  Neurophysiological Evidence for the Time Course of Activation of Global Shape, Part, and Local Contour Representations during Visual Object Categorization and Memory , 2007, Journal of Cognitive Neuroscience.

[112]  T. Allison,et al.  Electrophysiological studies of human face perception. II: Response properties of face-specific potentials generated in occipitotemporal cortex. , 1999, Cerebral cortex.

[113]  Margot J. Taylor,et al.  Source analysis of the N170 to faces and objects , 2004, Neuroreport.

[114]  John J. Foxe,et al.  Visual Perceptual Learning in Human Object Recognition Areas: A Repetition Priming Study Using High-Density Electrical Mapping , 2001, NeuroImage.

[115]  Guillaume A. Rousselet,et al.  Single-trial EEG dynamics of object and face visual processing , 2007, NeuroImage.

[116]  K. Grill-Spector,et al.  The dynamics of object-selective activation correlate with recognition performance in humans , 2000, Nature Neuroscience.

[117]  K. Koffka.  Principles Of Gestalt Psychology , 1936 .

[118]  T. Hendler,et al.  A hierarchical axis of object processing stages in the human visual cortex. , 2001, Cerebral cortex.

[119]  A. J. Mistlin,et al.  Visual neurones responsive to faces , 1987, Trends in Neurosciences.

[120]  R. McCarley,et al.  Functional and structural deficits in brain regions subserving face perception in schizophrenia. , 2006, The American journal of psychiatry.

[121]  G. V. Van Hoesen,et al.  Prosopagnosia , 1982, Neurology.

[122]  Margot J. Taylor,et al.  N170 or N1? Spatiotemporal differences between object and face processing using ERPs. , 2004, Cerebral cortex.

[123]  Jesse S. Husk,et al.  Spatial scaling factors explain eccentricity effects on face ERPs. , 2005, Journal of vision.

[124]  S. Grossberg.  How does the cerebral cortex work? Learning, attention, and grouping by the laminar circuits of visual cortex. , 1999, Spatial vision.