Non-retinotopic feature integration decreases response-locked brain activity as revealed by electrical neuroimaging

When presented with dynamic scenes, the brain integrates visual elements across space and time. Such non-retinotopic processing has been intensively studied from a psychophysical point of view, but little is known about the underlying neural processes. Here we used high-density EEG to reveal neural correlates of non-retinotopic feature integration. In an offset-discrimination task we presented sequences of lines for which feature integration depended on a small, endogenous shift of attention. Attention effects were observed in the stimulus-locked evoked potentials but non-retinotopic feature integration was reflected in voltage topographies time-locked to the behavioral response, lasting for about 400 ms. Statistical parametric mapping of estimated current densities revealed that this integration reduced electrical activity in an extensive network of brain areas, with the effects progressing from high-level visual, via frontal, to central ones. The results suggest that endogenously timed neural processes, rather than bottom-up ones, underlie non-retinotopic feature integration.

[1]  M. Walton,et al.  Action sets and decisions in the medial frontal cortex , 2004, Trends in Cognitive Sciences.

[2]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.

[3]  C Koch,et al.  Seeing properties of an invisible object: Feature inheritance and shine-through , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[4]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[5]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[6]  Adrian T. Lee,et al.  fMRI of human visual cortex , 1994, Nature.

[7]  O. Blanke,et al.  Motion direction tuning in human visual cortex , 2009, The European journal of neuroscience.

[8]  J. Driver,et al.  Visibility Reflects Dynamic Changes of Effective Connectivity between V1 and Fusiform Cortex , 2005, Neuron.

[9]  D. Bates,et al.  Mixed-Effects Models in S and S-PLUS , 2001 .

[10]  M. Murray,et al.  EEG source imaging , 2004, Clinical Neurophysiology.

[11]  D Lehmann,et al.  EEG assessment of brain activity: spatial aspects, segmentation and imaging. , 1984, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[12]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[13]  Andreas A. Ioannides,et al.  Consistent and precise localization of brain activity in human primary visual cortex by MEG and fMRI , 2003, NeuroImage.

[14]  Talis Bachmann.  Psychophysiology of Visual Masking: The Fine Structure of Conscious Experience , 1994 .

[15]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[16]  S. Morand,et al.  Electric source imaging of human brain functions , 2001, Brain Research Reviews.

[17]  R. Andersen,et al.  Functional analysis of human MT and related visual cortical areas using magnetic resonance imaging , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  Roland R. Lee,et al.  Temporal dynamics of ipsilateral and contralateral motor activity during voluntary finger movement , 2004, Human brain mapping.

[19]  Clara D. Martin,et al.  Controlling for interstimulus perceptual variance abolishes N170 face selectivity , 2007, Nature Neuroscience.

[20]  C. Michel,et al.  Electromagnetic Inverse Solutions in Anatomically Constrained Spherical Head Models , 2004, Brain Topography.

[21]  K. R. Ridderinkhof,et al.  The Role of the Medial Frontal Cortex in Cognitive Control , 2004, Science.

[22]  Michael H Herzog,et al.  Shape distortions and Gestalt grouping in anorthoscopic perception. , 2009, Journal of vision.

[23]  Stephen A. Engel,et al.  Regional Brain Activity Associated with Visual Backward Masking , 2005, Journal of Cognitive Neuroscience.

[24]  T. Koenig,et al.  Brain electric microstates and momentary conscious mind states as building blocks of spontaneous thinking: I. Visual imagery and abstract thoughts. , 1998, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[25]  M. M. Taylor,et al.  PEST: Efficient Estimates on Probability Functions , 1967 .

[26]  M. Bar,et al.  Cortical Mechanisms Specific to Explicit Visual Object Recognition , 2001, Neuron.

[27]  O. Blanke,et al.  Neural Basis of Embodiment: Distinct Contributions of Temporoparietal Junction and Extrastriate Body Area , 2006, The Journal of Neuroscience.

[28]  D. Lehmann,et al.  Reference-free identification of components of checkerboard-evoked multichannel potential fields. , 1980, Electroencephalography and clinical neurophysiology.

[29]  C M Michel,et al.  Visual activity in the human frontal eye field. , 1999, Neuroreport.

[30]  R. M. Siegel,et al.  Maps of Visual Space in Human Occipital Cortex Are Retinotopic, Not Spatiotopic , 2008, The Journal of Neuroscience.

[31]  Thomas U. Otto,et al.  The flight path of the phoenix--the visible trace of invisible elements in human vision. , 2006, Journal of vision.

[32]  T. Sejnowski,et al.  Dynamic Brain Sources of Visual Evoked Responses , 2002, Science.

[33]  Leslie G. Ungerleider,et al.  Increased Activity in Human Visual Cortex during Directed Attention in the Absence of Visual Stimulation , 1999, Neuron.

[34]  Alan C. Evans,et al.  A Three-Dimensional Statistical Analysis for CBF Activation Studies in Human Brain , 1992, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[35]  Luiz Pessoa,et al.  Quantitative prediction of perceptual decisions during near-threshold fear detection. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[36]  S. Nishida,et al.  Human Visual System Integrates Color Signals along a Motion Trajectory , 2007, Current Biology.

[37]  J. Hirsch,et al.  A Neural Representation of Categorization Uncertainty in the Human Brain , 2006, Neuron.

[38]  S S Shimozaki,et al.  The maintenance of apparent luminance of an object. , 1999, Journal of experimental psychology. Human perception and performance.

[39]  Á. Pascual-Leone,et al.  Linking Out-of-Body Experience and Self Processing to Mental Own-Body Imagery at the Temporoparietal Junction , 2005, The Journal of Neuroscience.

[40]  S J Luck,et al.  Visual event-related potentials index focused attention within bilateral stimulus arrays. I. Evidence for early selection. , 1990, Electroencephalography and clinical neurophysiology.

[41]  Denis Brunet,et al.  Topographic ERP Analyses: A Step-by-Step Tutorial Review , 2008, Brain Topography.

[42]  Michael H. Herzog,et al.  Motion, Not Masking, Provides the Medium for Feature Attribution , 2008, Psychological science.

[43]  Takahiro Kawabe,et al.  Spatiotemporal feature attribution for the perception of visual size. , 2008, Journal of vision.

[44]  Junji Watanabe,et al.  Veridical perception of moving colors by trajectory integration of input signals. , 2007, Journal of vision.

[45]  M. Hallett,et al.  Cerebral structures participating in motor preparation in humans: a positron emission tomography study. , 1996, Journal of neurophysiology.

[46]  A. Mizuno,et al.  A change of the leading player in flow Visualization technique , 2006, J. Vis..

[47]  Thomas U. Otto,et al.  Feature integration across space, time, and orientation. , 2009, Journal of experimental psychology. Human perception and performance.

[48]  Cees van Leeuwen,et al.  Functional specialization and dynamic resource allocation in visual cortex , 2010, Human brain mapping.

[49]  Haluk Öğmen,et al.  Perceptual grouping induces non-retinotopic feature attribution in human vision , 2006, Vision Research.

[50]  A. A. Ioannides,et al.  Neural correlates of priming on occluded figure interpretation in human fusiform cortex , 2006, Neuroscience.

[51]  Christoph M. Michel,et al.  Electrical neuroimaging based on biophysical constraints , 2004, NeuroImage.

[52]  D Lehmann,et al.  EEG alpha map series: brain micro-states by space-oriented adaptive segmentation. , 1987, Electroencephalography and clinical neurophysiology.

[53]  R. Pascual-Marqui.  Review of methods for solving the EEG inverse problem , 1999 .

[54]  S. Thorpe,et al.  Seeking Categories in the Brain , 2001, Science.

[55]  M. Torrens.  Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[56]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[57]  A. Dale,et al.  Functional analysis of primary visual cortex (V1) in humans. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[58]  S. Quartz,et al.  Human Insula Activation Reflects Risk Prediction Errors As Well As Risk , 2008, The Journal of Neuroscience.

[59]  F. Perrin,et al.  Mapping of scalp potentials by surface spline interpolation. , 1987, Electroencephalography and clinical neurophysiology.

[60]  D. Schacter,et al.  Perceptual specificity in visual object priming: functional magnetic resonance imaging evidence for a laterality difference in fusiform cortex , 2001, Neuropsychologia.

[61]  D. Lehmann,et al.  Segmentation of brain electrical activity into microstates: model estimation and validation , 1995, IEEE Transactions on Biomedical Engineering.

[62]  John J. Foxe,et al.  Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. , 2005, Cerebral cortex.

[63]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[64]  S. Hillyard,et al.  Event-related brain potentials in the study of visual selective attention. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[65]  D. Schacter,et al.  The neural origins of specific and general memory: the role of the fusiform cortex , 2005, Neuropsychologia.

[66]  M. Sereno,et al.  Mapping of Contralateral Space in Retinotopic Coordinates by a Parietal Cortical Area in Humans , 2001, Science.

[67]  Mark D'Esposito,et al.  Cognitive Association Formation in Human Memory Revealed by Spatiotemporal Brain Imaging , 2001, Neuron.

[68]  E. Halgren,et al.  Location of human face‐selective cortex with respect to retinotopic areas , 1999, Human brain mapping.

[69]  M. Bach,et al.  The Freiburg Visual Acuity test--automatic measurement of visual acuity. , 1996, Optometry and vision science : official publication of the American Academy of Optometry.

[71]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[72]  Haluk Öğmen,et al.  Perceived speed differences explain apparent compression in slit viewing , 2008, Vision Research.

[73]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[74]  Patrick Cavanagh,et al.  Mobile computation: spatiotemporal integration of the properties of objects in motion. , 2008, Journal of vision.