Temporal dynamics of face selection mechanism in the context of similar and dissimilar faces: ERP evidence for biased competition within the ventral occipito-temporal cortex using ICA

This study was designed to investigate the spatio-temporal characteristic of face selection in the context of the Biased Competition (BC) model using electroencephalography (EEG). Pairs of similar (SIM) or dissimilar (DISS) faces were presented simultaneously. Subjects had to attend to one face (ATT) or ignore both faces (IGN). According to the BC account, simultaneously presented faces compete for representation. Spatial attention biases these competitive interactions towards neural processing of the attended face alone. A preceding functional magnetic resonance imaging (fMRI) study confirmed the validity of BC as selection principle in the occipital face area (OFA) and in the fusiform face area (FFA) (IGN SIM<IGN DISS; ATT SIM=ATT DISS) (Gentile and Jansma, 2010). The directionality of the similarity modulation within the IGN condition was interpreted in line with the assumption that within FFA similar faces are more likely to be encoded by largely overlapping population of neurons, hence leading to a stronger competition. In the present EEG experiment we investigated when neural competition and the bias effect take place. Using independent component analysis (ICA), we focused on face-processing-related components N170 and N250. Whereas we could not find any context-dependent modulation of the N170, we observed a context x task interaction within the N250 time-window. Together, the fMRI and EEG results suggested that faces competed for representation (IGN SIM<IGN DISS) in the N250 time-window within FFA. In addition, at the same latency (250 ms post-stimulus onset) and region of interest (FFA) the data supported the idea that attention solved neural competition in favor of the relevant face (ATT SIM=ATT DISS). We also observed a main effect of attention frontally within the N2b time-window, i.e. about 50 ms later than the attentional bias that solved competitive interactions. Based on these findings, it is plausible to conclude that this frontal activity was not directly involved in the bias control during selection in FFA.

[1]  H. Hawkins,et al.  Visual attention modulates signal detectability. , 1990, Journal of experimental psychology. Human perception and performance.

[2]  E. Williams.  Experimental Designs Balanced for the Estimation of Residual Effects of Treatments , 1949 .

[3]  E. DeYoe,et al.  A physiological correlate of the 'spotlight' of visual attention , 1999, Nature Neuroscience.

[4]  Scott Makeig,et al.  Information-based modeling of event-related brain dynamics. , 2006, Progress in brain research.

[5]  K. Bötzel,et al.  Scalp topography and analysis of intracranial sources of face-evoked potentials , 2004, Experimental Brain Research.

[6]  R. Desimone,et al.  High-Frequency, Long-Range Coupling Between Prefrontal and Visual Cortex During Attention , 2009, Science.

[7]  James W. Tanaka,et al.  Activation of Preexisting and Acquired Face Representations: The N250 Event-related Potential as an Index of Face Familiarity , 2006, Journal of Cognitive Neuroscience.

[8]  Mark Steyvers,et al.  Predicting Similarity Ratings to Faces using Physical Descriptions , 2000 .

[9]  J. Theeuwes.  Top-down and bottom-up control of visual selection. , 2010, Acta psychologica.

[10]  Karl J. Friston,et al.  Population-level inferences for distributed MEG source localization under multiple constraints: Application to face-evoked fields , 2007, NeuroImage.

[11]  R. Desimone.  Visual attention mediated by biased competition in extrastriate visual cortex. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[12]  Dietrich Lehmann,et al.  Affective Judgments of Faces Modulate Early Activity (∼160 ms) within the Fusiform Gyri , 2002, NeuroImage.

[13]  R. Desimone,et al.  Responses of Neurons in Inferior Temporal Cortex during Memory- Guided Visual Search , 1998 .

[14]  Stefan Pollmann,et al.  Neural basis of redundancy effects in visual object categorization , 2007, Neuroscience Letters.

[15]  M. Tanifuji,et al.  Cortical Columnar Organization Is Reconsidered in Inferior Temporal Cortex , 2008, Cerebral cortex.

[16]  Leslie G. Ungerleider,et al.  Neuroimaging Studies of Attention: From Modulation of Sensory Processing to Top-Down Control , 2003, The Journal of Neuroscience.

[17]  M. Young,et al.  Sparse population coding of faces in the inferotemporal cortex. , 1992, Science.

[18]  N. Kanwisher,et al.  Covert visual attention modulates face-specific activity in the human fusiform gyrus: fMRI study. , 1998, Journal of neurophysiology.

[19]  T. Sejnowski,et al.  Functionally Independent Components of the Late Positive Event-Related Potential during Visual Spatial Attention , 1999, The Journal of Neuroscience.

[20]  A. Mizuno,et al.  A change of the leading player in flow Visualization technique , 2006, J. Vis..

[21]  R. Desimone,et al.  The Role of Neural Mechanisms of Attention in Solving the Binding Problem , 1999, Neuron.

[22]  S. Tipper,et al.  Negative priming between pictures and words in a selective attention task: Evidence for semantic processing of ignored stimuli , 1988, Memory & cognition.

[23]  Kenneth F. Valyear,et al.  The fusiform face area is not sufficient for face recognition: Evidence from a patient with dense prosopagnosia and no occipital face area , 2006, Neuropsychologia.

[24]  G H Recanzone,et al.  Spatial processing in the auditory cortex of the macaque monkey. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[25]  A. Engel,et al.  What is novel in the novelty oddball paradigm? Functional significance of the novelty P3 event-related potential as revealed by independent component analysis. , 2005, Brain research. Cognitive brain research.

[26]  B. Jansma,et al.  Neural competition through visual similarity in face selection , 2010, Brain Research.

[27]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[28]  J Duncan,et al.  Responses of neurons in macaque area V4 during memory-guided visual search. , 2001, Cerebral cortex.

[29]  Arthur Gilbert Bills.  The effects of mental fatigue. , 1934 .

[30]  Arnaud Delorme,et al.  Frontal midline EEG dynamics during working memory , 2005, NeuroImage.

[31]  C. Jacques,et al.  Concurrent processing reveals competition between visual representations of faces , 2004, Neuroreport.

[32]  Minami Ito,et al.  Columns for visual features of objects in monkey inferotemporal cortex , 1992, Nature.

[33]  Bruno Rossion,et al.  Does physical interstimulus variance account for early electrophysiological face sensitive responses in the human brain? Ten lessons on the N170 , 2008, NeuroImage.

[34]  A. Burton,et al.  N250r: a face-selective brain response to stimulus repetitions , 2004, Neuroreport.

[35]  John H. R. Maunsell,et al.  Attentional modulation of visual motion processing in cortical areas MT and MST , 1996, Nature.

[36]  Penny L. Yee,et al.  Semantic inhibition of Ignored Words during a Figure Classification Task , 1991, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[37]  S J Luck,et al.  Effects of spatial cuing on luminance detectability: psychophysical and electrophysiological evidence for early selection. , 1994, Journal of experimental psychology. Human perception and performance.

[38]  Hisao Nishijo,et al.  Generators of Visual Evoked Potentials for Faces and Eyes in the Human Brain as Determined by Dipole Localization , 2004, Brain Topography.

[39]  Katherine M. Armstrong,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2003, Nature.

[40]  Leslie G. Ungerleider,et al.  The neural basis of biased competition in human visual cortex , 2001, Neuropsychologia.

[41]  I. Tarkka,et al.  Familiar-face recognition and comparison: source analysis of scalp-recorded event-related potentials , 2004, Clinical Neurophysiology.

[42]  E. Halgren,et al.  Location of human face‐selective cortex with respect to retinotopic areas , 1999, Human brain mapping.

[43]  M. Posner,et al.  Attention and the detection of signals. , 1980, Journal of experimental psychology.

[44]  Takashi R Sato,et al.  Neuronal Basis of Covert Spatial Attention in the Frontal Eye Field , 2005, The Journal of Neuroscience.

[45]  Mark W. Greenlee,et al.  Position-specific and position-invariant face aftereffects reflect the adaptation of different cortical areas , 2008, NeuroImage.

[46]  R. Desimone,et al.  Attention Increases Sensitivity of V4 Neurons , 2000, Neuron.

[47]  Leslie G. Ungerleider,et al.  Increased Activity in Human Visual Cortex during Directed Attention in the Absence of Visual Stimulation , 1999, Neuron.

[48]  Maarten A. S. Boksem,et al.  Effects of mental fatigue on attention: an ERP study. , 2005, Brain research. Cognitive brain research.

[49]  M. Tarr,et al.  The Fusiform Face Area is Part of a Network that Processes Faces at the Individual Level , 2000, Journal of Cognitive Neuroscience.

[50]  A. Burton,et al.  Event-related brain potential evidence for a response of inferior temporal cortex to familiar face repetitions. , 2002, Brain research. Cognitive brain research.

[51]  J. Haxby,et al.  Dissociation of face-selective cortical responses by attention. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[52]  Rainer Goebel,et al.  Receptive field size-dependent attention effects in simultaneously presented stimulus displays , 2006, NeuroImage.

[53]  Lars Riecke,et al.  Hearing Illusory Sounds in Noise: The Timing of Sensory-Perceptual Transformations in Auditory Cortex , 2009, Neuron.

[54]  A. Engel,et al.  Trial-by-Trial Coupling of Concurrent Electroencephalogram and Functional Magnetic Resonance Imaging Identifies the Dynamics of Performance Monitoring , 2005, The Journal of Neuroscience.

[55]  D. Jeffreys.  A face-responsive potential recorded from the human scalp , 2004, Experimental Brain Research.

[56]  K. Grill-Spector,et al.  The human visual cortex. , 2004, Annual review of neuroscience.

[57]  R. Desimone,et al.  Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. , 1997, Journal of neurophysiology.

[58]  A. A. Wijers,et al.  Memory search and visual spatial attention: an event-related brain potential analysis. , 1985, Acta psychologica.

[59]  Ann-Christine Ehlis,et al.  Source Localization of Early Stages of Face Processing , 2005, Brain Topography.

[60]  E. Miller,et al.  Suppression of visual responses of neurons in inferior temporal cortex of the awake macaque by addition of a second stimulus , 1993, Brain Research.

[61]  S Makeig,et al.  Functionally independent components of early event-related potentials in a visual spatial attention task. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[62]  T. Poggio,et al.  Object Selectivity of Local Field Potentials and Spikes in the Macaque Inferior Temporal Cortex , 2006, Neuron.

[63]  Bruno Rossion,et al.  Electrophysiological evidence for temporal dissociation between spatial attention and sensory competition during human face processing. , 2006, Cerebral cortex.

[64]  A. Burton,et al.  Brain responses to repetitions of human and animal faces, inverted faces, and objects — An MEG study , 2007, Brain Research.

[65]  A. A. Wijers,et al.  Brain potentials during selective attention, memory search, and mental rotation. , 1989, Psychophysiology.

[66]  Mart Bles,et al.  Phonological processing of ignored distractor pictures, an fMRI investigation , 2008, BMC Neuroscience.

[67]  Leslie G. Ungerleider,et al.  Mechanisms of directed attention in the human extrastriate cortex as revealed by functional MRI. , 1998, Science.

[68]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.

[69]  Ichiro Fujita,et al.  Quantitative analysis of functional clustering of neurons in the macaque inferior temporal cortex , 2005, Neuroscience Research.

[70]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[71]  T. Moore,et al.  Microstimulation of the frontal eye field and its effects on covert spatial attention. , 2004, Journal of neurophysiology.

[72]  M. Riesenhuber,et al.  Evaluation of a Shape-Based Model of Human Face Discrimination Using fMRI and Behavioral Techniques , 2006, Neuron.

[73]  G Mulder,et al.  Attention to color: an analysis of selection, controlled search, and motor activation, using event-related potentials. , 1989, Psychophysiology.

[74]  Leslie G. Ungerleider,et al.  Modulation of sensory suppression: implications for receptive field sizes in the human visual cortex. , 2001, Journal of neurophysiology.

[75]  A. Treisman.  Strategies and models of selective attention. , 1969, Psychological review.

[76]  M. Carrasco,et al.  Attention alters appearance , 2004, Nature Neuroscience.

[77]  Dietrich Lehmann,et al.  Affective judgments of faces modulate early activity (approximately 160 ms) within the fusiform gyri. , 2002, NeuroImage.

[78]  C. Jacques,et al.  The time course of visual competition to the presentation of centrally fixated faces. , 2006, Journal of vision.

[79]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[80]  C. Jacques,et al.  The initial representation of individual faces in the right occipito-temporal cortex is holistic: electrophysiological evidence from the composite face illusion. , 2009, Journal of vision.

[81]  S. Hillyard,et al.  Selective attention to color and location: An analysis with event-related brain potentials , 1984, Perception & psychophysics.

[82]  Hossein Esteky,et al.  A study of N250 event-related brain potential during face and non-face detection tasks. , 2009, Journal of vision.

[83]  Stefan R Schweinberger,et al.  Age-related slowing in face and name recognition: evidence from event-related brain potentials. , 2002, Psychology and aging.

[84]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[85]  Gabriel Curio,et al.  MEG/EEG sources of the 170-ms response to faces are co-localized in the fusiform gyrus , 2007, NeuroImage.

[86]  R. Näätänen,et al.  Sequential effects on the ERP in discriminating two stimuli , 1983, Biological Psychology.

[87]  J. J. Lange,et al.  Color selection and location selection in ERPs: differences, similarities and `neural specificity' , 1998, Biological Psychology.

[88]  Richard N. A. Henson,et al.  Effect of spatial attention on stimulus-specific haemodynamic repetition effects , 2007, NeuroImage.

[89]  S. Kastner,et al.  Stimulus context modulates competition in human extrastriate cortex , 2005, Nature Neuroscience.

[90]  S. Makeig,et al.  Mining event-related brain dynamics , 2004, Trends in Cognitive Sciences.

[91]  Bruno Rossion,et al.  Early lateralization and orientation tuning for face, word, and object processing in the visual cortex , 2003, NeuroImage.

[92]  Martin Eimer,et al.  The top-down control of visual selection and how it is linked to the N2pc component. , 2010, Acta psychologica.

[93]  H. Jasper,et al.  The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[94]  Marianna D. Eddy,et al.  Masked repetition priming and event-related brain potentials: a new approach for tracking the time-course of object perception. , 2006, Psychophysiology.

[95]  Tutis Vilis,et al.  fMRI reveals greater within‐ than between‐hemifield integration in the human lateral occipital cortex , 2008, The European journal of neuroscience.

[96]  T. Sejnowski,et al.  Dynamic Brain Sources of Visual Evoked Responses , 2002, Science.

[97]  Keiji Tanaka.  Columns for complex visual object features in the inferotemporal cortex: clustering of cells with similar but slightly different stimulus selectivities. , 2003, Cerebral cortex.

[98]  S. Kastner,et al.  Stimulus similarity modulates competitive interactions in human visual cortex. , 2007, Journal of vision.

[99]  H. Wilson,et al.  fMRI evidence for the neural representation of faces , 2005, Nature Neuroscience.

[100]  R. Desimone,et al.  Competitive Mechanisms Subserve Attention in Macaque Areas V2 and V4 , 1999, The Journal of Neuroscience.

[101]  M. Seghier,et al.  A network of occipito-temporal face-sensitive areas besides the right middle fusiform gyrus is necessary for normal face processing. , 2003, Brain : a journal of neurology.

[102]  A. Longoni,et al.  Semantic processing of unattended parafoveal words. , 1991, Acta psychologica.

[103]  Keiji Tanaka,et al.  Functional architecture in monkey inferotemporal cortex revealed by in vivo optical imaging , 1998, Neuroscience Research.

[104]  S. Luck,et al.  Electrophysiological correlates of feature analysis during visual search. , 1994, Psychophysiology.

[105]  Stefan Treue,et al.  Feature-based attention influences motion processing gain in macaque visual cortex , 1999, Nature.

[106]  R. VanRullen,et al.  Attention and biased competition in multi-voxel object representations , 2009, Proceedings of the National Academy of Sciences.