Modeling Single-Trial ERP Reveals Modulation of Bottom-Up Face Visual Processing by Top-Down Task Constraints (in Some Subjects)

We studied how task constraints modulate the relationship between single-trial event-related potentials (ERPs) and image noise. Thirteen subjects performed two interleaved tasks: on different blocks, they saw the same stimuli, but they discriminated either between two faces or between two colors. Stimuli were two pictures of red or green faces that contained from 10 to 80% of phase noise, with 10% increments. Behavioral accuracy followed a noise dependent sigmoid in the identity task but was high and independent of noise level in the color task. EEG data recorded concurrently were analyzed using a single-trial ANCOVA: we assessed how changes in task constraints modulated ERP noise sensitivity while regressing out the main ERP differences due to identity, color, and task. Single-trial ERP sensitivity to image phase noise started at about 95–110 ms post-stimulus onset. Group analyses showed a significant reduction in noise sensitivity in the color task compared to the identity task from about 140 ms to 300 ms post-stimulus onset. However, statistical analyses in every subject revealed different results: significant task modulation occurred in 8/13 subjects, one showing an increase and seven showing a decrease in noise sensitivity in the color task. Onsets and durations of effects also differed between group and single-trial analyses: at any time point only a maximum of four subjects (31%) showed results consistent with group analyses. We provide detailed results for all 13 subjects, including a shift function analysis that revealed asymmetric task modulations of single-trial ERP distributions. We conclude that, during face processing, bottom-up sensitivity to phase noise can be modulated by top-down task constraints, in a broad window around the P2, at least in some subjects.

[1]  Marie L. Smith,et al.  From a face to its category via a few information processing states in the brain , 2007, NeuroImage.

[2]  Lucy S. Petro,et al.  Dynamics of Visual Information Integration in the Brain for Categorizing Facial Expressions , 2007, Current Biology.

[3]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[4]  S. Thorpe,et al.  Seeking Categories in the Brain , 2001, Science.

[5]  K. Bötzel,et al.  Electric brain potentials evoked by pictures of faces and non-faces: a search for “face-specific” EEG-potentials , 2004, Experimental Brain Research.

[6]  G. Kreiman,et al.  Timing, Timing, Timing: Fast Decoding of Object Information from Intracranial Field Potentials in Human Visual Cortex , 2009, Neuron.

[7]  Jesse S. Husk,et al.  Age-related delay in information accrual for faces: Evidence from a parametric, single-trial EEG approach , 2009, BMC Neuroscience.

[8]  Limits of ERP differences in tracking object processing speed. , 2007 .

[9]  M. Ruz,et al.  Category expectations: A differential modulation of the N170 potential for faces and words , 2010, Neuropsychologia.

[10]  Peter Kovesi,et al.  Image Features from Phase Congruency , 1995 .

[11]  P. Bennett,et al.  Identification of band-pass filtered letters and faces by human and ideal observers , 1999, Vision Research.

[12]  E. Wagenmakers.  A practical solution to the pervasive problems ofp values , 2007, Psychonomic bulletin & review.

[13]  Éva M. Bankó,et al.  Dissociating the Effect of Noise on Sensory Processing and Overall Decision Difficulty , 2011, The Journal of Neuroscience.

[14]  Bruno A Olshausen,et al.  Timecourse of neural signatures of object recognition. , 2003, Journal of vision.

[15]  Jean-François Démonet,et al.  Specific, selective or preferential: Comments on category specificity in neuroimaging , 2007, NeuroImage.

[16]  P. Schyns,et al.  A principled method for determining the functionality of brain responses , 2003, Neuroreport.

[17]  Søren K. Andersen,et al.  Feature-selective attention: Evidence for a decline in old age , 2010, Neuroscience Letters.

[18]  Philippe G. Schyns,et al.  Dynamics of Trimming the Content of Face Representations for Categorization in the Brain , 2009, PLoS Comput. Biol..

[19]  P. Sajda,et al.  EEG-Informed fMRI Reveals Spatiotemporal Characteristics of Perceptual Decision Making , 2007, The Journal of Neuroscience.

[20]  D. Jeffreys,et al.  Evoked potential evidence for human brain mechanisms that respond to single, fixated faces , 2004, Experimental Brain Research.

[21]  Margot J. Taylor,et al.  Is the face‐sensitive N170 the only ERP not affected by selective attention? , 2000, Neuroreport.

[22]  A. A. Ioannides,et al.  The timing of face selectivity and attentional modulation in visual processing , 2008, Neuroscience.

[23]  Bruno Rossion,et al.  Does physical interstimulus variance account for early electrophysiological face sensitive responses in the human brain? Ten lessons on the N170 , 2008, NeuroImage.

[24]  M. Eimer.  Effects of face inversion on the structural encoding and recognition of faces. Evidence from event-related brain potentials. , 2000, Brain research. Cognitive brain research.

[25]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[26]  T. Allison,et al.  Electrophysiological studies of human face perception. III: Effects of top-down processing on face-specific potentials. , 1999, Cerebral cortex.

[27]  D. Jeffreys,et al.  The vertex-positive scalp potential evoked by faces and by objects , 2004, Experimental Brain Research.

[28]  Frédéric Gosselin,et al.  Information processing algorithms in the brain , 2009, Trends in Cognitive Sciences.

[29]  Ilona Berkovits,et al.  Bootstrap Resampling Approaches for Repeated Measure Designs: Relative Robustness to Sphericity and Normality Violations , 2000 .

[30]  Marty G. Woldorff,et al.  Face Processing is Gated by Visual Spatial Attention , 2007, Frontiers in human neuroscience.

[31]  G. Rousselet,et al.  How do amplitude spectra influence rapid animal detection? , 2009, Vision Research.

[32]  J. Haxby,et al.  Dissociation of face-selective cortical responses by attention. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[33]  L. Trahms,et al.  Looking for faces: Attention modulates early occipitotemporal object processing. , 2004, Psychophysiology.

[34]  Guillermo Vallejo Seco,et al.  A Comparison of the Bootstrap-F, Improved General Approximation, and Brown-Forsythe Multivariate Approaches in a Mixed Repeated Measures Design , 2006 .

[35]  Philippe G. Schyns.  Grand Challenges in Perception Science: Modeling the Future , 2010, Front. Psychology.

[36]  R. Ratcliff,et al.  Neural Representation of Task Difficulty and Decision Making during Perceptual Categorization: A Timing Diagram , 2006, The Journal of Neuroscience.

[37]  G. Rousselet,et al.  Parametric study of EEG sensitivity to phase noise during face processing , 2008, BMC Neuroscience.

[38]  Paul Sajda,et al.  Quality of evidence for perceptual decision making is indexed by trial-to-trial variability of the EEG , 2009, Proceedings of the National Academy of Sciences.

[39]  Julia Kastner,et al.  Introduction to Robust Estimation and Hypothesis Testing , 2005 .

[40]  Richard B. Ivry,et al.  The Influence of Language on Perception: Listening to Sentences about Faces Affects the Perception of Faces , 2010, The Journal of Neuroscience.

[41]  Terrence J. Sejnowski,et al.  Enhanced detection of artifacts in EEG data using higher-order statistics and independent component analysis , 2007, NeuroImage.

[42]  Jesse S. Husk,et al.  Time course and robustness of ERP object and face differences. , 2008, Journal of vision.

[43]  T. Allison,et al.  Modulation of human extrastriate visual processing by selective attention to colours and words. , 1998, Brain : a journal of neurology.

[44]  Kartik K. Sreenivasan,et al.  Temporal Characteristics of Top-Down Modulations during Working Memory Maintenance: An Event-related Potential Study of the N170 Component , 2007, Journal of Cognitive Neuroscience.

[45]  Philippe G Schyns,et al.  Diagnostic recognition: task constraints, object information, and their interactions , 1998, Cognition.

[46]  T. Sejnowski,et al.  Electroencephalographic Brain Dynamics Following Manually Responded Visual Targets , 2004, PLoS biology.

[47]  Guillaume A. Rousselet,et al.  Healthy Aging Delays Scalp EEG Sensitivity to Noise in a Face Discrimination Task , 2010, Front. Psychology.

[48]  S. Bentin,et al.  Domain specificity versus expertise: factors influencing distinct processing of faces , 2002, Cognition.

[49]  G. V. Simpson,et al.  Flow of activation from V1 to frontal cortex in humans , 2001, Experimental Brain Research.

[50]  Guillaume A. Rousselet,et al.  Single-trial EEG dynamics of object and face visual processing , 2007, NeuroImage.

[51]  Simon J Thorpe,et al.  The Speed of Categorization in the Human Visual System , 2009, Neuron.

[52]  Jeff Miller.  What is the probability of replicating a statistically significant effect? , 2009, Psychonomic bulletin & review.

[53]  Markus F. Neumann,et al.  Perceptual load manipulation reveals sensitivity of the face-selective N170 to attention , 2009, Neuroreport.

[54]  S. Thorpe,et al.  How parallel is visual processing in the ventral pathway? , 2004, Trends in Cognitive Sciences.

[55]  Guillaume A. Rousselet,et al.  LIMO EEG: A Toolbox for Hierarchical LInear MOdeling of ElectroEncephaloGraphic Data , 2011, Comput. Intell. Neurosci..

[56]  O. Grüsser,et al.  Category-related components in visual evoked potentials: photographs of faces, persons, flowers and tools as stimuli , 2004, Experimental Brain Research.

[57]  Guillaume A. Rousselet,et al.  Quantifying the Time Course of Visual Object Processing Using ERPs: It's Time to Up the Game , 2011, Front. Psychology.

[58]  D. Jeffreys.  A face-responsive potential recorded from the human scalp , 2004, Experimental Brain Research.

[59]  G. Rousselet,et al.  Neural repetition suppression to identity is abolished by other-race faces , 2010, Proceedings of the National Academy of Sciences.

[60]  Bruno Rossion,et al.  Electrophysiological evidence for temporal dissociation between spatial attention and sensory competition during human face processing. , 2006, Cerebral cortex.

[61]  E. Ziegel.  Introduction to Robust Estimation and Hypothesis Testing (2nd ed.) , 2005 .

[62]  Peter Kovesi,et al.  Phase Congruency Detects Corners and Edges , 2003, DICTA.

[63]  Guillaume A. Rousselet,et al.  Reliability of ERP and single-trial analyses , 2011, NeuroImage.

[64]  Jesse S. Husk,et al.  Inverting houses and textures: Investigating the characteristics of learned inversion effects , 2007, Vision Research.

[65]  P. Sajda,et al.  Temporal characterization of the neural correlates of perceptual decision making in the human brain. , 2006, Cerebral cortex.

[66]  N. Kanwisher,et al.  Stages of processing in face perception: an MEG study , 2002, Nature Neuroscience.

[67]  D. Heeger,et al.  The Normalization Model of Attention , 2009, Neuron.

[68]  Bruno Rossion,et al.  ERP evidence for task modulations on face perceptual processing at different spatial scales , 2003, Cogn. Sci..

[69]  John J. Foxe,et al.  Anticipatory Attentional Suppression of Visual Features Indexed by Oscillatory Alpha-Band Power Increases:A High-Density Electrical Mapping Study , 2010, The Journal of Neuroscience.