The electrophysiological correlate of saliency: Evidence from a figure-detection task

Although figure-ground segregation in a natural environment usually relies on multiple cues, we experience a coherent figure without usually noticing the individual single cues. It is still unclear how various cues interact to achieve this unified percept and whether this interaction depends on task demands. Studies investigating the effect of cue combination on the human EEG are still lacking. In the present study, we combined psychophysics, ERP and time-frequency analysis to investigate the interaction of orientation and spatial frequency as visual cues in a figure detection task. The figure was embedded in a matrix of Gabor elements, and we systematically varied figure saliency by changing the underlying cue configuration. We found a strong correlation between the posterior P2 amplitude and the perceived saliency of the figure: the P2 amplitude decreased with increasing saliency. Analogously, the power of the theta-band decreased for more salient figures. At longer latencies, the posterior P3 component was modulated in amplitude and latency, possibly reflecting increased decision confidence at higher saliencies. In conclusion, when the cue composition (e.g. one or two cues) or cue strength is changed in a figure detection task, first differences in the electrophysiological response reflect the perceived saliency and not directly the underlying cue configuration.

[1]  C. Torrence,et al.  A Practical Guide to Wavelet Analysis. , 1998 .

[2]  G. Meinhardt,et al.  Feature synergy depends on feature contrast and objecthood , 2004, Vision Research.

[3]  John J. Foxe,et al.  Activation Timecourse of Ventral Visual Stream Object-recognition Areas: High Density Electrical Mapping of Perceptual Closure Processes , 2000, Journal of Cognitive Neuroscience.

[4]  Kara D. Federmeier,et al.  Handbook of Psychophysiology: Event-Related Brain Potentials: Methods, Theory, and Applications , 2007 .

[5]  D. Senkowski,et al.  Effects of task difficulty on evoked gamma activity and ERPs in a visual discrimination task , 2002, Clinical Neurophysiology.

[6]  Michael Bach,et al.  Summation of texture segregation across orientation and spatial frequency: electrophysiological and psychophysical findings , 2000, Vision Research.

[7]  Sasa Kenjeres,et al.  Visualization of turbulence structures reorganization in thermal convection subjected to external magnetic field , 2004, J. Vis..

[8]  J. Polich,et al.  Cognitive and biological determinants of P300: an integrative review , 1995, Biological Psychology.

[9]  Manfred Fahle,et al.  The electrophysiological correlate of contour integration is modulated by task demands , 2006, Brain Research.

[10]  M. Landy,et al.  Weighted linear cue combination with possibly correlated error , 2003, Vision Research.

[11]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[12]  S. Luck An Introduction to the Event-Related Potential Technique , 2005 .

[13]  Sirko Straube,et al.  Electrophysiological correlates of figure–ground segregation directly reflect perceptual saliency , 2010, Vision Research.

[14]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[15]  T W Picton,et al.  The P300 Wave of the Human Event‐Related Potential , 1992, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[16]  W. A. Phillips Contextual modulation and dynamic grouping in perception , 2001, Trends in Cognitive Sciences.

[17]  W. Singer,et al.  Conjunctions of colour, luminance and orientation: the role of colour and luminance contrast on saliency and proximity grouping in texture segregation. , 2000, Spatial vision.

[18]  J. Cacioppo,et al.  Handbook Of Psychophysiology , 2019 .

[19]  Christoph S. Herrmann,et al.  Time-frequency analysis of target detection reveals an early interface between bottom-up and top-down processes in the gamma-band , 2006, NeuroImage.

[20]  E Donchin,et al.  A metric for thought: a comparison of P300 latency and reaction time. , 1981, Science.

[21]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[22]  M. Berger,et al.  High Gamma Power Is Phase-Locked to Theta Oscillations in Human Neocortex , 2006, Science.

[23]  E. Basar,et al.  Are cognitive processes manifested in event-related gamma, alpha, theta and delta oscillations in the EEG? , 1999, Neuroscience Letters.

[24]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[25]  M. Kubovy,et al.  Feature integration that routinely occurs without focal attention , 1999, Psychonomic bulletin & review.

[26]  D. Ballard,et al.  Fast Temporal Dynamics of Visual Cue Integration , 2000, Perception.

[27]  Wilson P. Tanner,et al.  Theory of recognition. , 1956 .

[28]  Maren Grigutsch,et al.  EEG oscillations and wavelet analysis , 2005 .

[29]  H Pashler,et al.  Cross-dimensional interaction and texture segregation , 1988, Perception & psychophysics.

[30]  Pejman Sehatpour,et al.  Spatiotemporal dynamics of human object recognition processing: An integrated high-density electrical mapping and functional imaging study of “closure” processes , 2006, NeuroImage.

[31]  Victor A. F. Lamme,et al.  Texture segregation is processed by primary visual cortex in man and monkey. Evidence from VEP experiments , 1992, Vision Research.

[32]  Catherine Tallon-Baudry,et al.  Induced γ-Band Activity during the Delay of a Visual Short-Term Memory Task in Humans , 1998, The Journal of Neuroscience.

[33]  J. Polich Clinical application of the P300 event-related brain potential. , 2004, Physical medicine and rehabilitation clinics of North America.

[34]  O. Bertrand,et al.  Oscillatory gamma activity in humans and its role in object representation , 1999, Trends in Cognitive Sciences.

[35]  Clara Casco,et al.  A visual evoked potential correlate of global figure-ground segmentation , 1999, Vision Research.

[36]  Todd C. Handy,et al.  Event-related potentials : a methods handbook , 2005 .

[37]  A. Mecklinger,et al.  Dissociations in the Processing of What and Where Information in Working Memory: An Event-Related Potential Analysis , 1996, Journal of Cognitive Neuroscience.

[38]  S. Tsujimoto,et al.  Independent mechanisms for dividing attention between the motion and the color of dynamic random dot patterns , 2004, Psychological research.

[39]  John J. Foxe,et al.  Setting Boundaries: Brain Dynamics of Modal and Amodal Illusory Shape Completion in Humans , 2004, The Journal of Neuroscience.

[40]  Michael Bach,et al.  Electrophysiological correlates of texture segregation in the human visual evoked potential , 1992, Vision Research.

[41]  What boundaries tell us about binding , 2001, Trends in Cognitive Sciences.

[42]  Andrew Blake,et al.  Shape from texture: Ideal observers and human psychophysics , 1993, Vision Research.

[43]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[44]  John J. Foxe,et al.  Visual Perceptual Learning in Human Object Recognition Areas: A Repetition Priming Study Using High-Density Electrical Mapping , 2001, NeuroImage.

[45]  R. Eckhorn,et al.  Coherent oscillations: A mechanism of feature linking in the visual cortex? , 1988, Biological Cybernetics.

[46]  Denis Mareschal,et al.  Electrophysiological correlates of common-onset visual masking , 2007, Neuropsychologia.

[47]  Michael J. Kahana,et al.  Neural Representations of Individual Stimuli in Humans Revealed by Gamma-Band Electrocorticographic Activity , 2009, The Journal of Neuroscience.

[48]  N. Perrin,et al.  Varieties of perceptual independence. , 1986, Psychological review.

[49]  Manfred Fahle,et al.  The electrophysiological correlate of contour integration is similar for color and luminance mechanisms. , 2007, Psychophysiology.

[50]  M. Bach,et al.  Similar Electrophysiological Correlates of Texture Segregation Induced by Luminance, Orientation, Motion and Stereo , 1997, Vision Research.

[51]  N. Busch,et al.  Gamma amplitudes are coupled to theta phase in human EEG during visual perception. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[52]  Michael Bach,et al.  Attention and visual texture segregation. , 2007, Journal of vision.

[53]  Strength of feature contrast mediates interaction among feature domains. , 2003, Spatial vision.

[54]  G. Meinhardt,et al.  Cue combination in a combined feature contrast detection and figure identification task , 2006, Vision Research.

[55]  G. Meinhardt,et al.  Synergy of features enables detection of texture defined figures. , 2006, Spatial vision.

[56]  John J. Foxe,et al.  The Spatiotemporal Dynamics of Illusory Contour Processing: Combined High-Density Electrical Mapping, Source Analysis, and Functional Magnetic Resonance Imaging , 2002, The Journal of Neuroscience.

[57]  Niels Birbaumer,et al.  Cross-frequency phase synchronization: A brain mechanism of memory matching and attention , 2008, NeuroImage.

[58]  S. Hillyard,et al.  Selective attention to the color and direction of moving stimuli: Electrophysiological correlates of hierarchical feature selection , 1996, Perception & psychophysics.

[59]  S. Zeki,et al.  The functional organization of area V2, II: The impact of stripes on visual topography , 2002, Visual Neuroscience.

[60]  H. Nothdurft Salience from feature contrast: additivity across dimensions , 2000, Vision Research.

[61]  C. Schroeder,et al.  The Gamma Oscillation: Master or Slave? , 2009, Brain Topography.

[62]  M S Landy,et al.  Ideal cue combination for localizing texture-defined edges. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[63]  M. Bach,et al.  The Freiburg Visual Acuity test--automatic measurement of visual acuity. , 1996, Optometry and vision science : official publication of the American Academy of Optometry.

[64]  James M. Hillis,et al.  Slant from texture and disparity cues: optimal cue combination. , 2004, Journal of vision.

[65]  Eli Brenner,et al.  Temporal aspects of cue combination. , 2007, Journal of vision.

[66]  Stefan Debener,et al.  Size matters: effects of stimulus size, duration and eccentricity on the visual gamma-band response , 2004, Clinical Neurophysiology.

[67]  S. Treue Visual attention: the where, what, how and why of saliency , 2003, Current Opinion in Neurobiology.

[68]  M Fahle,et al.  Feature-specific electrophysiological correlates of texture segregation , 2003, Vision Research.

[69]  B J Craven,et al.  Interactions between coincident and orthogonal cues to texture boundaries , 2000, Perception & psychophysics.

[70]  S. Zeki,et al.  The functional organization of area V2, I: Specialization across stripes and layers , 2002, Visual Neuroscience.

[71]  Josée Rivest,et al.  Localizing contours defined by more than one attribute , 1996, Vision Research.

[72]  R. Jacobs,et al.  Experience-dependent integration of texture and motion cues to depth , 1999, Vision Research.

[73]  Katsumi Aoki,et al.  Recent development of flow visualization , 2004, J. Vis..

[74]  Guy Dove,et al.  Linking Brainwaves to the Brain: An ERP Primer , 2005, Developmental neuropsychology.