Low-level and high-level modulations of fixational saccades and high frequency oscillatory brain activity in a visual object classification task

Until recently induced gamma-band activity (GBA) was considered a neural marker of cortical object representation. However, induced GBA in the electroencephalogram (EEG) is susceptible to artifacts caused by miniature fixational saccades. Recent studies have demonstrated that fixational saccades also reflect high-level representational processes. Do high-level as opposed to low-level factors influence fixational saccades? What is the effect of these factors on artifact-free GBA? To investigate this, we conducted separate eye tracking and EEG experiments using identical designs. Participants classified line drawings as objects or non-objects. To introduce low-level differences, contours were defined along different directions in cardinal color space: S-cone-isolating, intermediate isoluminant, or a full-color stimulus, the latter containing an additional achromatic component. Prior to the classification task, object discrimination thresholds were measured and stimuli were scaled to matching suprathreshold levels for each participant. In both experiments, behavioral performance was best for full-color stimuli and worst for S-cone isolating stimuli. Saccade rates 200–700 ms after stimulus onset were modulated independently by low and high-level factors, being higher for full-color stimuli than for S-cone isolating stimuli and higher for objects. Low-amplitude evoked GBA and total GBA were observed in very few conditions, showing that paradigms with isoluminant stimuli may not be ideal for eliciting such responses. We conclude that cortical loops involved in the processing of objects are preferentially excited by stimuli that contain achromatic information. Their activation can lead to relatively early exploratory eye movements even for foveally-presented stimuli.

[1]  David J. Schwartzman,et al.  In the blink of an eye: the contribution of microsaccadic activity to the induced γ band response. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[2]  J. Mollon,et al.  Luminance noise and the rapid determination of discrimination ellipses in colour deficiency , 1994, Vision Research.

[3]  Matthias M. Müller,et al.  A cross-laboratory study of event-related gamma activity in a standard object recognition paradigm , 2006, NeuroImage.

[4]  J. Barraza,et al.  The effect of chromatic and luminance information on reaction times , 2010, Visual Neuroscience.

[5]  C A Grimbergen,et al.  High-quality recording of bioelectric events , 1991, Medical and Biological Engineering and Computing.

[6]  R. Reid,et al.  The koniocellular pathway in primate vision. , 2000, Annual review of neuroscience.

[7]  Caspar M. Schwiedrzik,et al.  (Micro)Saccades, corollary activity and cortical oscillations , 2009, Trends in Cognitive Sciences.

[8]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources , 1999, Neural Computation.

[9]  R. Eskew Chromatic Detection and Discrimination , 2008 .

[10]  Catherine Tallon-Baudry,et al.  The roles of gamma-band oscillatory synchrony in human visual cognition. , 2009, Frontiers in bioscience.

[11]  Jasna Martinovic,et al.  Induced gamma-band activity is related to the time point of object identification , 2008, Brain Research.

[12]  Stefan Debener,et al.  Size matters: effects of stimulus size, duration and eccentricity on the visual gamma-band response , 2004, Clinical Neurophysiology.

[13]  C. Kennard,et al.  Distinct Cortical and Collicular Mechanisms of Inhibition of Return Revealed with S Cone Stimuli , 2004, Current Biology.

[14]  A. Stockman,et al.  The S-cone contribution to luminance depends on the M- and L-cone adaptation levels: silent surrounds? , 2009, Journal of vision.

[15]  F X Alario,et al.  A set of 400 pictures standardized for French: Norms for name agreement, image agreement, familiarity, visual complexity, image variability, and age of acquisition , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[16]  W. McIlhagga,et al.  Detection mechanisms in L-, M-, and S-cone contrast space. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[17]  R. Shapley,et al.  Space and Time Maps of Cone Photoreceptor Signals in Macaque Lateral Geniculate Nucleus , 2002, The Journal of Neuroscience.

[18]  Wael El-Deredy,et al.  Coherent illusory contours reduce microsaccade frequency , 2011, Neuropsychologia.

[19]  Nelson J. Trujillo-Barreto,et al.  Induced gamma band responses in human EEG after the control of miniature saccadic artifacts , 2011, NeuroImage.

[20]  M. Turatto,et al.  Microsaccadic response to visual events that are invisible to the superior colliculus. , 2007, Behavioral neuroscience.

[21]  M. Turatto,et al.  Are you ready? I can tell by looking at your microsaccades , 2006, Neuroreport.

[22]  P. Mitra,et al.  Analysis of dynamic brain imaging data. , 1998, Biophysical journal.

[23]  Ziad M. Hafed,et al.  A Neural Mechanism for Microsaccade Generation in the Primate Superior Colliculus , 2009, Science.

[24]  Xoana G. Troncoso,et al.  Microsaccades: a neurophysiological analysis , 2009, Trends in Neurosciences.

[25]  Jochen Kaiser,et al.  Human γ-band activity and behavior. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[26]  Christoph S. Herrmann,et al.  Time Pressure Modulates Electrophysiological Correlates of Early Visual Processing , 2008, PloS one.

[27]  Petroc Sumner,et al.  Signals Invisible to the Collicular and Magnocellular Pathways Can Capture Visual Attention , 2002, Current Biology.

[28]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[29]  R. Marrocco,et al.  Monkey superior colliculus: properties of single cells and their afferent inputs. , 1977, Journal of neurophysiology.

[30]  Sophie M. Wuerger,et al.  Towards a spatio-chromatic standard observer for detection , 2002, IS&T/SPIE Electronic Imaging.

[31]  Uwe Hassler,et al.  Repetition priming effects dissociate between miniature eye movements and induced gamma‐band responses in the human electroencephalogram , 2013, The European journal of neuroscience.

[32]  Bsrat Mezghebe from The Search , 2013 .

[33]  S. Shevell,et al.  Color in complex scenes. , 2008, Annual review of psychology.

[34]  Reinhold Kliegl,et al.  Microsaccadic inhibition and P300 enhancement in a visual oddball task. , 2009, Psychophysiology.

[35]  S. Makeig,et al.  Mining event-related brain dynamics , 2004, Trends in Cognitive Sciences.

[36]  J. Hartigan,et al.  The Dip Test of Unimodality , 1985 .

[37]  Ralf Engbert,et al.  Computational Modeling of Collicular Integration of Perceptual Responses and Attention in Microsaccades , 2012, The Journal of Neuroscience.

[38]  Kara D. Federmeier,et al.  Timed picture naming in seven languages , 2003, Psychonomic bulletin & review.

[39]  Xoana G. Troncoso,et al.  Saccades and microsaccades during visual fixation, exploration, and search: foundations for a common saccadic generator. , 2008, Journal of vision.

[40]  David J. Schwartzman,et al.  In the blink of an eye: the contribution of microsaccadic activity to the induced γ band response. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[41]  W D Wright,et al.  Color Science, Concepts and Methods. Quantitative Data and Formulas , 1967 .

[42]  Christoph S. Herrmann,et al.  EEG oscillations in the gamma and alpha range respond differently to spatial frequency , 2007, Vision Research.

[43]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[44]  Jasna Martinovic,et al.  Task and Spatial Frequency Modulations of Object Processing: An EEG Study , 2013, PloS one.

[45]  R. M. Boynton,et al.  Chromaticity diagram showing cone excitation by stimuli of equal luminance. , 1979, Journal of the Optical Society of America.

[46]  M. Bar,et al.  Magnocellular Projections as the Trigger of Top-Down Facilitation in Recognition , 2007, The Journal of Neuroscience.

[47]  N. Logothetis,et al.  Visibility states modulate microsaccade rate and direction , 2009, Vision Research.

[48]  N. Prins Psychophysics: A Practical Introduction , 2009 .

[49]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[50]  Matthias M. Müller,et al.  Oscillatory brain activity dissociates between associative stimulus content in a repetition priming task in the human EEG. , 2004, Cerebral cortex.

[51]  Andrew J. Zele,et al.  Threshold units: A correct metric for reaction time? , 2007, Vision Research.

[52]  Ralf Engbert,et al.  Microsaccades uncover the orientation of covert attention , 2003, Vision Research.

[53]  Angela M. Brown,et al.  Color Channels, Not Color Appearance or Color Categories, Guide Visual Search for Desaturated Color Targets , 2010, Psychological science.

[54]  Sophie M. Wuerger,et al.  'Color Vision: From Genes to Perception' , 2000 .

[55]  A. Engel,et al.  Cognitive functions of gamma-band activity: memory match and utilization , 2004, Trends in Cognitive Sciences.

[56]  Laurent Itti,et al.  Color-Related Signals in the Primate Superior Colliculus , 2009, The Journal of Neuroscience.

[57]  M. Bar A Cortical Mechanism for Triggering Top-Down Facilitation in Visual Object Recognition , 2003, Journal of Cognitive Neuroscience.

[58]  R. M. Boynton Human color vision , 1979 .

[59]  A. Vassilev,et al.  On the search for an appropriate metric for reaction time to suprathreshold increments and decrements , 2009, Vision Research.

[60]  Ralf Engbert,et al.  Microsaccades are different from saccades in scene perception , 2010, Experimental Brain Research.

[61]  P. Lennie,et al.  Functional Asymmetries in Visual Pathways Carrying S-Cone Signals in Macaque , 2008, The Journal of Neuroscience.

[62]  Martina Poletti,et al.  Eye movements under various conditions of image fading. , 2010, Journal of vision.

[63]  Jasna Martinovic,et al.  Event-related potentials reveal an early advantage for luminance contours in the processing of objects. , 2011, Journal of vision.

[64]  Shlomit Yuval-Greenberg,et al.  Saccadic spike potentials in gamma-band EEG: Characterization, detection and suppression , 2010, NeuroImage.

[65]  Jasna Martinovic,et al.  The integration of local chromatic motion signals is sensitive to contrast polarity , 2011, Visual Neuroscience.

[66]  A. Hendrickson,et al.  Distribution and development of short‐wavelength cones differ between Macaca monkey and human fovea , 1999, The Journal of comparative neurology.

[67]  J. Rieger,et al.  Stimulus intensity affects early sensory processing: visual contrast modulates evoked gamma-band activity in human EEG. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[68]  Jasna Martinovic,et al.  Coding of Visual Object Features and Feature Conjunctions in the Human Brain , 2008, PloS one.

[69]  Philippe Kahane,et al.  Task‐related gamma‐band dynamics from an intracerebral perspective: Review and implications for surface EEG and MEG , 2009, Human brain mapping.

[70]  Michael B. McCamy,et al.  The effects of fixation target size and luminance on microsaccades and square-wave jerks , 2013, PeerJ.

[71]  M. Rucci,et al.  Microsaccades Precisely Relocate Gaze in a High Visual Acuity Task , 2010, Nature Neuroscience.

[72]  Jasna Martinovic,et al.  High frequency oscillations as a correlate of visual perception. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[73]  S. Martinez-Conde,et al.  An oculomotor continuum from exploration to fixation , 2013, Proceedings of the National Academy of Sciences.

[74]  J. Victor,et al.  Temporal Encoding of Spatial Information during Active Visual Fixation , 2012, Current Biology.

[75]  J. Krauskopf,et al.  Cone Contrast and Opponent Modulation Color Spaces 565 ( a ) , 2022 .

[76]  Ralf Engbert,et al.  Microsaccades Keep the Eyes' Balance During Fixation , 2004, Psychological science.

[77]  P. Lennie,et al.  Chromatic mechanisms in lateral geniculate nucleus of macaque. , 1984, The Journal of physiology.

[78]  Marta Kutas,et al.  Identifying reliable independent components via split-half comparisons , 2009, NeuroImage.

[79]  Chris Tailby,et al.  Colour and pattern selectivity of receptive fields in superior colliculus of marmoset monkeys , 2012, The Journal of physiology.

[80]  M. Rolfs Microsaccades: Small steps on a long way , 2009, Vision Research.

[81]  T. Cornsweet Determination of the stimuli for involuntary drifts and saccadic eye movements. , 1956, Journal of the Optical Society of America.

[82]  Jasna Martinovic,et al.  Induced Gamma Band Responses Predict Recognition Delays during Object Identification , 2007, Journal of Cognitive Neuroscience.

[83]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[84]  Marco Bertamini,et al.  The chromatic input to global motion perception , 2003, Visual Neuroscience.

[85]  H. Jasper Report of the committee on methods of clinical examination in electroencephalography , 1958 .

[86]  Ingo Fründ,et al.  Human gamma-band activity: A review on cognitive and behavioral correlates and network models , 2010, Neuroscience & Biobehavioral Reviews.

[87]  Burkhard Maess,et al.  Memory-matches evoke human gamma-responses , 2004, BMC Neuroscience.

[88]  I. Nelken,et al.  Transient Induced Gamma-Band Response in EEG as a Manifestation of Miniature Saccades , 2008, Neuron.

[89]  S. Bressler,et al.  Trial-to-trial variability of cortical evoked responses: implications for the analysis of functional connectivity , 2002, Clinical Neurophysiology.

[90]  C. A. Grimbergen,et al.  HIGH QUALITY RECORDING OF BIOELECTRIC EVENTS . I : INTERFERENCE REDUCTION , THEORY AND PRACTICE , 2009 .

[91]  Janus J. Kulikowski,et al.  Neural basis of fundamental filters in vision (chapter 1 in: Boook edited by Buracas GT, Ruksenas O, Boynton GM, Albright TD, ISBN 1 58603 181 3) , 2003 .

[92]  P. Mcmullen,et al.  Effects of orientation on the identification of rotated objects depend on the level of identity. , 1998, Journal of experimental psychology. Human perception and performance.

[93]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[94]  R. B. Reilly,et al.  FASTER: Fully Automated Statistical Thresholding for EEG artifact Rejection , 2010, Journal of Neuroscience Methods.

[95]  Ralf Engbert,et al.  When do microsaccades follow spatial attention? , 2010, Attention, perception & psychophysics.