Attentional dynamics during free picture viewing: Evidence from oculomotor behavior and electrocortical activity

Most empirical evidence on attentional control is based on brief presentations of rather abstract stimuli. Results revealed indications for a dynamic interplay between bottom-up and top-down attentional mechanisms. Here we used a more naturalistic task to examine temporal signatures of attentional mechanisms on fine and coarse time scales. Subjects had to inspect digitized copies of 60 paintings, each shown for 40 s. We simultaneously measured oculomotor behavior and electrophysiological correlates of brain activity to compare early and late intervals (1) of inspection time of each picture (picture viewing) and (2) of the full experiment (time on task). For picture viewing, we found an increase in fixation duration and a decrease of saccadic amplitude while these parameters did not change with time on task. Furthermore, early in picture viewing we observed higher spatial and temporal similarity of gaze behavior. Analyzing electrical brain activity revealed changes in three components (C1, N1 and P2) of the eye fixation-related potential (EFRP); during picture viewing; no variation was obtained for the power in the frontal beta- and in the theta activity. Time on task analyses demonstrated no effects on the EFRP amplitudes but an increase of power in the frontal theta and beta band activity. Thus, behavioral and electrophysiological measures similarly show characteristic changes during picture viewing, indicating a shifting balance of its underlying (bottom-up and top-down) attentional mechanisms. Time on task also modulated top-down attention but probably represents a different attentional mechanism.

[1]  D. Spalding.  The Principles of Psychology , 1873, Nature.

[2]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[3]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[4]  J. Antes.  The time course of picture viewing. , 1974, Journal of experimental psychology.

[5]  E. Donchin,et al.  COGNITIVE PSYCHOPHYSIOLOGY: THE ENDOGENOUS COMPONENTS OF THE ERP , 1978 .

[6]  N. Mackworth,et al.  Cognitive determinants of fixation location during picture viewing. , 1978, Journal of experimental psychology. Human perception and performance.

[7]  Akihiro Yagi,et al.  Lambda waves associated with offset of saccades: A subject with large lambda waves , 1979, Biological Psychology.

[8]  R Broughton,et al.  Sensitivity of the stanford sleepiness scale to the effects of cumulative partial sleep deprivation and recovery oversleeping. , 1981, Sleep.

[9]  G. Mangun,et al.  Luminance and spatial attention effects on early visual processing. , 1995, Brain research. Cognitive brain research.

[10]  S. Yantis,et al.  Visual attention: control, representation, and time course. , 1997, Annual review of psychology.

[11]  Daphne N. Yu,et al.  High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice. , 1997, Cerebral cortex.

[12]  Attention! , 1998, Trends in Cognitive Sciences.

[13]  E. Vogel,et al.  Sensory gain control (amplification) as a mechanism of selective attention: electrophysiological and neuroimaging evidence. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[14]  Judi E. See,et al.  Brain systems of vigilance. , 1998 .

[15]  J. Arruda,et al.  Validation of a right hemisphere vigilance system as measured by principal component and factor analyzed quantitative electroencephalogram. , 1999, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[16]  A. Starr,et al.  The N100 auditory cortical evoked potential indexes scanning of auditory short-term memory , 1999, Clinical Neurophysiology.

[17]  Z Li,et al.  Contextual influences in V1 as a basis for pop out and asymmetry in visual search. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[18]  S. Nieuwenhuis,et al.  Mental fatigue and task control: planning and preparation. , 2000, Psychophysiology.

[19]  C. Frith,et al.  The Role of Working Memory in Visual Selective Attention , 2001, Science.

[20]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[21]  A. Ohman,et al.  Emotion drives attention: detecting the snake in the grass. , 2001, Journal of experimental psychology. General.

[22]  J. Jonides,et al.  Overlapping mechanisms of attention and spatial working memory , 2001, Trends in Cognitive Sciences.

[23]  S. Hochstein,et al.  View from the Top Hierarchies and Reverse Hierarchies in the Visual System , 2002, Neuron.

[24]  Zhaoping Li.  A saliency map in primary visual cortex , 2002, Trends in Cognitive Sciences.

[25]  O. Jensen,et al.  Frontal theta activity in humans increases with memory load in a working memory task , 2002, The European journal of neuroscience.

[26]  B. Velichkovsky.  Heterarchy of cognition: The depths and the highs of a framework for memory research , 2002, Memory.

[27]  S. Hillyard,et al.  Cortical sources of the early components of the visual evoked potential , 2002, Human brain mapping.

[28]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[29]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[30]  Edward J. Golob,et al.  Serial Position Effects in Auditory Event-related Potentials during Working Memory Retrieval , 2004, Journal of Cognitive Neuroscience.

[31]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[32]  A. Coenen,et al.  Mental effort affects vigilance enduringly: after-effects in EEG and behavior. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[33]  J. Reynolds,et al.  Exogenous attentional selection of transparent superimposed surfaces modulates early event-related potentials , 2005, Vision Research.

[34]  B. Velichkovsky,et al.  Time course of information processing during scene perception: The relationship between saccade amplitude and fixation duration , 2005 .

[35]  Asha Iyer,et al.  Components of bottom-up gaze allocation in natural images , 2005, Vision Research.

[36]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[37]  Christian Büchel,et al.  The functional and temporal characteristics of top-down modulation in visual selection. , 2005, Cerebral cortex.

[38]  Anthony J. Ries,et al.  Automatic Versus Contingent Mechanisms of Sensory-Driven Neural Biasing and Reflexive Attention , 2005, Journal of Cognitive Neuroscience.

[39]  Michael Leyton.  The Structure of Paintings , 2006 .

[40]  A. Keil,et al.  Modulation of the C1 visual event-related component by conditioned stimuli: evidence for sensory plasticity in early affective perception. , 2006, Cerebral cortex.

[41]  T. Foulsham,et al.  Quarterly Journal of Experimental Psychology: in press Visual saliency and semantic incongruency influence eye movements when , 2022 .

[42]  T. Foulsham,et al.  Eye movements during scene inspection: A test of the saliency map hypothesis , 2006 .

[43]  B. Kotchoubey,et al.  Event-related potentials, cognition, and behavior: A biological approach , 2006, Neuroscience & Biobehavioral Reviews.

[44]  Claudia Mello-Thoms,et al.  Visual interest in pictorial art during an aesthetic experience. , 2007, Spatial vision.

[45]  Christopher W Tyler,et al.  Some principles of spatial organization in art. , 2007, Spatial vision.

[46]  C. Gerloff,et al.  Dissociation of sustained attention from central executive functions: local activity and interregional connectivity in the theta range , 2007, The European journal of neuroscience.

[47]  Gianluca Ficca,et al.  Increased spontaneous eye blink rate following prolonged wakefulness , 2007, Physiology & Behavior.

[48]  W. Klimesch,et al.  Visual P2 component is related to theta phase-locking , 2007, Neuroscience Letters.

[49]  Sven-Thomas Graupner,et al.  Surprise, surprise: two distinct components in the visually evoked distractor effect. , 2007, Psychophysiology.

[50]  Benjamin W Tatler,et al.  The central fixation bias in scene viewing: selecting an optimal viewing position independently of motor biases and image feature distributions. , 2007, Journal of vision.

[51]  C. Koch,et al.  Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. , 2008, Journal of vision.

[52]  E. J. Golob,et al.  Auditory event-related potentials during a spatial working memory task , 2008, Clinical Neurophysiology.

[53]  M. Corbetta,et al.  The Reorienting System of the Human Brain: From Environment to Theory of Mind , 2008, Neuron.

[54]  J. Helmert,et al.  Visual Fixation Durations and Saccade Amplitudes: Shifting Relationship in a Variety of Conditions , 2008 .

[55]  Niels Birbaumer,et al.  Arousal and Attention: Self-chosen Stimulation Optimizes Cortical Excitability and Minimizes Compensatory Effort , 2008, Journal of Cognitive Neuroscience.

[56]  Christopher M. Masciocchi,et al.  Everyone knows what is interesting: salient locations which should be fixated. , 2009, Journal of vision.

[57]  Vincent Di Lollo,et al.  Electrophysiological Indices of Target and Distractor Processing in Visual Search , 2009, Journal of Cognitive Neuroscience.

[58]  Jan Theeuwes,et al.  The limits of top-down control of visual attention. , 2009, Acta psychologica.

[59]  G. Pourtois,et al.  Attentional load modifies early activity in human primary visual cortex , 2009, Human brain mapping.

[60]  J. Theeuwes,et al.  The time course of exogenous and endogenous control of covert attention , 2009, Experimental Brain Research.

[61]  Jeff Miller,et al.  Distraction by color and its electrophysiological correlates. , 2009, Psychophysiology.

[62]  Agnieszka Wykowska,et al.  On the Temporal Relation of Top–Down and Bottom–Up Mechanisms during Guidance of Attention , 2010, Journal of Cognitive Neuroscience.

[63]  Jan Theeuwes,et al.  ScanMatch: A novel method for comparing fixation sequences , 2010, Behavior research methods.

[64]  J. Theeuwes.  Top-down and bottom-up control of visual selection. , 2010, Acta psychologica.

[65]  Raja Parasuraman,et al.  Dissociation of visual C1 and P1 components as a function of attentional load: An event-related potential study , 2010, Biological Psychology.

[66]  Thierry Baccino,et al.  Eye fixation–related potentials (EFRPs) during object identification , 2010, Visual Neuroscience.

[67]  Michael D. Dodd,et al.  Examining the influence of task set on eye movements and fixations. , 2011, Journal of vision.

[68]  Adrian R. Willoughby,et al.  Effects of Working Memory Load on Visual Selective Attention: Behavioral and Electrophysiological Evidence , 2011, Front. Hum. Neurosci..

[69]  Tom Foulsham,et al.  Scrambled eyes? Disrupting scene structure impedes focal processing and increases bottom-up guidance , 2011, Attention, perception & psychophysics.

[70]  D. Ballard,et al.  Eye guidance in natural vision: reinterpreting salience. , 2011, Journal of vision.

[71]  Julie D. Golomb,et al.  A taxonomy of external and internal attention. , 2011, Annual review of psychology.

[72]  G. Pourtois,et al.  Top-down effects on early visual processing in humans: A predictive coding framework , 2011, Neuroscience & Biobehavioral Reviews.

[73]  S. Kastner,et al.  A neural basis for real-world visual search in human occipitotemporal cortex , 2011, Proceedings of the National Academy of Sciences.

[74]  Sven-Thomas Graupner,et al.  Saccadic context indicates information processing within visual fixations: evidence from event-related potentials and eye-movements analysis of the distractor effect. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[75]  Zhaoping Li,et al.  Neural Activities in V1 Create a Bottom-Up Saliency Map , 2012, Neuron.

[76]  V. Gallese,et al.  When Art Moves the Eyes: A Behavioral and Eye-Tracking Study , 2012, PloS one.

[77]  A. Nobre,et al.  Top-down modulation: bridging selective attention and working memory , 2012, Trends in Cognitive Sciences.

[78]  Raja Parasuraman,et al.  Attentional load is not a critical factor for eliciting C1 attentional effect – A reply to Rauss, Pourtois, Vuilleumier, and Schwartz , 2012, Biological Psychology.