Global and local covert visual attention: Evidence from a bayesian hidden markov model

Psychological, psychophysical and physiological research indicates that people switch between two covert attention states, local and global attention, while visually exploring complex scenes. The focus in the local attention state is on specific aspects and details of the scene, and on examining its content with greater visual detail. The focus in the global attention state is on exploring the informative and perceptually salient areas of the scene, and possibly on integrating the information contained therein. The existence of these two visual attention states, their relative prevalence and sequence in time has remained empirically untested to date. To fill this gap, we develop a psychometric model of visual covert attention that extends recent work on hidden Markov models, and we test it using eye-movement data. The model aims to describe the observed time series of saccades typically collected in eye-movement research by assuming a latent Markov process, indicative of the brain switching between global and local covert attention. We allow subjects to be in either state while exploring a stimulus visually, and to switch between them an arbitrary number of times. We relax the no-memory-property of the Markov chain. The model that we develop is estimated with MCMC methodology and calibrated on eye-movement data collected in a study of consumers' attention to print advertisements in magazines.

[1]  S M Anstis,et al.  Letter: A chart demonstrating variations in acuity with retinal position. , 1974, Vision research.

[2]  Reinhold Kliegl,et al.  Mathematical models of eye movements in reading: a possible role for autonomous saccades , 2001, Biological Cybernetics.

[3]  Sylvia Richardson,et al.  Markov Chain Monte Carlo in Practice , 1997 .

[4]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[5]  John M. Findlay,et al.  Eye guidance and visual search , 1998 .

[6]  L. Stark,et al.  Evidence for a global scanpath strategy in viewing abstract compared with realistic images , 1995, Neuropsychologia.

[7]  M. Posner,et al.  Components of visual orienting , 1984 .

[8]  Marc Pomplun,et al.  Analysis and models of eye movements in comparative visual search , 1998 .

[9]  M. Farah,et al.  Does visual attention select objects or locations? , 1994, Journal of experimental psychology. General.

[10]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[11]  G. Sperling,et al.  Episodic theory of the dynamics of spatial attention. , 1995 .

[12]  R. Pieters,et al.  Visual Attention to Repeated Print Advertising: A Test of Scanpath Theory , 1999 .

[13]  Christopher M. Brown,et al.  Controlling eye movements with hidden Markov models , 2004, International Journal of Computer Vision.

[14]  M. Just,et al.  The psychology of reading and language comprehension , 1986 .

[15]  J. Henderson,et al.  High-level scene perception. , 1999, Annual review of psychology.

[16]  S. Yantis,et al.  Visual attention: control, representation, and time course. , 1997, Annual review of psychology.

[17]  Michel Wedel,et al.  Eye Fixations on Advertisements and Memory for Brands: A Model and Findings , 2000 .

[18]  Michael D. Reddix,et al.  Perception and Cognition in Reading: Where is the Meeting Point? , 1992 .

[19]  J. Warm Sustained attention in human performance , 1984 .

[20]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[21]  S R Ellis,et al.  Statistical Dependency in Visual Scanning , 1986, Human factors.

[22]  A. Inhoff,et al.  Chapter 2 – Definition and Computation of Oculomotor Measures in the Study of Cognitive Processes , 1998 .

[23]  C. Robert,et al.  Bayesian inference in hidden Markov models through the reversible jump Markov chain Monte Carlo method , 2000 .

[24]  J. Antes The time course of picture viewing. , 1974, Journal of experimental psychology.

[25]  Sheldon M. Ross,et al.  Stochastic Processes , 2018, Gauge Integral Structures for Stochastic Calculus and Quantum Electrodynamics.

[26]  Geoffrey Underwood,et al.  Eye Guidance and Visual Information Processing , 1998 .

[27]  K. Rayner,et al.  Toward a model of eye movement control in reading. , 1998 .

[28]  Raymond Klein,et al.  Inhibitory tagging system facilitates visual search , 1988, Nature.

[29]  R. Pieters,et al.  Visual attention to advertising: A segment-level analysis , 1997 .

[30]  George W. McConkie,et al.  Eye Movements and Perception during Reading. , 1982 .

[31]  Lawrence W. Stark,et al.  Visual perception and sequences of eye movement fixations: a stochastic modeling approach , 1992, IEEE Trans. Syst. Man Cybern..

[32]  John R. Anderson,et al.  Automated Eye-Movement Protocol Analysis , 2001, Hum. Comput. Interact..

[33]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[34]  G. Roberts,et al.  Markov chain Monte Carlo methods for switching diffusion models , 2001 .

[35]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[36]  P. Viviani Eye movements in visual search: cognitive, perceptual and motor control aspects. , 1990, Reviews of oculomotor research.

[37]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[38]  S. Palmer Vision Science : Photons to Phenomenology , 1999 .

[39]  Michel Wedel,et al.  Breaking Through the Clutter: Benefits of Advertisement Originality and Familiarity for Brand Attention and Memory , 2002, Manag. Sci..

[40]  Andrew Hollingworth,et al.  Eye Movements During Scene Viewing: An Overview , 1998 .

[41]  Andrew J. Stewart,et al.  Integrating text and pictorial information: eye movements when looking at print advertisements. , 2001, Journal of experimental psychology. Applied.