On the discriminability of hROIs, human visually selected regions-of-interest

Many studies have tried to answer an important question: is it possible to predict human visually selected regions-of-interest (hROIs)? hROIs are defined as the loci of eye fixations and they can be analyzed by their spatial distribution over the visual stimulus and their temporal ordering. We used a simplified set of geometrical spatial kernels and linear filter models as bottom-up conspicuity operators that produce algorithmically selected regions-of-interest, aROIs. As a direct approach we measured the ability of these aROIs to predict human scanpaths. The level of prediction is measured by two similarity indices: Sp for spatial similarity and Ss for temporal ordering similarity. At the same time we assessed the discriminability of the hROI loci, in terms of conspicuity, with respect to non-selected (not of interest) regions of an image. We prove that this discrimination is possible and further correlates with the positional similarity index Sp. Other human scanpath experimental conditions are presented in parsing diagrams and discussed. A general top–down/bottom–up scanpath model is finally formulated.

[1]  J. Daugman Two-dimensional spectral analysis of cortical receptive field profiles , 1980, Vision Research.

[2]  Andrew Hollingworth,et al.  Eye Movements During Scene Viewing: An Overview , 1998 .

[3]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[4]  I. Rybak,et al.  A model of attention-guided visual perception and recognition , 1998, Vision Research.

[5]  L. Stark,et al.  Spontaneous Eye Movements During Visual Imagery Reflect the Content of the Visual Scene , 1997, Journal of Cognitive Neuroscience.

[6]  N. P. Bichot,et al.  Saccade target selection in macaque during feature and conjunction visual search , 1999, Visual Neuroscience.

[7]  Gustavo Deco,et al.  Computational neuroscience of vision , 2002 .

[8]  RICHARD L. DIDDAY,et al.  Eye Movements and Visual Perception: A "Two Visual System" Model , 1975, Int. J. Man Mach. Stud..

[9]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[10]  Lawrence W. Stark,et al.  Top-down guided eye movements , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[11]  M. Pinsk,et al.  Attention modulates responses in the human lateral geniculate nucleus , 2002, Nature Neuroscience.

[12]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[13]  D. Noton,et al.  Eye movements and visual perception. , 1971, Scientific American.

[14]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[15]  W. W. Peterson,et al.  The theory of signal detectability , 1954, Trans. IRE Prof. Group Inf. Theory.

[16]  R. Walker,et al.  A model of saccade generation based on parallel processing and competitive inhibition , 1999, Behavioral and Brain Sciences.

[17]  S. Gerathewohl Conspicuity of steady and flashing light signals: variation of contrast. , 1953, Journal of the Optical Society of America.

[18]  Gerhard Krieger,et al.  Scene analysis with saccadic eye movements: Top-down and bottom-up modeling , 2001, J. Electronic Imaging.

[19]  F. L. Engel Visual conspicuity, visual search and fixation tendencies of the eye , 1977, Vision Research.

[20]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[21]  P Reinagel,et al.  Natural scene statistics at the centre of gaze. , 1999, Network.

[22]  W. Pitts,et al.  What the Frog's Eye Tells the Frog's Brain , 1959, Proceedings of the IRE.

[23]  H. Nothdurft Attention shifts to salient targets , 2002, Vision Research.

[24]  G. Hauske,et al.  Object and scene analysis by saccadic eye-movements: an investigation with higher-order statistics. , 2000, Spatial vision.

[25]  F. Ulaby,et al.  Textural Infornation in SAR Images , 1986, IEEE Transactions on Geoscience and Remote Sensing.

[26]  F. L. Engel Visual conspicuity, directed attention and retinal locus. , 1971, Vision research.

[27]  Claudio M. Privitera,et al.  Algorithms for Defining Visual Regions-of-Interest: Comparison with Eye Fixations , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  M. A. Steinmetz,et al.  Neuronal responses in area 7a to multiple-stimulus displays: I. neurons encode the location of the salient stimulus. , 2001, Cerebral cortex.

[29]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[30]  C. Freksa,et al.  Visual Attention and Cognition , 1996 .

[31]  D. S. Wooding,et al.  The relationship between the locations of spatial features and those of fixations made during visual examination of briefly presented images. , 1996, Spatial vision.

[32]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[33]  Claudio M. Privitera,et al.  Human-vision-based selection of image processing algorithms for planetary exploration , 2003, IEEE Trans. Image Process..

[34]  L. Stark,et al.  Experimental metaphysics: The scanpath as an epistemological mechanism , 1996 .

[35]  J. Pelz,et al.  Oculomotor behavior and perceptual strategies in complex tasks , 2001, Vision Research.

[36]  Leslie G. Ungerleider,et al.  Mechanisms of directed attention in the human extrastriate cortex as revealed by functional MRI. , 1998, Science.

[37]  Ronald M. Lesperance,et al.  The Gaussian derivative model for spatial-temporal vision: II. Cortical data. , 2001, Spatial vision.

[38]  Gustavo Deco,et al.  Systems-Level Neuronal Modeling of Visual Attentional Mechanisms , 2003, Artificial Intelligence Review.

[39]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[40]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[41]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[42]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[43]  G. Legge,et al.  Mr. Chips: An ideal-observer model of reading , 1997 .

[44]  Claudio M. Privitera,et al.  Vision theory guiding Web communication , 2000, IS&T/SPIE Electronic Imaging.

[45]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[46]  G Wallis Linear models of simple cells: correspondence to real cell responses and space spanning properties. , 2001, Spatial vision.

[47]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[48]  Christopher M. Brown,et al.  Controlling eye movements with hidden Markov models , 2004, International Journal of Computer Vision.

[49]  Jordan Grafman,et al.  Handbook of Neuropsychology , 1991 .

[50]  S. Treue Visual attention: the where, what, how and why of saliency , 2003, Current Opinion in Neurobiology.

[51]  Claudio M. Privitera,et al.  Representation of human vision in the brain: How does human perception recognize images? , 2001, J. Electronic Imaging.

[52]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[53]  R. Almond The therapeutic community. , 1971, Scientific American.

[54]  Ronald M. Lesperance,et al.  The Gaussian derivative model for spatial-temporal vision: I. Cortical model. , 2001, Spatial vision.

[55]  J. Gallant,et al.  Goal-Related Activity in V4 during Free Viewing Visual Search Evidence for a Ventral Stream Visual Salience Map , 2003, Neuron.

[56]  R. Desimone,et al.  Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. , 1997, Journal of neurophysiology.