Image-type dependent eigen-regions-of-interest define conspicuity operators for predicting human scanpath fixation

Top-down informativeness elaboration and bottom-up conspicuity processing are intimately interconnected in visual perception. An internal cognitive model of the external world must necessarily control not only our recognition but also the scanpath sequence of eye movement/shift of attention jumps. A self-organizing process based on principal component analysis and scanpath experimental data are used in this paper to define spatial visual conspicuity from the eigen-features of the scanpath sequence image loci. Eight different classes of images are used as both training and testing set. We first demonstrate that cognitive-driven scanpath loci can be discriminated in terms of these bottom-up eigen conspicuity features. We can finally define a conspicuity processing algorithm and measure its ability to predict human scanpaths as evidenced by the positional similarity measure Sp. Some computer vision applications will also be discussed.

[1]  C. Fyfe,et al.  Finding compact and sparse-distributed representations of visual images , 1995 .

[2]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[3]  Claudio M. Privitera,et al.  On the discriminability of hROIs, human visually selected regions-of-interest , 2005, Biological Cybernetics.

[4]  Claudio M. Privitera,et al.  Algorithms for Defining Visual Regions-of-Interest: Comparison with Eye Fixations , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[6]  L. Stark,et al.  Spontaneous Eye Movements During Visual Imagery Reflect the Content of the Visual Scene , 1997, Journal of Cognitive Neuroscience.

[7]  RICHARD L. DIDDAY,et al.  Eye Movements and Visual Perception: A "Two Visual System" Model , 1975, Int. J. Man Mach. Stud..

[8]  G. Hauske,et al.  Object and scene analysis by saccadic eye-movements: an investigation with higher-order statistics. , 2000, Spatial vision.

[9]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[10]  C. C. Law,et al.  Formation of receptive fields in realistic visual environments according to the Bienenstock, Cooper, and Munro (BCM) theory. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[11]  J. Rubner,et al.  Development of feature detectors by self-organization , 2004, Biological Cybernetics.

[12]  Claudio M. Privitera,et al.  Human-vision-based selection of image processing algorithms for planetary exploration , 2003, IEEE Trans. Image Process..

[13]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[14]  George W. McConkie,et al.  Eye movements and human information processing , 1985 .

[15]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[16]  R. Almond The therapeutic community. , 1971, Scientific American.

[17]  D. Noton,et al.  Eye movements and visual perception. , 1971, Scientific American.

[18]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[19]  Claudio M. Privitera,et al.  Representation of human vision in the brain: How does human perception recognize images? , 2001, J. Electronic Imaging.

[20]  D. S. Wooding,et al.  The relationship between the locations of spatial features and those of fixations made during visual examination of briefly presented images. , 1996, Spatial vision.

[21]  P Reinagel,et al.  Natural scene statistics at the centre of gaze. , 1999, Network.

[22]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[23]  D. Mackay,et al.  Analysis of Linsker's application of Hebbian rules to linear networks , 1990 .

[24]  Leslie S. Smith,et al.  The principal components of natural images , 1992 .

[25]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[26]  W. W. Peterson,et al.  The theory of signal detectability , 1954, Trans. IRE Prof. Group Inf. Theory.