Stereo Saliency Map Considering Affective Factors in a Dynamic Environment

We propose a new integrated saliency map model, which reflects more human-like visual attention mechanism. The proposed model considers not only the binocular stereopsis to construct a final attention area so that the closer attention area can be easily made to pop-out as in human binocular vision, based on the single eye alignment hypothesis, but also both static and dynamic features of an input scene. Moreover, the proposed saliency map model includes an affective computing process to skip an unwanted area and/or to pay attention to a desired area, mimicking the pulvinar's function in the human preference and refusal mechanism in subsequent visual search processes. In addition, we show the effectiveness of using the symmetry feature implemented by a neural network and independent component analysis (ICA) filter to construct more object preferable attention model. The experimental results show that the proposed model can generate more plausible scan paths for natural input scenes.

[1]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[2]  R Held,et al.  The development of eye alignment, convergence, and sensory binocularity in young infants. , 1994, Investigative ophthalmology & visual science.

[3]  Seong-Whan Lee,et al.  Biologically Motivated Computer Vision , 2002, Lecture Notes in Computer Science.

[4]  Frank S. Werblin,et al.  Parallel Visual Processing: a Tutorial of Retinal Function , 2004, Int. J. Bifurc. Chaos.

[5]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[6]  Timothy J Andrews,et al.  The Role of Voluntary and Involuntary Attention in Selecting Perceptual Dominance during Binocular Rivalry , 2007, Perception.

[7]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[8]  Dennis M. Levi,et al.  Mechanisms of perceptual learning for vernier acuity , 2002 .

[9]  Minho Lee,et al.  Dynamic visual selective attention model , 2008, Neurocomputing.

[10]  Henrik I. Christensen,et al.  Visual Attention Using Game Theory , 2002, Biologically Motivated Computer Vision.

[11]  Minho Lee,et al.  Biologically motivated vergence control system using human-like selective attention model , 2006, Neurocomputing.

[12]  Yehezkel Yeshurun,et al.  Context-free attentional operators: The generalized symmetry transform , 1995, International Journal of Computer Vision.

[13]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[14]  J. Duncan Selective attention and the organization of visual information. , 1984, Journal of experimental psychology. General.

[15]  J. Gallant,et al.  Goal-Related Activity in V4 during Free Viewing Visual Search Evidence for a Ventral Stream Visual Salience Map , 2003, Neuron.

[16]  Pietro Perona,et al.  Selective visual attention enables learning and recognition of multiple objects in cluttered scenes , 2005, Comput. Vis. Image Underst..

[17]  Robert Ward,et al.  Emotion recognition following human pulvinar damage , 2007, Neuropsychologia.

[18]  L. Itti,et al.  Visual causes versus correlates of attentional selection in dynamic scenes , 2006, Vision Research.

[19]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[20]  Mark W Pettet,et al.  Temporal dynamics of the human response to symmetry. , 2002, Journal of vision.

[21]  Laurent Itti,et al.  An Integrated Model of Top-Down and Bottom-Up Attention for Optimizing Detection Speed , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[22]  Rosalind W. Picard Affective Computing , 1997 .

[23]  Jun Saiki,et al.  Stochastic Guided Search Model for Search Asymmetries in Visual Search Tasks , 2002, Biologically Motivated Computer Vision.

[24]  Kunihiko Fukushima,et al.  Use of non-uniform spatial blur for image comparison: symmetry axis extraction , 2005, Neural Networks.

[25]  Minho Lee,et al.  Saliency map model with adaptive masking based on independent component analysis , 2002, Neurocomputing.