Fast and Robust Generation of Feature Maps for Region-Based Visual Attention

Visual attention is one of the important phenomena in biological vision which can be followed to achieve more efficiency, intelligence, and robustness in artificial vision systems. This paper investigates a region-based approach that performs pixel clustering prior to the processes of attention in contrast to late clustering as done by contemporary methods. The foundation steps of feature map construction for the region-based attention model are proposed here. The color contrast map is generated based upon the extended findings from the color theory, the symmetry map is constructed using a novel scanning-based method, and a new algorithm is proposed to compute a size contrast map as a formal feature channel. Eccentricity and orientation are computed using the moments of obtained regions and then saliency is evaluated using the rarity criteria. The efficient design of the proposed algorithms allows incorporating five feature channels while maintaining a processing rate of multiple frames per second. Another salient advantage over the existing techniques is the reusability of the salient regions in the high-level machine vision procedures due to preservation of their shapes and precise locations. The results indicate that the proposed model has the potential to efficiently integrate the phenomenon of attention into the main stream of machine vision and systems with restricted computing resources such as mobile robots can benefit from its advantages.

[1]  Heinz Hügli,et al.  A Model of Dynamic Visual Attention for Object Tracking in Natural Image Sequences , 2003, IWANN.

[2]  Jang-Kyoo Shin,et al.  Biologically Inspired Saliency Map Model for Bottom-up Visual Attention , 2002, Biologically Motivated Computer Vision.

[3]  Fred Stentiford,et al.  Attention Based Auto Image Cropping , 2007, ICVS 2007.

[4]  John K. Tsotsos,et al.  An attentional framework for stereo vision , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[5]  Henrik I. Christensen,et al.  Object based visual attention: searching for objects defined by size , 2004 .

[6]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.

[7]  B. Fischer,et al.  Express-saccades of the monkey: Reaction times versus intensity, size, duration, and eccentricity of their targets , 2004, Experimental Brain Research.

[8]  Robert B. Fisher,et al.  Object-based visual attention for computer vision , 2003, Artif. Intell..

[9]  Jan Flusser,et al.  Rotation Moment Invariants for Recognition of Symmetric Objects , 2006, IEEE Transactions on Image Processing.

[10]  Simone Frintrop,et al.  Goal-Directed Search with a Top-Down Modulated Computational Attention System , 2005, DAGM-Symposium.

[11]  Brian Wandell,et al.  Colour tuning inhumanvisual cortexmeasuredwith functionalmagnetic resonance imaging , 1997 .

[12]  Patrick Le Callet,et al.  A coherent computational approach to model bottom-up visual attention , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  John K. Tsotsos,et al.  Selective Tuning: Feature Binding Through Selective Attention , 2006, ICANN.

[14]  Shoji Itakura,et al.  Attention to repeated events in human infants (Homo sapiens): effects of joint visual attention versus stimulus change , 2001, Animal Cognition.

[15]  Luiz Henrique Alves Monteiro,et al.  Symmetry Detection Using Global-Locally Coupled Maps , 2002, ICANN.

[16]  Allen Allport,et al.  Visual attention , 1989 .

[17]  Bärbel Mertsching,et al.  Color Saliency and Inhibition Using Static and Dynamic Scenes in Region Based Visual Attention , 2008, WAPCV.

[18]  Helge J. Ritter,et al.  Integrating Context-Free and Context-Dependent Attentional Mechanisms for Gestural Object Reference , 2003, ICVS.

[19]  Weisi Lin,et al.  Modeling visual attention's modulatory aftereffects on visual sensitivity and quality evaluation , 2005, IEEE Transactions on Image Processing.

[20]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[21]  S. Engel,et al.  Colour tuning in human visual cortex measured with functional magnetic resonance imaging , 1997, Nature.

[22]  Nahum Kiryati,et al.  Detecting Symmetry in Grey Level Images: The Global Optimization Approach , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[23]  Bärbel Mertsching,et al.  An Attentional Approach for Perceptual Grouping of Spatially Distributed Patterns , 2007, DAGM-Symposium.

[24]  Peter Neri,et al.  Attentional effects on sensory tuning for single-feature detection and double-feature conjunction , 2004, Vision Research.

[25]  Fred Stentiford,et al.  An estimator for visual attention through competitive novelty with application to image compression , 2001 .

[26]  Bärbel Mertsching,et al.  Evaluation of Visual Attention Models for Robots , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[27]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[28]  Frank H. Mahnke,et al.  Color, Environment, and Human Response: An Interdisciplinary Understanding of Color and Its Use As a Beneficial Element in the Design of the Architectural Environment , 1996 .

[29]  Narendra Ahuja,et al.  A Transform for Multiscale Image Segmentation by Integrated Edge and Region Detection , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  R A Abrams,et al.  Color-based inhibition of return , 1995, Perception & psychophysics.

[31]  Bärbel Mertsching,et al.  Data- and Model-Driven Gaze Control for an Active-Vision System , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Yoel Shkolnisky,et al.  A signal processing approach to symmetry detection , 2006, IEEE Transactions on Image Processing.

[33]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[34]  Fred Stentiford Attention Based Facial Symmetry Detection , 2005, ICAPR.

[35]  Fred Stentiford,et al.  Visual attention for region of interest coding in JPEG 2000 , 2003, J. Vis. Commun. Image Represent..

[36]  Laurent Itti,et al.  Top-down attention selection is fine grained. , 2006, Journal of vision.

[37]  Alan Chalmers,et al.  Visual attention models for producing high fidelity graphics efficiently , 2003, SCCG '03.

[38]  Arthur Karp,et al.  The Elements of Color , 1970 .

[39]  John K. Tsotsos,et al.  Towards a Biologically Plausible Active Visual Search Model , 2004, WAPCV.

[40]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[41]  Muhammad Zaheer Aziz,et al.  Pop-out and IOR in Static Scenes with Region B ased Visual Attention , 2007 .