Focus-of-attention from local color symmetries

In this paper, a continuous valued measure for local color symmetry is introduced. The new algorithm is an extension of the successful gray value-based symmetry map proposed by Reisfeld et al. The use of color facilitates the detection of focus points (FPs) on objects that are difficult to detect using gray-value contrast only. The detection of FPs is aimed at guiding the attention of an object recognition system; therefore, FPs have to fulfill three major requirements: stability, distinctiveness, and usability. The proposed algorithm is evaluated for these criteria and compared with the gray value-based symmetry measure and two other methods from the literature. Stability is tested against noise, object rotation, and variations of lighting. As a measure for the distinctiveness of FPs, the principal components of FP-centered windows are compared with those of windows at randomly chosen points on a large database of natural images. Finally, usability is evaluated in the context of an object recognition task.

[1]  Vicky G Bruce,et al.  Violations of Symmetry and Repetition in Visual Patterns , 1975 .

[2]  Terence D. Sanger,et al.  Optimal unsupervised learning in a single-layer linear feedforward neural network , 1989, Neural Networks.

[3]  Alston S. Householder,et al.  The Theory of Matrices in Numerical Analysis , 1964 .

[4]  Luc Van Gool,et al.  Content-Based Image Retrieval Based on Local Affinely Invariant Regions , 1999, VISUAL.

[5]  Hans P. Moravec.  Towards Automatic Visual Obstacle Avoidance , 1977, IJCAI.

[6]  Alex Pentland,et al.  Probabilistic Visual Learning for Object Representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Helge J. Ritter,et al.  Guiding attention for grasping tasks by gestural instruction: the GRAVIS-robot architecture , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[8]  Claudio M. Privitera,et al.  Algorithms for Defining Visual Regions-of-Interest: Comparison with Eye Fixations , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Han Wang,et al.  Analysis of gray level corner detection , 1999, Pattern Recognit. Lett..

[10]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[11]  J. Koenderink,et al.  Representation of local geometry in the visual system , 1987, Biological Cybernetics.

[12]  Ruzena Bajcsy,et al.  Active and exploratory perception , 1992, CVGIP Image Underst..

[13]  Yehezkel Yeshurun,et al.  Context-free attentional operators: The generalized symmetry transform , 1995, International Journal of Computer Vision.

[14]  Franz Kummert,et al.  Towards and Image Understanding Architecture for a Situated Artificial Communicator , 1999 .

[15]  Helge Ritter,et al.  Combining multiple neural nets for visual feature selection and classification , 1999 .

[16]  Bärbel Mertsching,et al.  Data- and Model-Driven Gaze Control for an Active-Vision System , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Hiroshi Murase,et al.  Visual learning and recognition of 3-d objects from appearance , 2005, International Journal of Computer Vision.

[18]  Helge J. Ritter,et al.  Efficient Vector Quantization Using the WTA-Rule with Activity Equalization , 2004, Neural Processing Letters.

[19]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Han Wang,et al.  Gray Level Corner Detection , 1998, MVA.

[21]  T. Lindeberg,et al.  Scale-Space Theory : A Basic Tool for Analysing Structures at Different Scales , 1994 .

[22]  Thomas Kalinke,et al.  An image processing system for driver assistance , 2000, Image Vis. Comput..

[23]  Paul Beaudet,et al.  Rotationally invariant image operators , 1978 .

[24]  Rajesh P. N. Rao,et al.  An Active Vision Architecture Based on Iconic Representations , 1995, Artif. Intell..

[25]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[26]  P. Locher,et al.  SYMMETRY CATCHES THE EYE , 1987 .

[27]  Kjell Brunnström,et al.  Active fixation for scene exploration , 1996, International Journal of Computer Vision.

[28]  Chin-Hsing Chen,et al.  Wavelet transformation for gray-level corner detection , 1995, Pattern Recognit..

[29]  Rajesh P. N. Rao,et al.  Modeling Saccadic Targeting in Visual Search , 1995, NIPS.

[30]  Hans P. Morevec.  Towards automatic visual obstacle avoidance , 1977, IJCAI 1977.

[31]  Helge J. Ritter,et al.  A system for various visual classification tasks based on neural networks , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[32]  Gunther Heidemann,et al.  Ein flexibel einsetzbares Objekterkennungssystem auf der Basis neuronaler Netze , 1998, DISKI.

[33]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[34]  Jan Flusser,et al.  Robust detection of significant points in multiframe images , 1999, Pattern Recognit. Lett..

[35]  Gérard G. Medioni,et al.  Corner detection and curve representation using cubic B-splines , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[36]  Chin-Hsing Chen,et al.  Multiscale corner detection by using wavelet transform , 1995, IEEE Trans. Image Process..

[37]  I. Daubechies.  Orthonormal bases of compactly supported wavelets , 1988 .

[38]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[39]  G. Medioni,et al.  Corner detection and curve representation using cubic B-splines , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[40]  L. Kaufman,et al.  Spontaneous fixation tendencies for visual forms , 1969 .

[41]  Ali Shokoufandeh,et al.  View-based object recognition using saliency maps , 1999, Image Vis. Comput..

[42]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[43]  Nicu Sebe,et al.  Image retrieval using wavelet-based salient points , 2001, J. Electronic Imaging.

[44]  Cordelia Schmid,et al.  Local Grayvalue Invariants for Image Retrieval , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Jean-Michel Jolion,et al.  Detection of Interest Points for Image Indexation , 1999, VISUAL.

[46]  Hagit Hel-Or,et al.  Symmetry as a Continuous Feature , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Radu Horaud,et al.  Finding Geometric and Relational Structures in an Image , 1990, ECCV.

[48]  Tony Lindeberg,et al.  Detecting salient blob-like image structures and their scales with a scale-space primal sketch: A method for focus-of-attention , 1993, International Journal of Computer Vision.

[49]  Thomas Kalinke,et al.  Entropie als Maß des lokalen Informationsgehalts in Bildern zur Realisierung einer Aufmerksamkeitssteuerung , 1996, DAGM-Symposium.

[50]  Leslie S. Smith,et al.  The principal components of natural images , 1992 .

[51]  Helge J. Ritter,et al.  A multi-directional multiple-path recognition scheme for complex objects applied to the domain of a wooden toy kit , 1999, Pattern Recognit. Lett..

[52]  Yiannis Aloimonos,et al.  Active vision , 2004, International Journal of Computer Vision.

[53]  James L. Crowley,et al.  Layered Control of a Binocular Camera Head , 1993, Int. J. Pattern Recognit. Artif. Intell..

[54]  Robert Laganière,et al.  Morphological corner detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[55]  Michael Werman,et al.  Ridge's corner detection and correspondence , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[56]  Hans-Hellmut Nagel,et al.  Volumetric model and 3D trajectory of a moving car derived from monocular TV frame sequences of a street scene , 1981, Comput. Graph. Image Process..

[57]  Tim Wilhelm Nattkemper,et al.  Farbe und Symmetrie für die datengetriebene Generierung prägnanter Fokuspunkte , 1998 .

[58]  S. Mallat.  A wavelet tour of signal processing , 1998 .

[59]  Wolfgang Förstner,et al.  A Framework for Low Level Feature Extraction , 1994, ECCV.

[60]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[61]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[62]  Michael Brady,et al.  The Curvature Primal Sketch , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[63]  Ipke Wachsmuth,et al.  Collaborative Research Centre “Situated Artificial Communicators” at the University of Bielefeld, Germany , 2004, Artificial Intelligence Review.

[64]  Olaf Kübler,et al.  Simulation of neural contour mechanisms: from simple to end-stopped cells , 1992, Vision Research.

[65]  S. Palmer.  The Psychology of Perceptual Organization: A Transformational Approach , 1983 .