A Color-Based Interest Operator

In this paper we propose a novel interest operator robust to photometric and geometric transformations. Our operator is closely related to the grayscale MSER but it works on the HSV color space, as opposed to the most popular operators in the literature, which are intensity based. It combines a fine and a coarse overlapped quantization of the HSV color space to find maximally stable extremal regions on each of its components and combine them into a final set of regions that are useful in images where intensity does not discriminate well. We evaluate the performance of our operator on two different applications: wide-baseline stereo matching and image annotation.

[1]  Lei Zhang,et al.  A CBIR method based on color-spatial feature , 1999, Proceedings of IEEE. IEEE Region 10 Conference. TENCON 99. 'Multimedia Technology for Asia-Pacific Information Infrastructure' (Cat. No.99CH37030).

[2]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[3]  Luc Van Gool,et al.  Content-Based Image Retrieval Based on Local Affinely Invariant Regions , 1999, VISUAL.

[4]  Cordelia Schmid,et al.  Coloring Local Feature Extraction , 2006, ECCV.

[5]  Cordelia Schmid,et al.  Learning Object Representations for Visual Object Class Recognition , 2007, ICCV 2007.

[6]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[7]  Koen E. A. van de Sande,et al.  Evaluation of color descriptors for object and scene recognition , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[9]  Cordelia Schmid,et al.  Semantic Hierarchies for Visual Object Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[11]  Andrew Zisserman,et al.  An Affine Invariant Salient Region Detector , 2004, ECCV.

[12]  Jing-li Zhou,et al.  Image retrieval using both color and local spatial feature histograms , 2004, 2004 International Conference on Communications, Circuits and Systems (IEEE Cat. No.04EX914).

[13]  Per-Erik Forssén,et al.  Maximally Stable Colour Regions for Recognition and Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[15]  Cordelia Schmid,et al.  Local Grayvalue Invariants for Image Retrieval , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Chris Harris,et al.  Geometry from visual motion , 1993 .

[17]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[18]  Andrew Zisserman,et al.  Automated location matching in movies , 2003, Comput. Vis. Image Underst..