Extending Surf to the Color Domain

Automatic extraction of local features from images plays an important role in many computer vision tasks. During the last years, much focus has been put on making the features invariant to geometric transformations such as a rotation and scaling of the image. Recently, some work has been published concerning the integration of color information into the detection and description step of SIFT. In various evaluations, it has been shown that including color information can increase distinctiveness and invariance to photometric transformations caused by illumination changes. In this paper we build on the results from these approaches and apply them to the SURF descriptor, which is advantageous compared to SIFT in terms of speed, making it a perfect candidate for online applications, for example in the field of robotics. Our results show significant improvements concerning the repeatability and destinctiveness of SURF for 3d objects under varying illumination directions. In contrast to many other evaluations we also determine the accuracy of the orientation assignment and include this into our comparisons.

[1]  Anlong Ming,et al.  A blob detector in color images , 2007, CIVR '07.

[2]  Arnold W. M. Smeulders,et al.  Color Invariance , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Andrew Zisserman,et al.  Scene Classification Using a Hybrid Generative/Discriminative Approach , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Arnold W. M. Smeulders,et al.  Color and Scale: The Spatial Structure of Color Images , 2000, ECCV.

[5]  Arnold W. M. Smeulders,et al.  The Amsterdam Library of Object Images , 2004, International Journal of Computer Vision.

[6]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[7]  Joost van de Weijer,et al.  Boosting color saliency in image feature detection , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[9]  Koen E. A. van de Sande,et al.  Color Descriptors for Object Category Recognition , 2008, CGIV/MCS.

[10]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Cordelia Schmid,et al.  Coloring Local Feature Extraction , 2006, ECCV.

[12]  Koen E. A. van de Sande,et al.  Evaluation of color descriptors for object and scene recognition , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Arnold W. M. Smeulders,et al.  Color Based Object Recognition , 1997, ICIAP.

[14]  Ghassan Hamarneh,et al.  Quaternion Color Curvature , 2008, Color Imaging Conference.

[15]  David J. Kriegman,et al.  Color Subspaces as Photometric Invariants , 2006, CVPR.

[16]  Joost van de Weijer,et al.  Color edge detection by photometric quasi-invariants , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  Nicolas Le Bihan,et al.  Quaternion principal component analysis of color images , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[18]  Aly A. Farag,et al.  CSIFT: A SIFT Descriptor with Color Invariant Characteristics , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[19]  Gertjan J. Burghouts,et al.  Performance evaluation of local colour invariants , 2009, Comput. Vis. Image Underst..

[20]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[21]  Luc Van Gool,et al.  Omnidirectional sparse visual path following with occlusion-robust feature tracking , 2005 .