On Affine Invariant Descriptors Related to SIFT

Using a classical result on algebraic invariants of the unimodular group, we present in this paper some basic geometric affine invariant quantities, and we use them to construct some distinctive descriptors for object detection. Although full affine invariance cannot be guaranteed due to noncommutativity of camera blur with affine maps and the domain problem (that is, the difficulty of finding an affine covariant domain), the proposed descriptors behave more robustly than SIFT with respect to affine deformations. This is supported by our comparisons both with the version of SIFT computed on an affine normalized neighborhood, and with ASIFT, which solves both the previously mentioned camera blur and domain problems by cleverly sampling the orbit of affine transformations of the images.

[1]  Enric Meinhardt Llopis.  Morphological and statistical techniques for the analysis of 3D images , 2011 .

[2]  Tony Lindeberg,et al.  Shape-adapted smoothing in estimation of 3-D shape cues from affine deformations of local 2-D brightness structure , 1997, Image Vis. Comput..

[3]  Jean-Michel Morel,et al.  ASIFT: A New Framework for Fully Affine Invariant Image Comparison , 2009, SIAM J. Imaging Sci..

[4]  L. Ambrosio,et al.  Functions of Bounded Variation and Free Discontinuity Problems , 2000 .

[5]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[6]  Antonio Torralba,et al.  SIFT Flow: Dense Correspondence across Different Scenes , 2008, ECCV.

[7]  Pascal Monasse,et al.  Fast computation of a contrast-invariant image representation , 2000, IEEE Trans. Image Process..

[8]  Vincent Lepetit,et al.  Fast Keypoint Recognition Using Random Ferns , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[11]  Alexander M. Bronstein,et al.  Are MSER Features Really Interesting? , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Philippe Salembier,et al.  Flat zones filtering, connected operators, and filters by reconstruction , 1995, IEEE Trans. Image Process..

[13]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[14]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Jean-Michel Morel,et al.  ASIFT: An Algorithm for Fully Affine Invariant Comparison , 2011, Image Process. Line.

[17]  Vincent Lepetit,et al.  Randomized trees for real-time keypoint recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[19]  Michael Isard,et al.  Object retrieval with large vocabularies and fast spatial matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  G. Sapiro,et al.  On affine plane curve evolution , 1994 .

[21]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[22]  Luc Van Gool,et al.  Content-Based Image Retrieval Based on Local Affinely Invariant Regions , 1999, VISUAL.

[23]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[24]  Lionel Moisan,et al.  On the Theory of Planar Shape , 2003, Multiscale Model. Simul..

[25]  Cordelia Schmid,et al.  Semi-Local Affine Parts for Object Recognition , 2004, BMVC.

[26]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[27]  Luc Van Gool,et al.  Recognizing color patterns irrespective of viewpoint and illumination , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[28]  Lionel Moisan,et al.  A Probabilistic Criterion to Detect Rigid Point Matches Between Two Images and Estimate the Fundamental Matrix , 2004, International Journal of Computer Vision.

[29]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[30]  O. Hellwich,et al.  An efficient front-end facial pose estimation system for face recognition , 2008, Pattern Recognition and Image Analysis.

[31]  Guillermo Sapiro,et al.  Affine invariant scale-space , 1993, International Journal of Computer Vision.

[32]  Luc Van Gool,et al.  Local Features for Image Retrieval , 1999, State-of-the-Art in Content-Based Image and Video Retrieval.

[33]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[34]  Tony Lindeberg,et al.  Direct computation of shape cues using scale-adapted spatial derivative operators , 1996, International Journal of Computer Vision.

[35]  H. Weyl.  The Classical Groups , 1940 .

[36]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[37]  Vincent Lepetit,et al.  Keypoint recognition using randomized trees , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Guillermo Sapiro,et al.  Differential Invariant Signatures and Flows in Computer Vision: A Symmetry Group Approach , 1994, Geometry-Driven Diffusion in Computer Vision.

[39]  Wolfgang Heidrich,et al.  Cloth Motion Capture , 2003, SIGGRAPH '03.

[40]  Vicent Caselles,et al.  Affine Invariant Segmentation by Variational Method , 1996, SIAM J. Appl. Math..

[41]  Jean-Michel Morel,et al.  A Theory of Shape Identification , 2008 .

[42]  Andrew Zisserman,et al.  Scene Classification Using a Hybrid Generative/Discriminative Approach , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  P. Lions,et al.  Axioms and fundamental equations of image processing , 1993 .

[44]  Matthew A. Brown,et al.  Invariant Features from Interest Point Groups , 2002, BMVC.

[45]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[46]  Alfred M. Bruckstein,et al.  Invariant signatures for planar shape recognition under partial occlusion , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[47]  J. Morel,et al.  Is SIFT scale invariant , 2011 .

[48]  Pascal Monasse,et al.  Grain Filters , 2002, Journal of Mathematical Imaging and Vision.

[49]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[50]  Pascal Monasse,et al.  Contrast invariant registration of images , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[51]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[52]  Andrew Zisserman,et al.  Image Classification using Random Forests and Ferns , 2007, 2007 IEEE 11th International Conference on Computer Vision.