Viewpoint normalized images for feature based landmark detection

Image feature based landmark detection is widely used in machine vision for mobile robotics applications. Advanced image feature extraction algorithms offer robust keypoint detection as being invariant to numerous transformations such as translation, rotation, scale change. Even slight changes in brightness, contrast or viewpoint do not affect feature point matching abilities. The most widely used advanced image feature extraction algorithms such as SIFT (Scale Invariant Feature Transform) and SURF (Speeded Up Robust Feature) both have these features. Both algorithms implement feature point detection and descriptor generation. Descriptor vectors are calculated around feature points to distinguish and match these points based on the image content. In the application of mobile robotics viewpoint invariance is essential. As the robot moves in its environment it must detect landmarks from widely different viewpoints to improve efficiency of SLAM algorithms. This is essential in loop closing situations. In this paper we evaluate a method to improve viewpoint invariance based on the additional data provided by range image sensors to supplement traditional feature extraction algorithms. Planes are extracted from range images based on local surface normal histograms and feature point matching is evaluated in viewpoint normalized image planes. We present a simulation framework and results for the selected algorithm. We compare feature point matching with and without the improvement.

[1]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[2]  Aly A. Farag,et al.  CSIFT: A SIFT Descriptor with Color Invariant Characteristics , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[3]  Gertjan J. Burghouts,et al.  Performance evaluation of local colour invariants , 2009, Comput. Vis. Image Underst..

[4]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Liang Cheng,et al.  Robust Affine Invariant Feature Extraction for Image Matching , 2008, IEEE Geoscience and Remote Sensing Letters.

[6]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Yanpeng Cao,et al.  Viewpoint invariant features from single images using 3D geometry , 2009, 2009 Workshop on Applications of Computer Vision (WACV).

[8]  Michael Ying Yang,et al.  Robust alignment of wide baseline terrestrial laser scans via 3D viewpoint normalization , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[9]  Niko Sünderhauf,et al.  COMPARING SEVERAL IMPLEMENTATIONS OF TWO RECENTLY PUBLISHED FEATURE DETECTORS , 2007 .

[10]  Dongming Zhao,et al.  Gradient based polyhedral segmentation for 3-D range image , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[11]  Bayumy A. B. Youssef,et al.  A New Approach for 3D Range Image Segmentation using Gradient Method , 2011 .

[12]  Kanad K. Biswas,et al.  An integrated approach for range image segmentation and representation , 1996, Artif. Intell. Eng..

[13]  Michael Ying Yang,et al.  Fusion of camera images and laser scans for wide baseline 3D scene alignment in urban environments , 2011 .

[14]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[15]  Arnold W. M. Smeulders,et al.  Color Invariant SURF in Discriminative Object Tracking , 2010, ECCV Workshops.

[16]  Simon Lacroix,et al.  Vision-Based SLAM: Stereo and Monocular Approaches , 2007, International Journal of Computer Vision.

[17]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[18]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[19]  Jan-Michael Frahm,et al.  3D model matching with Viewpoint-Invariant Patches (VIP) , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Jean-Michel Morel,et al.  A fully affine invariant image comparison method , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[22]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..