Comparison of local descriptors for image registration of geometrically-complex 3D scenes

Image registration is an important process in a number of machine vision applications. It is often used as a pre-processing step to gain a better understanding of the images and many techniques have been proposed to better register a set of images without user intervention. The performance of these techniques are often scene-dependent and a technique designed for one application often performs less favourably under a different condition. In this paper, the performance of a number of local descriptor methods which have been proposed for image registration are studied, in particular, the main focus is on the techniques based on the SIFT descriptor for use with Maori artefacts. These techniques have been previously studied and shown to have good performance in the case of planar scenes or scenes which are far away from the camera, however little data exist for geometrically-complex 3D scenes. The experimental setup used in the work which allows for a fair and accurate comparison of the techniques under a number of different conditions is presented. The results from the work are presented and the reasons for the poor performance of the descriptors under the given scenes and conditions are discussed. Finally, based on the results obtained, the proposed approach for automatic registration of images of Maori artefacts are presented.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  C. Schmid,et al.  Indexing based on scale invariant interest points , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[3]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[4]  Ngahuia Te Awekotuku,et al.  The old-time Maori , 1938 .

[5]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[6]  Andrew Zisserman,et al.  An Affine Invariant Salient Region Detector , 2004, ECCV.

[7]  Cordelia Schmid,et al.  An Affine Invariant Interest Point Detector , 2002, ECCV.

[8]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[9]  Luc Van Gool,et al.  Content-Based Image Retrieval Based on Local Affinely Invariant Regions , 1999, VISUAL.

[10]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[11]  Aly A. Farag,et al.  CSIFT: A SIFT Descriptor with Color Invariant Characteristics , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[13]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Horst Bischof,et al.  Efficient Maximally Stable Extremal Region (MSER) Tracking , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[15]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, CVPR 2004.

[16]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[17]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Cordelia Schmid,et al.  A sparse texture representation using local affine regions , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[20]  Cordelia Schmid,et al.  Comparison of affine-invariant local detectors and descriptors , 2004, 2004 12th European Signal Processing Conference.

[21]  Tomaso Poggio,et al.  Cooperative computation of stereo disparity , 1988 .

[22]  Luc Van Gool,et al.  Affine/ Photometric Invariants for Planar Intensity Patterns , 1996, ECCV.

[23]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..