Range data registration using photometric features

This paper investigates the use of photometric features for the pair-wise registration of range images. Many artificial and natural objects exhibit abundant surface texture that may not be revealed in range data, and most structured light and laser range sensors are capable of capturing either grayscale or color photometric intensity in addition to range data. Nevertheless, the use of photometric features has not been widely investigated for range data registration, despite widespread research into local feature descriptors for object recognition in 2D photometric images. This paper addresses some of the problems that arise in using photometric features for range data registration, and presents a systematic method for their use. Potentially useful photometric features are detected on planar regions in 3D, and then reprojected to 2D to remove the perspective distortion. Then, a well-established 2D rotation- and brightness-invariant image feature descriptor is used for matching. Range data alignment is performed using a RANSAC algorithm, with verification performed in 3D. Experimental results demonstrate the effectiveness of this method.

[1]  Ray Jarvis,et al.  3D free-form surface registration and object recognition , 2004, International Journal of Computer Vision.

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[5]  Sang Wook Lee,et al.  ICP Registration Using Invariant Features , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Cordelia Schmid,et al.  Local Grayvalue Invariants for Image Retrieval , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Naokazu Yokoya,et al.  A Robust Method for Registration and Segmentation of Multiple Range Images , 1995, Comput. Vis. Image Underst..

[8]  Gilbert Soucy.  Surface Recovery from Range Images Using Curvature and Motion Consistency , 1997, Comput. Vis. Image Underst..

[9]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Sing Bing Kang,et al.  Registration and integration of textured 3-D data , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[11]  Cordelia Schmid,et al.  An Affine Invariant Interest Point Detector , 2002, ECCV.

[12]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[13]  Nicholas Ayache,et al.  Rigid, affine and locally affine registration of free-form surfaces , 1996, International Journal of Computer Vision.

[14]  Jean-Philippe Thirion,et al.  New feature points based on geometric invariants for 3D image registration , 1996, International Journal of Computer Vision.

[15]  Reinhard Klein,et al.  Image-Based Registration of 3D-Range Data Using Feature Surface Elements , 2004, VAST.

[16]  Andrew E. Johnson,et al.  Surface matching for object recognition in complex three-dimensional scenes , 1998, Image Vis. Comput..

[17]  Gerhard Roth.  Registering two overlapping range images , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).