Developing structural constraints for accurate registration of overlapping range images

Automatic image registration is an attractive and unresolved problem in the machine vision literature. This paper presents two novel structural constraints, namely proximity and closeness constraints, that improve both the accuracy and robustness of an existing motion consistency based algorithm (GICP) for automatic image registration. It also defines the conditions when such constraints are fired at specific points of the registration of two overlapping range images. The proximity constraint says that neighbouring points should be neighbouring before and after a rigid motion. The closeness constraint implements a local closest point search from the second image to the first image. While the GICP algorithm uses an exhaustive search for the closest points, in this paper, we employ the optimised k–d tree data structure to accelerate the closest point search. A large number of experiments based on real range images demonstrate that the combination of rigid motion constraints with these novel proximity and closeness constraints leads to a more accurate and robust evaluation of possible correspondences leading, in turn, to more accurate, robust and efficient automatic image registration results. © 2004 Elsevier B.V. All rights reserved.

[1]  Ross T. Whitaker,et al.  Indoor scene reconstruction from sets of noisy range images , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[2]  Andrew E. Johnson,et al.  Registration and integration of textured 3-D data , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[3]  David Cooper,et al.  Using geometric properties of correspondence vectors for the registration of free-form shapes , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[4]  Marcos A. Rodrigues,et al.  Geometrical Analysis of Two Sets of 3D Correspondence Data Patterns for the Registration of Free-Form Shapes , 2002, J. Intell. Robotic Syst..

[5]  Aly A. Farag,et al.  Free-form surface registration using surface signatures , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Katsushi Ikeuchi,et al.  Sensor Modeling, Probabilistic Hypothesis Generation, and Robust Localization for Object Recognition , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Sang Wook Lee,et al.  Invariant features and the registration of rigid bodies , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[8]  Nicholas Ayache,et al.  3D-2D Projective Registration of Free-Form Curves and Surfaces , 1997, Comput. Vis. Image Underst..

[9]  Martial Hebert,et al.  3D map reconstruction from range data , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[10]  Fred W. DePiero,et al.  Fast landmark-based registration via deterministic and efficient processing, some preliminary results , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[11]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[12]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[13]  Sang Wook Lee,et al.  ICP Registration Using Invariant Features , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Robert B. Fisher,et al.  Finding Surface Correspondance for Object Recognition and Registration Using Pairwise Geometric Histograms , 1998, ECCV.

[15]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[16]  Yi-Ping Hung,et al.  RANSAC-Based DARCES: A New Approach to Fast Automatic Registration of Partially Overlapping Range Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Marcos A. Rodrigues,et al.  Accurate registration of structured data using two overlapping range images , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[19]  Ying Wang,et al.  Developing rigid motion constraints for the registration of free-form shapes , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[20]  Thomas S. Huang,et al.  FINDING 3-D POINT CORRESPONDENCES IN MOTION ESTIMATION. , 1986 .

[21]  Reinhard Koch,et al.  Invariant-based registration of surface patches , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[22]  Peter Johannes Neugebauer,et al.  Geometrical cloning of 3D objects via simultaneous registration of multiple range images , 1997, Proceedings of 1997 International Conference on Shape Modeling and Applications.

[23]  Jean-Philippe Thirion,et al.  New feature points based on geometric invariants for 3D image registration , 1996, International Journal of Computer Vision.

[24]  Marcos A. Rodrigues,et al.  On the representation of rigid body transformations for accurate registration of free-form shapes , 2002, Robotics Auton. Syst..

[25]  Jon Louis Bentley,et al.  An Algorithm for Finding Best Matches in Logarithmic Expected Time , 1977, TOMS.

[26]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[27]  Gang Wang,et al.  From images to models: automatic 3D object model construction from multiple views , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[28]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[29]  Sing Bing Kang,et al.  Registration and integration of textured 3-D data , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[30]  Ruigang Yang,et al.  Registering, integrating, and building CAD models from range data , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).