Free-form surface registration using surface signatures

The paper introduces a new free-form surface representation scheme for the purpose of fast and accurate registration and matching. Accurate registration of surfaces is a common task in computer vision. The proposed representation scheme captures the surface curvature information seen from certain points and produces images called surface signatures at these points. Matching signatures of different surfaces enables the recovery of the transformation parameters between these surfaces. We propose to use template matching to compare the signature images. To enable partial matching, another criterion, the overlap ratio, is used. This representation scheme can be used as a global representation of the surface as well as a local one and performs near real time registration. We show that the signature representation can be used to match objects in 3D scenes in the presence of clutter and occlusion. Applications presented include free-form object matching, multimodal medical volume registration and dental teeth reconstruction from intra-oral images.

[1]  Aly A. Farag,et al.  Integrating shape from shading and range data using neural networks , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[2]  Aly A. Farag,et al.  Multi-modal medical volumes fusion by surface matching , 1999, ISSPA '99. Proceedings of the Fifth International Symposium on Signal Processing and its Applications (IEEE Cat. No.99EX359).

[3]  Katsushi Ikeuchi,et al.  Shape representation and image segmentation using deformable surfaces , 1992, Image Vis. Comput..

[4]  Peter E. Hart,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[5]  Aly A. Farag,et al.  A new genetic-based technique for matching 3-D curves and surfaces , 1999, Pattern Recognit..

[6]  Nicholas Ayache,et al.  Smoothing and Matching of 3-D Space Curves , 1992, ECCV.

[7]  Richard Szeliski,et al.  Recovering the Position and Orientation of Free-Form Objects from Image Contours Using 3D Distance Maps , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  R. Bergevin,et al.  Registering range views of multipart objects , 1995 .

[9]  Andrew E. Johnson,et al.  Surface matching for object recognition in complex three-dimensional scenes , 1998, Image Vis. Comput..

[10]  Aly A. Farag,et al.  3D reconstruction of the human jaw from a sequence of images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Aly A. Farag,et al.  A Robust 3-D Reconstruction System for Human Jaw Modeling , 1999, MICCAI.

[12]  Aly A. Farag,et al.  Multi-modal Medical Volumes Fusion by Surface Matching , 1999, MICCAI.

[13]  Katsushi Ikeuchi,et al.  A Spherical Representation for Recognition of Free-Form Surfaces , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Gérard G. Medioni,et al.  Structural Indexing: Efficient 3-D Object Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Hervé Delingette,et al.  Simplex meshes: a general representation for 3D shape reconstruction , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[17]  Chitra Dorai,et al.  COSMOS - A Representation Scheme for 3D Free-Form Objects , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Jean-Philippe Thirion,et al.  Extremal points: definition and application to 3D image registration , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Robert Bergevin,et al.  Registering Range Views of Multipart Objects , 1995, Comput. Vis. Image Underst..