LEAST SQUARES 3D SURFACE MATCHING

An algorithm for the least squares matching of overlapping 3D surfaces is presented. It estimates the transformation parameters between two or more fully 3D surfaces, using the Generalized Gauss-Markoff model, minimizing the sum of squares of the Euclidean distances between the surfaces. This formulation gives the opportunity of matching arbitrarily oriented 3D surfaces simultaneously, without using explicit tie points. Besides the mathematical model and execution aspects we give further extension of the basic model. The first extension is the simultaneous matching of sub-surface patches, which are selected in cooperative surface areas. It provides a computationally effective solution, since it matches only relevant multi-subpatches rather than the whole overlapping areas. The second extension is the matching of surface geometry and its attribute information, e.g. reflectance, color, temperature, etc., under a combined estimation model. We give practical examples for the demonstration of the basic method and the extensions.

[1]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .

[2]  P. Schönemann,et al.  A generalized solution of the orthogonal procrustes problem , 1966 .

[3]  P. Schönemann,et al.  Fitting one matrix to another under choice of a central dilation and a rigid motion , 1970 .

[4]  G. Peters.  interactive computer graphics application of the PARAMETRIC BI-CUBIC SURFACE to engineering design problems , 1974 .

[5]  Michael Potmesil,et al.  Generating Models of Solid Objects by Matching 3D Surface Segments , 1983, IJCAI.

[6]  A. Gruen.  ADAPTIVE LEAST SQUARES CORRELATION: A POWERFUL IMAGE MATCHING TECHNIQUE , 1985 .

[7]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Heinrich Ebner,et al.  Processing of digital three-line imagery using a generalized model for combined point determination , 1987 .

[9]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using orthonormal matrices , 1988 .

[10]  Armin Gruen,et al.  High-accuracy edge-matching with an extension of the MPGC-matching algorithm , 1991, Other Conferences.

[11]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[12]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  G. Karras,et al.  DEM matching and detection of deformation in close-range photogrammetry without control , 1993 .

[14]  Armin Gruen,et al.  Linear feature extraction by least squares template matching constrained by internal shape forces , 1994, Other Conferences.

[15]  Marc Rioux,et al.  Three-dimensional registration using range and intensity information , 1994, Other Conferences.

[16]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[17]  Armin Gruen,et al.  Digital photogrammetric techniques for high-resolution three-dimensional flow velocity measurements , 1995 .

[18]  Luc Van Gool,et al.  Matching of 3-D curves using semi-differential invariants , 1995, Proceedings of IEEE International Conference on Computer Vision.

[19]  Katsushi Ikeuchi,et al.  Building 3-D Models from Unregistered Range Images , 1995, CVGIP Graph. Model. Image Process..

[20]  Martin D. Levine,et al.  Registering Multiview Range Data to Create 3D Computer Objects , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Olli Jokinen,et al.  Relative Orientation of two Disparity Maps in Stereo Vision , 1995 .

[22]  Naokazu Yokoya,et al.  A Robust Method for Registration and Segmentation of Multiple Range Images , 1995, Comput. Vis. Image Underst..

[23]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[24]  Robert Bergevin,et al.  Towards a General Multi-View Registration Technique , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  L. Pilgrim.  Robust estimation applied to surface matching , 1996 .

[26]  Linda G. Shapiro,et al.  Robust meshes from multiple range maps , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[27]  Peter Johannes Neugebauer,et al.  Reconstruction of Real-World Objects via Simultaneous Registration and Robust Combination of Multiple Range Images , 1997, Int. J. Shape Model..

[28]  Chitra Dorai,et al.  Optimal Registration of Object Views Using Range Data , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Gilbert Soucy.  Surface Recovery from Range Images Using Curvature and Motion Consistency , 1997, Comput. Vis. Image Underst..

[30]  Adrian Hilton,et al.  Multi-resolution geometric fusion , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[31]  Sebastian Weik,et al.  Registration of 3-D partial surface models using luminance and depth information , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[32]  Ruigang Yang,et al.  Registering, integrating, and building CAD models from range data , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[33]  Andrew W. Fitzgibbon,et al.  Simultaneous Registration of Multiple Range Views for Use in Reverse Engineering of CAD Models , 1998, Comput. Vis. Image Underst..

[34]  Gang Wang,et al.  Registration and Integration of Multiple Object Views for 3D Model Construction , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Olli Jokinen,et al.  Statistical analysis of two 3-D registration and modeling strategies , 1998 .

[36]  Andrew E. Johnson,et al.  Surface matching for object recognition in complex three-dimensional scenes , 1998, Image Vis. Comput..

[37]  Andrew J. Stoddart,et al.  N-View Point Set Registration: A Comparison , 1999, BMVC.

[38]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[39]  R. G. Chadwick,et al.  Digital photogrammetric concepts applied to surface deformation studies , 1999 .

[40]  Kia Ng,et al.  Automated reconstruction of 3D models from real environments , 1999 .

[41]  Bennamoun,et al.  Multiple view 3D registration: a review and a new technique , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[42]  Sing Bing Kang,et al.  Registration and integration of textured 3-D data , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[43]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  Reinhard Koch,et al.  Invariant-based registration of surface patches , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[45]  Ayman Habib,et al.  A NEW APPROACH FOR MATCHING SURFACES FROM LASER SCANNERS AND OPTICAL SCANNERS , 2000 .

[46]  Zhilin Li,et al.  LEAST MEDIAN OF SQUARES MATCHING FOR AUTOMATED DETECTION OF SURFACE DEFORMATIONS , 2000 .

[47]  H. Maas.  Least-Squares Matching with Airborne Laserscanning Data in a TIN Structure , 2000 .

[48]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[49]  Robert Bergevin,et al.  A method for the registration of attributed range images , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[50]  John A. Williams,et al.  Simultaneous Registration of Multiple Corresponding Point Sets , 2001, Comput. Vis. Image Underst..

[51]  Andrea Fusiello,et al.  Reconstruction of complex environments by robust pre-aligned ICP , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[52]  Patrick J. Flynn,et al.  A Survey Of Free-Form Object Representation and Recognition Techniques , 2001, Comput. Vis. Image Underst..

[53]  H. Maas.  On the use of pulse reflectance data for laserscanner strip adjustment , 2001 .

[54]  Andrea Fusiello,et al.  Registration of Multiple Acoustic Range Views for Underwater Scene Reconstruction , 2002, Comput. Vis. Image Underst..

[55]  Sang Wook Lee,et al.  ICP Registration Using Invariant Features , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[56]  Takeshi Masuda,et al.  Registration and Integration of Multiple Range Images by Matching Signed Distance Fields for Object Shape Modeling , 2002, Comput. Vis. Image Underst..

[57]  Patrick J. Flynn,et al.  Pair-Wise Range Image Registration: A Study in Outlier Classification , 2002, Comput. Vis. Image Underst..

[58]  Pavel Krsek,et al.  Differential Invariants as the Base of Triangulated Surface Registration , 2002, Comput. Vis. Image Underst..

[59]  Luc Van Gool,et al.  Automatic Crude Patch Registration: Toward Automatic 3D Model Building , 2002, Comput. Vis. Image Underst..

[60]  Martin Kampel,et al.  Model-Based Registration of Front- and Backviews of Rotationally Symmetric Objects , 2002, Comput. Vis. Image Underst..

[61]  Koichiro Deguchi,et al.  A Method for Fine Registration of Multiple View Range Images Considering the Measurement Error Properties , 2002, Comput. Vis. Image Underst..

[62]  Fulvio Rinaudo,et al.  A new software for the automatic registration of 3D models acquired using laser scanner devices , 2002 .

[63]  Luca Lucchese,et al.  A Frequency Domain Technique for Range Data Registration , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[64]  S. T. Dijkman.  SEMI AUTOMATIC REGISTRATION OF LASER SCANNER DATA , 2002 .

[65]  Andrea Fusiello,et al.  Model Acquisition by Registration of Multiple Acoustic Range Views , 2002, ECCV.

[66]  Fabio Crosilla,et al.  Use of generalised Procrustes analysis for the photogrammetric block adjustment by independent models , 2002 .

[67]  Luc Van Gool,et al.  Combining texture and shape for automatic crude patch registration , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[68]  M. Devrim Mehmet Devrim Akça.  FULL AUTOMATIC REGISTRATION OF LASER SCANNER POINT CLOUDS , 2003 .

[69]  Alberto Guarnieri,et al.  TOWARDS AUTOMATIC MODELING FOR CULTURAL HERITAGE APPLICATIONS , 2003 .

[70]  Ioannis Stamos,et al.  Automated feature-based range registration of urban scenes of large scale , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[71]  G. Forlani,et al.  Independent Model Triangulation of Terrestrial Laser Scanner Data , 2003 .

[72]  Kim L. Boyer,et al.  Low-Overlap Range Image Registration for Archaeological Applications , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[73]  A. Krupnik,et al.  REGISTRATION OF AIRBORNE LASER DATA TO SURFACES GENERATED BY PHOTOGRAMMETRIC MEANS , 2004 .

[74]  Nicholas Ayache,et al.  Rigid, affine and locally affine registration of free-form surfaces , 1996, International Journal of Computer Vision.

[75]  Jean-Philippe Thirion,et al.  New feature points based on geometric invariants for 3D image registration , 1996, International Journal of Computer Vision.

[76]  Ray Jarvis,et al.  3D free-form surface registration and object recognition , 2004, International Journal of Computer Vision.

[77]  Richard Szeliski,et al.  Matching 3-D anatomical surfaces with non-rigid deformations using octree-splines , 1993, Proceedings of IEEE Workshop on Biomedical Image Analysis.

[78]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.