Least squares 3 D surface matching

An algorithm for the least squares matching of overlapping 3D surfaces is presented. It estimates the transformation parameters between two or more fully 3D surfaces, using the Generalized Gauss-Markoff model, minimizing the sum of squares of the Euclidean distances between the surfaces. This formulation gives the opportunity of matching arbitrarily oriented 3D surfaces simultaneously, without using explicit tie points. Besides the mathematical model and execution aspects we give further extension of the basic model. The first extension is the simultaneous matching of sub-surface patches, which are selected in cooperative surface areas. It provides a computationally effective solution, since it matches only relevant multi-subpatches rather than the whole overlapping areas. The second extension is the matching of surface geometry and its attribute information, e.g. reflectance, color, temperature, etc., under a combined estimation model. We give practical examples for the demonstration of the basic method and the extensions.

[1]  Katsushi Ikeuchi,et al.  Building 3-D Models from Unregistered Range Images , 1995, CVGIP Graph. Model. Image Process..

[2]  Sebastian Weik,et al.  Registration of 3-D partial surface models using luminance and depth information , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[3]  P. Schönemann,et al.  A generalized solution of the orthogonal procrustes problem , 1966 .

[4]  Patrick J. Flynn,et al.  A Survey Of Free-Form Object Representation and Recognition Techniques , 2001, Comput. Vis. Image Underst..

[5]  Robert Bergevin,et al.  Towards a General Multi-View Registration Technique , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  BennamounMohammed,et al.  Simultaneous Registration of Multiple Corresponding Point Sets , 2001 .

[7]  Ruigang Yang,et al.  Registering, integrating, and building CAD models from range data , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[8]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[9]  Linda G. Shapiro,et al.  Robust meshes from multiple range maps , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[10]  Nicholas Ayache,et al.  Rigid, affine and locally affine registration of free-form surfaces , 1996, International Journal of Computer Vision.

[11]  Richard Szeliski,et al.  Matching 3-D anatomical surfaces with non-rigid deformations using octree-splines , 1993, Proceedings of IEEE Workshop on Biomedical Image Analysis.

[12]  Alberto Guarnieri,et al.  TOWARDS AUTOMATIC MODELING FOR CULTURAL HERITAGE APPLICATIONS , 2003 .

[13]  John A. Williams,et al.  Simultaneous Registration of Multiple Corresponding Point Sets , 2001, Comput. Vis. Image Underst..

[14]  Ray Jarvis,et al.  3D free-form surface registration and object recognition , 2004, International Journal of Computer Vision.

[15]  Robert Bergevin,et al.  A method for the registration of attributed range images , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[16]  L. Pilgrim.  Robust estimation applied to surface matching , 1996 .

[17]  Ioannis Stamos,et al.  Automated feature-based range registration of urban scenes of large scale , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[18]  Olli Jokinen,et al.  Statistical analysis of two 3-D registration and modeling strategies , 1998 .

[19]  Bennamoun,et al.  Multiple view 3D registration: a review and a new technique , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[20]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using orthonormal matrices , 1988 .

[21]  Luca Lucchese,et al.  A Frequency Domain Technique for Range Data Registration , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Koichiro Deguchi,et al.  A Method for Fine Registration of Multiple View Range Images Considering the Measurement Error Properties , 2002, Comput. Vis. Image Underst..

[23]  Armin Gruen,et al.  Digital photogrammetric techniques for high-resolution three-dimensional flow velocity measurements , 1995 .

[24]  Luc Van Gool,et al.  Matching of 3-D curves using semi-differential invariants , 1995, Proceedings of IEEE International Conference on Computer Vision.

[25]  S. T. Dijkman.  SEMI AUTOMATIC REGISTRATION OF LASER SCANNER DATA , 2002 .

[26]  Sang Wook Lee,et al.  ICP Registration Using Invariant Features , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[28]  Takeshi Masuda,et al.  Registration and Integration of Multiple Range Images by Matching Signed Distance Fields for Object Shape Modeling , 2002, Comput. Vis. Image Underst..

[29]  G. Forlani,et al.  Independent Model Triangulation of Terrestrial Laser Scanner Data , 2003 .

[30]  P. Schönemann,et al.  Fitting one matrix to another under choice of a central dilation and a rigid motion , 1970 .

[31]  Marc Rioux,et al.  Three-dimensional registration using range and intensity information , 1994, Other Conferences.

[32]  A. Gruen.  ADAPTIVE LEAST SQUARES CORRELATION: A POWERFUL IMAGE MATCHING TECHNIQUE , 1985 .

[33]  Zhilin Li,et al.  LEAST MEDIAN OF SQUARES MATCHING FOR AUTOMATED DETECTION OF SURFACE DEFORMATIONS , 2000 .

[34]  G. Karras,et al.  DEM matching and detection of deformation in close-range photogrammetry without control , 1993 .

[35]  Fabio Crosilla,et al.  A generalized factored stochastic model for the optimal global registration of LIDAR range images , 2002 .

[36]  Patrick J. Flynn,et al.  Pair-Wise Range Image Registration: A Study in Outlier Classification , 2002, Comput. Vis. Image Underst..

[37]  Kia Ng,et al.  Automated reconstruction of 3D models from real environments , 1999 .

[38]  Jean-Philippe Thirion,et al.  New feature points based on geometric invariants for 3D image registration , 1996, International Journal of Computer Vision.

[39]  Andrew W. Fitzgibbon,et al.  Simultaneous Registration of Multiple Range Views for Use in Reverse Engineering of CAD Models , 1998, Comput. Vis. Image Underst..

[40]  Armin Grün.  Photogrammetrische Punktbestimmung mit der Bündelmethode , 1986 .

[41]  G. Peters.  interactive computer graphics application of the PARAMETRIC BI-CUBIC SURFACE to engineering design problems , 1974 .

[42]  N. D'Apuzzo,et al.  MEASUREMENT AND MODELING OF HUMAN FACES FROM MULTI IMAGES , 2002 .

[43]  Heinrich Ebner,et al.  Processing of digital three-line imagery using a generalized model for combined point determination , 1987 .

[44]  Pavel Krsek,et al.  Differential Invariants as the Base of Triangulated Surface Registration , 2002, Comput. Vis. Image Underst..

[45]  Naokazu Yokoya,et al.  A Robust Method for Registration and Segmentation of Multiple Range Images , 1995, Comput. Vis. Image Underst..

[46]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .

[47]  R. G. Chadwick,et al.  Digital photogrammetric concepts applied to surface deformation studies , 1999 .

[48]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[49]  Chitra Dorai,et al.  Optimal Registration of Object Views Using Range Data , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Gilbert Soucy.  Surface Recovery from Range Images Using Curvature and Motion Consistency , 1997, Comput. Vis. Image Underst..

[51]  A. Krupnik,et al.  REGISTRATION OF AIRBORNE LASER DATA TO SURFACES GENERATED BY PHOTOGRAMMETRIC MEANS , 2004 .

[52]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[53]  Martin Kampel,et al.  Model-Based Registration of Front- and Backviews of Rotationally Symmetric Objects , 2002, Comput. Vis. Image Underst..

[54]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Luc Van Gool,et al.  Combining texture and shape for automatic crude patch registration , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[56]  Fulvio Rinaudo,et al.  A new software for the automatic registration of 3D models acquired using laser scanner devices , 2002 .

[57]  Adrian Hilton,et al.  Multi-resolution geometric fusion , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[58]  Armin Gruen,et al.  High-accuracy edge-matching with an extension of the MPGC-matching algorithm , 1991, Other Conferences.

[59]  Kim L. Boyer,et al.  Low-Overlap Range Image Registration for Archaeological Applications , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[60]  Andrew J. Stoddart,et al.  N-View Point Set Registration: A Comparison , 1999, BMVC.

[61]  Luc Van Gool,et al.  Automatic Crude Patch Registration: Toward Automatic 3D Model Building , 2002, Comput. Vis. Image Underst..

[62]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[63]  Armin Gruen,et al.  Linear feature extraction by least squares template matching constrained by internal shape forces , 1994, Other Conferences.

[64]  M. Devrim Mehmet Devrim Akça.  FULL AUTOMATIC REGISTRATION OF LASER SCANNER POINT CLOUDS , 2003 .

[65]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[66]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[67]  Andrea Fusiello,et al.  Model Acquisition by Registration of Multiple Acoustic Range Views , 2002, ECCV.

[68]  H. Maas.  On the use of pulse reflectance data for laserscanner strip adjustment , 2001 .

[69]  Michael Potmesil,et al.  Generating Models of Solid Objects by Matching 3D Surface Segments , 1983, IJCAI.

[70]  Sing Bing Kang,et al.  Registration and integration of textured 3-D data , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[71]  Fabio Crosilla,et al.  Use of generalised Procrustes analysis for the photogrammetric block adjustment by independent models , 2002 .

[72]  SoucyMarc,et al.  Towards a General Multi-View Registration Technique , 1996 .

[73]  Andrew E. Johnson,et al.  Surface matching for object recognition in complex three-dimensional scenes , 1998, Image Vis. Comput..

[74]  Andrea Fusiello,et al.  Registration of Multiple Acoustic Range Views for Underwater Scene Reconstruction , 2002, Comput. Vis. Image Underst..

[75]  Reinhard Koch,et al.  Invariant-based registration of surface patches , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[76]  Koichiro Deguchi,et al.  A method for fine registration of multiple view range images considering the measurement error properties , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[77]  Ayman Habib,et al.  A NEW APPROACH FOR MATCHING SURFACES FROM LASER SCANNERS AND OPTICAL SCANNERS , 2000 .

[78]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[79]  Olli Jokinen,et al.  Relative Orientation of two Disparity Maps in Stereo Vision , 1995 .

[80]  Andrea Fusiello,et al.  Reconstruction of complex environments by robust pre-aligned ICP , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[81]  H. Maas.  Least-Squares Matching with Airborne Laserscanning Data in a TIN Structure , 2000 .

[82]  Gang Wang,et al.  Registration and Integration of Multiple Object Views for 3D Model Construction , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[83]  Martin D. Levine,et al.  Registering Multiview Range Data to Create 3D Computer Objects , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[84]  Peter Johannes Neugebauer,et al.  Reconstruction of Real-World Objects via Simultaneous Registration and Robust Combination of Multiple Range Images , 1997, Int. J. Shape Model..