Global registration of large collections of range images with an improved Optimization-on-a-Manifold approach

Abstract Concurrently obtaining an accurate, robust and fast global registration of multiple 3D scans is still an open issue for modern 3D modeling pipelines, especially when high metric precision as well as easy usage of high-end devices (structured-light or laser scanners) are required. Various solutions have been proposed (either heuristic, iterative and/or closed form solutions) which present some compromise concerning the fulfillment of the above contrasting requirements. Our purpose here, compared to existing reference solutions, is to go a step further in this perspective by presenting a new technique able to provide improved alignment performance, even on large datasets (both in terms of number of views and/or point density) of range images. Relying on the ‘Optimization-on-a-Manifold’ (OOM) approach, originally proposed by Krishnan et al., we propose a set of methodological and computational upgrades that produce an operative impact on both accuracy, robustness and computational performance compared to the original solution. In particular, always basing on an unconstrained error minimization over the manifold of rotations, instead of relying on a static set of point correspondences, our algorithm updates the optimization iterations with a dynamically modified set of correspondences in a computationally effective way, leading to substantial improvements in terms of registration accuracy and convergence trend. Other proposed improvements are directed to a substantial reduction of the computational load without sacrificing the alignment performance. Stress tests with increasing view misalignment allowed us to appreciate the convergence robustness of the proposed solution. Eventually, we demonstrate that for very large datasets a further computational speedup can be reached by the adoption of a hybrid (local heuristic followed by global optimization) registration approach.

[1]  C. J. Taylor,et al.  Minimization on the Lie Group SO(3) and Related Manifolds , 1994 .

[2]  John B. Moore,et al.  Optimisation-on-a-manifold for global registration of multiple 3D point sets , 2007, Int. J. Intell. Syst. Technol. Appl..

[3]  Adrian Hilton,et al.  Registration of multiple point sets , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[4]  Alberto Signoroni,et al.  Boosting the Computational Performance of Feature-Based Multiple 3D Scan Alignment by iat-k-means Clustering , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[5]  Leonidas J. Guibas,et al.  Eurographics Symposium on Geometry Processing (2007) Reconstruction of Deforming Geometry from Time-varying Point Clouds , 2022 .

[6]  Peter Johannes Neugebauer,et al.  Reconstruction of Real-World Objects via Simultaneous Registration and Robust Combination of Multiple Range Images , 1997, Int. J. Shape Model..

[7]  Martial Hebert,et al.  Fully automatic registration of multiple 3D data sets , 2003, Image Vis. Comput..

[8]  Marc Levoy,et al.  A hierarchical method for aligning warped meshes , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[9]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[10]  Pei Yean Lee Geometric optimization for computer vision , 2005 .

[11]  D. Rueckert,et al.  Medical Image Registration , 2010 .

[12]  Helmut Pottmann,et al.  Registration of point cloud data from a geometric optimization perspective , 2004, SGP '04.

[13]  Alberto Signoroni,et al.  Multi-view alignment with database of features for an improved usage of high-end 3D scanners , 2012, EURASIP J. Adv. Signal Process..

[14]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[15]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[16]  Yonghuai Liu,et al.  Automatic Range Image Registration in the Markov Chain , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  H. Pottmann,et al.  SIMULTANEOUS REGISTRATION OF MULTIPLE VIEWS OF A 3 D OBJECT , 2002 .

[18]  Robert Bergevin,et al.  Towards a General Multi-View Registration Technique , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Luciano Silva,et al.  A 3D reconstruction pipeline for digital preservation , 2009, CVPR.

[20]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[21]  Francis Schmitt,et al.  A Solution for the Registration of Multiple 3D Point Sets Using Unit Quaternions , 1998, ECCV.

[22]  Sang Wook Lee,et al.  ICP Registration Using Invariant Features , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Christoph Schnörr,et al.  Intrinsic Second-Order Geometric Optimization for Robust Point Set Registration without Correspondence , 2009, EMMCVPR.

[24]  John A. Williams,et al.  Simultaneous Registration of Multiple Corresponding Point Sets , 2001, Comput. Vis. Image Underst..

[25]  Martin D. Levine,et al.  Registering Multiview Range Data to Create 3D Computer Objects , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[27]  Andrew W. Fitzgibbon,et al.  Simultaneous Registration of Multiple Range Views for Use in Reverse Engineering of CAD Models , 1998, Comput. Vis. Image Underst..

[28]  Xavier Pennec,et al.  Multiple Registration and Mean Rigid Shape - Application to the 3D case , 1996 .

[29]  John B. Moore,et al.  Global registration of multiple 3D point sets via optimization-on-a-manifold , 2005, SGP '05.

[30]  Andrea Torsello,et al.  Multiview registration via graph diffusion of dual quaternions , 2011, CVPR 2011.

[31]  Christoph Schnörr,et al.  Model-Based Multiple Rigid Object Detection and Registration in Unstructured Range Data , 2011, International Journal of Computer Vision.

[32]  Francis Schmitt,et al.  Fast global registration of 3D sampled surfaces using a multi-z-buffer technique , 1999, Image Vis. Comput..

[33]  Andrew J. Stoddart,et al.  N-View Point Set Registration: A Comparison , 1999, BMVC.

[34]  Naokazu Yokoya,et al.  A Robust Method for Registration and Segmentation of Multiple Range Images , 1995, Comput. Vis. Image Underst..

[35]  Sang Wook Lee,et al.  Multiview registration of 3D scenes by minimizing error between coordinate frames , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Holly E. Rushmeier,et al.  The 3D Model Acquisition Pipeline , 2002, Comput. Graph. Forum.

[37]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[38]  Helmut Pottmann,et al.  Registration without ICP , 2004, Comput. Vis. Image Underst..

[39]  Alberto Signoroni,et al.  An Enhanced 'Optimization-on-a-Manifold' Framework for Global Registration of 3D Range Data , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[40]  Kiran Jude Fernandes,et al.  Reverse Engineering: An Industrial Perspective , 2007 .

[41]  Joachim Hertzberg,et al.  Globally consistent 3D mapping with scan matching , 2008, Robotics Auton. Syst..

[42]  Shi-Min Hu,et al.  Geometry and Convergence Analysis of Algorithms for Registration of 3D Shapes , 2006, International Journal of Computer Vision.

[43]  Adrian Hilton,et al.  Estimating pose uncertainty for surface registration , 1998, Image Vis. Comput..

[44]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Kim L. Boyer,et al.  Enhanced, robust genetic algorithms for multiview range image registration , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[46]  Soon-Yong Park,et al.  An accurate and fast point-to-plane registration technique , 2003, Pattern Recognit. Lett..