Correspondence chaining for enhanced dense 3D reconstruction

Within the computer vision community, the reconstruction of rigid 3D objects is a well known task in current research. Many existing algorithms provide a dense 3D reconstruction of a rigid object from sequences of 2D images. Commonly, an iterative registration approach is applied for these images, relying on pairwise dense matches between images, which are then triangulated. To minimize redundant and imprecisely reconstructed 3D points, we present and evaluate a new approach, called Correspondence Chaining, to fuse existing dense twoview 3D reconstruction algorithms to a multi-view reconstruction, where each 3D point is estimated from multiple images. This leads to an enhanced precision and reduced redundancy. The algorithm is evaluated with three different representative datasets. With Correspondence Chaining the mean error of the reconstructed pointclouds related to ground truth data, acquired with a laser scanner, can be reduced by up to 40%, whereas the root mean square error is even reduced by up to 56%. The reconstructed 3D models contain much less 3D points, while keeping details like fine structures, the file size is reduced by up to 78% and the computation time of the involved parts is decreased by up to 42%.

[1]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Pascal Monasse,et al.  UNORDERED FEATURE TRACKING MADE FAST AND EASY , 2011 .

[3]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Paolo Cignoni,et al.  MeshLab: an Open-Source Mesh Processing Tool , 2008, Eurographics Italian Chapter Conference.

[5]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[6]  H. Bischof,et al.  Multi-View Stereo : Redundancy Benefits for 3 D Reconstruction , 2011 .

[7]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[8]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[9]  Jan-Michael Frahm,et al.  Real-Time Visibility-Based Fusion of Depth Maps , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[10]  Didier Stricker,et al.  A full-spherical device for simultaneous geometry and reflectance acquisition , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[11]  William Rucklidge,et al.  Efficient Visual Recognition Using the Hausdorff Distance , 1996, Lecture Notes in Computer Science.

[12]  Reinhard Koch,et al.  Multi Viewpoint Stereo from Uncalibrated Video Sequences , 1998, ECCV.