A new metric for measuring image-based 3D reconstruction

We propose a novel metric to measure the image-based 3D reconstruction results without ground truth datasets. In contrast to previous metrics, our shading-based metric can not only accurately measure the reconstruction quality but also decouple from any reconstruction algorithm. Considering the uncertainty of topology, texture and soft shadow, we compute an anisotropic irradiance gradient field from multiple images to indicate the regions where reconstruction error occurs. We further apply the metric into the view planning application. Experimental results on both synthetic and real datasets illustrate the effectiveness of evaluating 3D reconstruction by our metric. The reconstruction accuracy and completeness overtop or are the same as the results of manually adding new viewpoints.

[1]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[2]  Leif Kobbelt,et al.  Image selection for improved Multi-View Stereo , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Jan-Michael Frahm,et al.  Next Best View Planning for Active Model Improvement , 2009, BMVC.

[4]  P. Hanrahan,et al.  On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[5]  Heinrich Niemann,et al.  Active Visual Object Reconstruction using D-, E-, and T-Optimal Next Best Views , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Pascal Fua,et al.  On benchmarking camera calibration and multi-view stereo for high resolution imagery , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  James T. Kajiya,et al.  The rendering equation , 1998 .

[8]  Michael Goesele,et al.  Multi-View Stereo for Community Photo Collections , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[9]  Matthew N. Dailey,et al.  Robust Key Frame Extraction for 3D Reconstruction from Video Streams , 2010, VISAPP.

[10]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).