Using noise function-based patterns to enhance photogrammetric 3D reconstruction performance of featureless surfaces

Abstract One of the factors that determine the data quality produced by targetless photogrammetric techniques is the feature richness of the surface being captured. The Structure-From-Motion and Multiple View Stereovision (SFM-MVS) pipeline is no exception to this rule as it relies on the ability to identify corresponding points within a collection of unordered images. In this work, we question the introduction of noise function-based pattern (NFP) projection in the SFM-MVS data collection phase in order to enhance the reconstruction performance when applied on featureless surfaces. We selected a set of NFPs and we demonstrate their reconstruction performance enhancement on a Cycladic figurine by using a commercial SFM-MVS software package. We quantify each NFP's behaviour in relation to the produced data. We correlate the reconstruction results with band limiting and aliasing pattern characteristics. We compare the SFM-MVS data with those produced by digitising the same artefact with a laser triangulation scanner. We discuss the NFPs performance along with the advantages of the proposed methodology and its limitations.

[1]  Gregory R. Osche.  Optical Detection Theory for Laser Applications , 2002 .

[2]  Tony DeRose,et al.  Wavelet noise , 2005, SIGGRAPH 2005.

[3]  Martin Fera,et al.  From Deposit to Point Cloud – a Study of Low-Cost Computer Vision Approaches for the Straightforward Documentation of Archaeological Excavations , 2011 .

[4]  K. Wenzel,et al.  A comparison of dense matching algorithms for scaled surface reconstruction using stereo camera rigs , 2013 .

[5]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Joaquim Salvi,et al.  Recent progress in coded structured light as a technique to solve the correspondence problem: a survey , 1998, Pattern Recognit..

[7]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[8]  Thomas P. Kersten,et al.  Image-Based Low-Cost Systems for Automatic 3D Recording and Modelling of Archaeological Finds and Objects , 2012, EuroMed.

[9]  R. Marks,et al.  Detection in Laplace Noise , 1978, IEEE Transactions on Aerospace and Electronic Systems.

[10]  Philippe De Smedt,et al.  Towards a three-dimensional cost-effective registration of the archaeological heritage , 2013 .

[11]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[12]  Thomas P. Kersten,et al.  Low-Cost and Open-Source Solutions for Automated Image Orientation - A Critical Overview , 2012, EuroMed.

[13]  Steven M. Seitz,et al.  Multicore bundle adjustment , 2011, CVPR 2011.

[14]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[15]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[16]  Maurizio Muzzupappa,et al.  3D reconstruction of small sized objects from a sequence of multi-focused images , 2014 .

[17]  Nahum Kiryati,et al.  Image Deblurring in the Presence of Salt-and-Pepper Noise , 2005, Scale-Space.

[18]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[19]  B. Mandelbrot.  A Fast Fractional Gaussian Noise Generator , 1971 .

[20]  John McCarthy,et al.  Multi-image photogrammetry as a practical tool for cultural heritage survey and community engagement , 2014 .

[21]  Reinhard Koch,et al.  Structure from Motion Using Rigidly Coupled Cameras without Overlapping Views , 2013, GCPR.

[22]  Anestis Koutsoudis,et al.  Performance Evaluation of a Multi-Image 3D Reconstruction Software on a Low-Feature Artefact , 2013 .

[23]  Milindkumar V. Sarode,et al.  Reduction of Speckle Noise and Image Enhancement of Images Using Filtering Technique , 2011 .

[24]  J. Brasington,et al.  Modeling the topography of shallow braided rivers using Structure-from-Motion photogrammetry , 2014 .

[25]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[26]  A. Dégre,et al.  The evaluation of unmanned aerial system-based photogrammetry and terrestrial laser scanning to generate DEMs of agricultural watersheds , 2014 .

[27]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[28]  Rachel Opitz,et al.  Close-range photogrammetry vs. 3D scanning: Comparing data capture, processing and model generation in the field and the lab , 2012 .

[29]  Donald D Duncan,et al.  Detrimental effects of speckle-pixel size matching in laser speckle contrast imaging. , 2008, Optics letters.

[30]  Ken Perlin,et al.  Improving noise , 2002, SIGGRAPH.