Simulated Imagery Rendering Workflow for UAS-Based Photogrammetric 3D Reconstruction Accuracy Assessments

Structure from motion (SfM) and MultiView Stereo (MVS) algorithms are increasingly being applied to imagery from unmanned aircraft systems (UAS) to generate point cloud data for various surveying and mapping applications. To date, the options for assessing the spatial accuracy of the SfM-MVS point clouds have primarily been limited to empirical accuracy assessments, which involve comparisons against reference data sets, which are both independent and of higher accuracy than the data they are being used to test. The acquisition of these reference data sets can be expensive, time consuming, and logistically challenging. Furthermore, these experiments are also almost always unable to be perfectly replicated and can contain numerous confounding variables, such as sun angle, cloud cover, wind, movement of objects in the scene, and camera thermal noise, to name a few. The combination of these factors leads to a situation in which robust, repeatable experiments are cost prohibitive, and the experiment results are frequently site-specific and condition-specific. Here, we present a workflow to render computer generated imagery using a virtual environment which can mimic the independent variables that would be experienced in a real-world UAS imagery acquisition scenario. The resultant modular workflow utilizes Blender, an open source computer graphics software, for the generation of photogrammetrically-accurate imagery suitable for SfM processing, with explicit control of camera interior orientation, exterior orientation, texture of objects in the scene, placement of objects in the scene, and ground control point (GCP) accuracy. The challenges and steps required to validate the photogrammetric accuracy of computer generated imagery are discussed, and an example experiment assessing accuracy of an SfM derived point cloud from imagery rendered using a computer graphics workflow is presented. The proposed workflow shows promise as a useful tool for sensitivity analysis and SfM-MVS experimentation.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Carl Salvaggio,et al.  Automated identification of voids in three-dimensional point clouds , 2013, Optics & Photonics - Optical Engineering + Applications.

[3]  S. Ullman The interpretation of structure from motion , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[4]  P. Wolf,et al.  Elements of Photogrammetry(with Applications in GIS) , 2000 .

[5]  Carlos Hernandez,et al.  Multi-View Stereo: A Tutorial , 2015, Found. Trends Comput. Graph. Vis..

[6]  G. Grenzdörffer,et al.  ACCURACY COMPARISON OF DIGITAL SURFACE MODELS CREATED BY UNMANNED AERIAL SYSTEMS IMAGERY AND TERRESTRIAL LASER SCANNER , 2013 .

[7]  Marc Olano,et al.  Optimal Altitude, Overlap, and Weather Conditions for Computer Vision UAV Estimates of Forest Structure , 2015, Remote. Sens..

[8]  S. Robson,et al.  Mitigating systematic error in topographic models derived from UAV and ground‐based image networks , 2014 .

[9]  C. Hugenholtz,et al.  Geomorphological mapping with a small unmanned aircraft system (sUAS): Feature detection and accuracy assessment of a photogrammetrically-derived digital terrain model , 2013 .

[10]  K. Oost,et al.  Reproducibility of UAV-based earth topography reconstructions based on Structure-from-Motion algorithms , 2016 .

[11]  Henrik Aanæs,et al.  Large Scale Multi-view Stereopsis Evaluation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  John D. Hedengren,et al.  Evolutionary View Planning for Optimized UAV Terrain Modeling in a Simulated Environment , 2015, Remote. Sens..

[13]  Mark A. Fonstad,et al.  Topographic structure from motion: a new development in photogrammetric measurement , 2013 .

[14]  J. Brasington,et al.  Modeling the topography of shallow braided rivers using Structure-from-Motion photogrammetry , 2014 .

[15]  Derek J. Walvoord,et al.  Assessing geoaccuracy of structure from motion point clouds from long-range image collections , 2014 .

[16]  Mark W. Smith,et al.  From experimental plots to experimental landscapes: topography, erosion and deposition in sub‐humid badlands from Structure‐from‐Motion photogrammetry , 2015 .

[17]  I. Colomina,et al.  Unmanned aerial systems for photogrammetry and remote sensing: A review , 2014 .

[18]  Arko Lucieer,et al.  Assessing the Accuracy of Georeferenced Point Clouds Produced via Multi-View Stereopsis from Unmanned Aerial Vehicle (UAV) Imagery , 2012, Remote. Sens..

[19]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[20]  Salvatore Esposito,et al.  Performance evaluation of UAV photogrammetric 3D reconstruction , 2014, IGARSS.

[21]  Ware Myers,et al.  Interactive Computer Graphics , 1984, Computer.

[22]  M. Westoby,et al.  ‘Structure-from-Motion’ photogrammetry: A low-cost, effective tool for geoscience applications , 2012 .

[23]  Peter Willett,et al.  What is a tutorial , 2013 .

[24]  K. Shadan,et al.  Available online: , 2012 .

[25]  Carlos Castillo,et al.  Image-based surface reconstruction in geomorphometry - merits, limits and developments , 2016 .

[26]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[27]  Dean Brown,et al.  Decentering distortion of lenses , 1966 .

[28]  Natan Micheletti,et al.  Investigating the geomorphological potential of freely available and accessible structure‐from‐motion photogrammetry using a smartphone , 2015 .

[29]  Gonzalo Pajares,et al.  Overview and Current Status of Remote Sensing Applications Based on Unmanned Aerial Vehicles (UAVs) , 2015 .