Structure from motion photogrammetric technique

Abstract Structure from motion (SfM) with multiview stereo, a technique from photogrammetry and computer vision that uses overlapping images to reconstruct 3D surface models, is a valuable research tool in geomorphology and related disciplines. Images can be collected with standard consumer-grade cameras, making SfM a low-cost tool that compliments other 3D technologies, such as terrestrial and airborne laser scanning (lidar). The high level of automation of SfM processing offers an unprecedented occasion to describe earth surface processes, but this comes with strengths and challenges. Accordingly, this contribution seeks to give a guide in successfully applying SfM for a range of geomorphic studies. First, it offers an overview of the technique, history, evolution, and the reason behind its success. Second, it describes the method, with guidelines about suitable settings, accuracy, and georeferencing. Finally, including case studies that have been contributed by experts from around the world, it showcases the chances offered to reconstruct processes across spatial and temporal scales.

[1]  Hans-Gerd Maas,et al.  The determination of high-resolution spatio-temporal glacier motion fields from time-lapse sequences , 2017 .

[2]  Vincent Raoult,et al.  GoPros™ as an underwater photogrammetry tool for citizen science , 2016, PeerJ.

[3]  M. Pierrot Deseilligny,et al.  APERO, AN OPEN SOURCE BUNDLE ADJUSMENT SOFTWARE FOR AUTOMATIC CALIBRATION AND ORIENTATION OF SET OF IMAGES , 2012 .

[4]  O. Hungr,et al.  Case study: Oso, Washington, landslide of march 22, 2014-material properties and failure mechanism , 2017 .

[5]  Robbie Austrums,et al.  Subaerial gravel size measurement using topographic data derived from a UAV‐SfM approach , 2017 .

[6]  S. Robson,et al.  3‐D uncertainty‐based topographic change detection with structure‐from‐motion photogrammetry: precision maps for ground control and directly georeferenced surveys , 2017 .

[7]  A. Brenning,et al.  Modeling the precision of structure-from-motion multi-view stereo digital elevation models from repeated close-range aerial surveys , 2018, Remote Sensing of Environment.

[8]  Brice R. Rea,et al.  Using UAV acquired photography and structure from motion techniques for studying glacier landforms: application to the glacial flutes at Isfallsglaciären , 2017 .

[9]  J. Warburton,et al.  Microtopography of bare peat: a conceptual model and objective classification from high‐resolution topographic survey data , 2018 .

[10]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[11]  Christopher A. Gomez Digital photogrammetry and GIS-based analysis of the bio-geomorphological evolution of Sakurajima Volcano, diachronic analysis from 1947 to 2006 , 2014 .

[12]  J. Ryan,et al.  UAV photogrammetry and structure from motion to assess calving dynamics at Store Glacier, a large outlet draining the Greenland ice sheet , 2015 .

[13]  Jan Skaloud,et al.  A micro-UAV with the capability of direct georeferencing , 2013 .

[14]  Birgit Kirsch,et al.  E2mC: Improving Emergency Management Service Practice through Social Media and Crowdsourcing Analysis in Near Real Time , 2017, Sensors.

[15]  J. A. Gomez,et al.  SF3M software: 3-D photo-reconstruction for non-expert users and its application to a gully network , 2015 .

[16]  Miao Yu,et al.  Modeling of landslide topography based on micro-unmanned aerial vehicle photography and structure-from-motion , 2017, Environmental Earth Sciences.

[17]  H. Eisenbeiss,et al.  DIRECT GEOREFERENCING OF UAVS , 2012 .

[18]  L. Nicholson,et al.  Using structure‐from‐motion to create glacier DEMs and orthoimagery from historical terrestrial and oblique aerial imagery , 2017 .

[19]  Anette Eltner,et al.  Time lapse structure‐from‐motion photogrammetry for continuous geomorphic monitoring , 2017 .

[20]  M. Lo Brutto,et al.  Computer Vision Tools for 3D Modelling in Archaeology , 2012 .

[21]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[22]  C. Hugenholtz,et al.  Spatial Accuracy of UAV-Derived Orthoimagery and Topography: Comparing Photogrammetric Models Processed with Direct Geo-Referencing and Ground Control Points , 2016 .

[23]  Tommy A. Noble,et al.  Guidelines on the use of structure‐from‐motion photogrammetry in geomorphic research , 2019, Earth Surface Processes and Landforms.

[24]  Maarten Bakker,et al.  Archival photogrammetric analysis of river–floodplain systems using Structure from Motion (SfM) methods , 2017 .

[25]  T. Quine,et al.  Testing the utility of structure‐from‐motion photogrammetry reconstructions using small unmanned aerial vehicles and ground photography to estimate the extent of upland soil erosion , 2017 .

[26]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[27]  Andreas Kääb,et al.  Terrain changes from images acquired on opportunistic flights by SfM photogrammetry , 2016 .

[28]  Steven M. De Jong,et al.  Monitoring river morphology & bank erosion using UAV imagery - A case study of the river Buëch, Hautes-Alpes, France , 2018, Int. J. Appl. Earth Obs. Geoinformation.

[29]  Dirk Rieke-Zapp,et al.  Assessment of Erosion, Deposition and Rill Development On Irregular Soil Surfaces Using Close Range Digital Photogrammetry , 2010 .

[30]  J. Brasington,et al.  Modeling the topography of shallow braided rivers using Structure-from-Motion photogrammetry , 2014 .

[31]  M. James,et al.  Pointcatcher software: analysis of glacial time-lapse photography and integration with multitemporal digital elevation models , 2016, Journal of Glaciology.

[32]  J. Brasington,et al.  Accounting for uncertainty in DEMs from repeat topographic surveys: improved sediment budgets , 2009 .

[33]  Natan Micheletti,et al.  Investigating the geomorphological potential of freely available and accessible structure‐from‐motion photogrammetry using a smartphone , 2015 .

[34]  K. Cook An evaluation of the effectiveness of low-cost UAVs and structure from motion for geomorphic change detection , 2017 .

[35]  J. Lutes,et al.  DIRECT GEOREFERENCING ON SMALL UNMANNED AERIAL PLATFORMS FOR IMPROVED RELIABILITY AND ACCURACY OF MAPPING WITHOUT THE NEED FOR GROUND CONTROL POINTS , 2015 .

[36]  Anders la Cour-Harbo,et al.  Calibration and accuracy assessment in a direct georeferencing system for UAS photogrammetry , 2018 .

[37]  Toby N. Tonkin,et al.  Ice-cored moraine degradation mapped and quantified using an unmanned aerial vehicle: A case study from a polythermal glacier in Svalbard , 2016 .

[38]  Mike J. Smith,et al.  Cameras and settings for aerial surveys in the geosciences , 2017 .

[39]  L. Klingbeil,et al.  DEVELOPMENT AND EVALUATION OF A UAV BASED MAPPING SYSTEM FOR REMOTE SENSING AND SURVEYING APPLICATIONS , 2015 .

[40]  K. Mair,et al.  Application of open‐source photogrammetric software MicMac for monitoring surface deformation in laboratory models , 2016 .

[41]  Gianfranco Forlani,et al.  Quality Assessment of DSMs Produced from UAV Flights Georeferenced with On-Board RTK Positioning , 2018, Remote. Sens..

[42]  D. Green,et al.  Application of Structure‐from‐Motion photogrammetry to river restoration , 2017 .

[43]  N. Pfeifer,et al.  DIRECT GEOREFERENCING WITH ON BOARD NAVIGATION COMPONENTS OF LIGHT WEIGHT UAV PLATFORMS , 2012 .

[44]  Investigating the effects of methodological expertise and data randomness on the robustness of crowd-sourced SfM terrain models , 2015 .

[45]  Mark W. Smith,et al.  From experimental plots to experimental landscapes: topography, erosion and deposition in sub‐humid badlands from Structure‐from‐Motion photogrammetry , 2015 .

[46]  Riccardo Salvini,et al.  Application of UAV photogrammetry for the multi-temporal estimation of surface extent and volumetric excavation in the Sa Pigada Bianca open-pit mine, Sardinia, Italy , 2017, Environmental Earth Sciences.

[47]  J. Dietrich Bathymetric Structure‐from‐Motion: extracting shallow stream bathymetry from multi‐view stereo photogrammetry , 2017 .

[48]  G. Sofia Combining geomorphometry, feature extraction techniques and Earth-surface processes research: The way forward , 2020 .

[49]  H. Maas,et al.  Soil micro-topography change detection at hillslopes in fragile Mediterranean landscapes , 2018 .

[50]  S. Robson,et al.  Straightforward reconstruction of 3D surfaces and topography with a camera: Accuracy and geoscience application , 2012 .

[51]  Arko Lucieer,et al.  Direct Georeferencing of Ultrahigh-Resolution UAV Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Koichi Yamamoto,et al.  Removal of water‐surface reflection effects with a temporal minimum filter for UAV‐based shallow‐water photogrammetry , 2018 .

[53]  R. E. Thomas,et al.  Quantification of braided river channel change using archival digital image analysis , 2010 .

[54]  C. Mulsow,et al.  SUBAQUATIC DIGITAL ELEVATION MODELS FROM UAV-IMAGERY , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[55]  J. Warrick,et al.  New Techniques to Measure Cliff Change from Historical Oblique Aerial Photographs and Structure-from-Motion Photogrammetry , 2016, Journal of Coastal Research.

[56]  Adam Mosbrucker,et al.  Camera system considerations for geomorphic applications of SfM photogrammetry , 2017 .

[57]  Fabrice Vinatier,et al.  Joining multi-epoch archival aerial images in a single SfM block allows 3-D change detection with almost exclusively image information , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[58]  Brian M. Anderson,et al.  Using structure from motion photogrammetry to measure past glacier changes from historic aerial photographs , 2017, Journal of Glaciology.

[59]  P. Tarolli,et al.  High-resolution morphologic characterization of conservation agriculture , 2019, CATENA.

[60]  Mark W. Smith,et al.  Structure from Motion in the Geosciences , 2016 .

[61]  Martina Slámová,et al.  The application of civic technologies in a field survey of landslides , 2018 .

[62]  N. Haala,et al.  DIRECT GEOREFERENCING USING GPS/INERTIAL EXTERIOR ORIENTATIONS FOR PHOTOGRAMMETRIC APPLICATIONS , 2000 .

[63]  M. Westoby,et al.  ‘Structure-from-Motion’ photogrammetry: A low-cost, effective tool for geoscience applications , 2012 .

[64]  Christian Haas,et al.  Brief Communication: Mapping river ice using drones and structure from motion , 2017 .

[65]  Michel Jaboyedoff,et al.  Detection of millimetric deformation using a terrestrial laser scanner: experiment and application to a rockfall event , 2009 .

[66]  Michael Goesele,et al.  Scene Reconstruction and Visualization From Community Photo Collections , 2010, Proceedings of the IEEE.

[67]  M. Jaboyedoff,et al.  Using street view imagery for 3-D survey of rock slope failures , 2017 .

[68]  Neil Entwistle,et al.  Recent remote sensing applications for hydro and morphodynamic monitoring and modelling , 2018 .

[69]  Fabio Menna,et al.  A CRITICAL REVIEW OF AUTOMATED PHOTOGRAMMETRICPROCESSING OF LARGE DATASETS , 2017 .

[70]  Jan-Michael Frahm,et al.  Structure-from-Motion Revisited , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[71]  P. Nelson,et al.  Application of Structure-from-Motion photogrammetry in laboratory flumes , 2017 .

[72]  Paolo Cignoni,et al.  MeshLab: an Open-Source Mesh Processing Tool , 2008, Eurographics Italian Chapter Conference.

[73]  Christopher Sevara,et al.  Capturing the Past for the Future: an Evaluation of the Effect of Geometric Scan Deformities on the Performance of Aerial Archival Media in Image‐based Modelling Environments , 2016 .

[74]  Patrice E. Carbonneau,et al.  Cost‐effective non‐metric photogrammetry from consumer‐grade sUAS: implications for direct georeferencing of structure from motion photogrammetry , 2017 .

[75]  Kai-Wei Chiang,et al.  The Development of an UAV Borne Direct Georeferenced Photogrammetric Platform for Ground Control Point Free Applications , 2012, Sensors.

[76]  Yazid Ninsalam,et al.  Towards high resolution and cost-effective terrain mapping for urban hydrodynamic modelling in densely settled river-corridors , 2016 .

[77]  H. Maas,et al.  WATCHING GRASS GROW- A PILOT STUDY ON THE SUITABILITY OF PHOTOGRAMMETRIC TECHNIQUES FOR QUANTIFYING CHANGE IN ABOVEGROUND BIOMASS IN GRASSLAND EXPERIMENTS , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[78]  K. McGwire,et al.  Assessing the performance of structure‐from‐motion photogrammetry and terrestrial LiDAR for reconstructing soil surface microtopography of naturally vegetated plots , 2016 .

[79]  O. Hungr,et al.  Oso, Washington, Landslide of March 22, 2014: Dynamic Analysis , 2017 .

[80]  Claudio Delrieux,et al.  Structure-from-Motion Approach for Characterization of Bioerosion Patterns Using UAV Imagery , 2015, Sensors.

[81]  Toby N. Tonkin,et al.  Ground-Control Networks for Image Based Surface Reconstruction: An Investigation of Optimum Survey Designs Using UAV Derived Imagery and Structure-from-Motion Photogrammetry , 2016, Remote. Sens..

[82]  Robert C. Bolles,et al.  Epipolar-plane image analysis: An approach to determining structure from motion , 1987, International Journal of Computer Vision.

[83]  Geert Verhoeven,et al.  Taking computer vision aloft – archaeological three‐dimensional reconstructions from aerial photographs with photoscan , 2011 .

[84]  Marco Dubbini,et al.  Using Unmanned Aerial Vehicles (UAV) for High-Resolution Reconstruction of Topography: The Structure from Motion Approach on Coastal Environments , 2013, Remote. Sens..

[85]  Toby N. Tonkin,et al.  Reconstruction of former glacier surface topography from archive oblique aerial images , 2017 .

[86]  Mark W. Smith,et al.  An integrated Structure-from-Motion and time-lapse technique for quantifying ice-margin dynamics , 2017, Journal of Glaciology.

[87]  F. Visser,et al.  Quantifying submerged fluvial topography using hyperspatial resolution UAS imagery and structure from motion photogrammetry , 2015 .

[88]  Camillo Ressl,et al.  Undistorting the past: new techniques for orthorectification of archaeological aerial frame imagery , 2013 .

[89]  Gianfranco Forlani,et al.  Testing Accuracy and Repeatability of UAV Blocks Oriented with GNSS-Supported Aerial Triangulation , 2017, Remote. Sens..

[90]  Tom Edwards,et al.  A 4D Filtering and Calibration Technique for Small-Scale Point Cloud Change Detection with a Terrestrial Laser Scanner , 2015, Remote. Sens..

[91]  Mark W. Smith,et al.  Can high resolution 3D topographic surveys provide reliable grain size estimates in gravel bed rivers , 2017 .

[92]  Jon P. Mills,et al.  Towards a Low-Cost Real-Time Photogrammetric Landslide Monitoring System Utilising Mobile and Cloud Computing Technology , 2016 .

[93]  J. L. Lerma,et al.  Estimation of small-scale soil erosion in laboratory experiments with Structure from Motion photogrammetry , 2017 .

[94]  Giulia Sofia,et al.  Prospects for crowdsourced information on the geomorphic ‘engineering’ by the invasive Coypu (Myocastor coypus) , 2017 .

[95]  Hiroya Yamano,et al.  Evaluation of DSMs generated from multi-temporal aerial photographs using emerging structure from motion–multi-view stereo technology , 2016 .

[96]  Gordon Petrie,et al.  Using image-based modelling (SfM–MVS) to produce a 1935 ortho-mosaic of the Ethiopian highlands , 2015, Int. J. Digit. Earth.

[97]  A. Gruen Development and Status of Image Matching in Photogrammetry , 2012 .

[98]  Danilo Schneider,et al.  Analysis of Different Methods for 3D Reconstruction of Natural Surfaces from Parallel‐Axes UAV Images , 2015 .

[99]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[100]  Jean-Stéphane Bailly,et al.  Comparison of Pleiades and LiDAR Digital Elevation Models for Terraces Detection in Farmlands , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[101]  Zhen Zhu,et al.  Simulating and quantifying legacy topographic data uncertainty: an initial step to advancing topographic change analyses , 2016, Progress in Earth and Planetary Science.

[102]  S. M. Jong,et al.  Mapping landslide displacements using Structure from Motion (SfM) and image correlation of multi-temporal UAV photography , 2014 .

[103]  D. Lague,et al.  Accurate 3D comparison of complex topography with terrestrial laser scanner: Application to the Rangitikei canyon (N-Z) , 2013, 1302.1183.

[104]  S. Lane,et al.  Estimation of erosion and deposition volumes in a large, gravel‐bed, braided river using synoptic remote sensing , 2003 .

[105]  Jan Skaloud,et al.  APPLICABILITY OF NEW APPROACHES OF SENSOR ORIENTATION TO MICRO AERIAL VEHICLES , 2016 .

[106]  Fabio Remondino,et al.  State of the art in high density image matching , 2014 .

[107]  Nico Mölg,et al.  Structure-from-Motion Using Historical Aerial Images to Analyse Changes in Glacier Surface Elevation , 2017, Remote. Sens..

[108]  Riccardo Salvini,et al.  Multitemporal monitoring of a coastal landslide through SfM‐derived point cloud comparison , 2017 .

[109]  F. Nex,et al.  Quality assessment of combined IMU/GNSS data for direct georeferencing in the context of UAV-based mapping , 2017 .

[110]  Markus Gerke,et al.  Accuracy analysis of photogrammetric UAV image blocks: influence of onboard RTK-GNSS and cross flight patterns , 2016 .

[111]  Mark W. Smith,et al.  Structure from motion photogrammetry in physical geography , 2016 .

[112]  Itaru Kitahara,et al.  Method to generate disaster-damage map using 3D photometry and crowd sourcing , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[113]  D. Brunstein,et al.  Characterizing and quantifying the discontinuous bank erosion of a small low energy river using Structure-from-Motion Photogrammetry and erosion pins , 2018, Journal of Hydrology.

[114]  S. Robson,et al.  Mitigating systematic error in topographic models derived from UAV and ground‐based image networks , 2014 .

[115]  Heide Friedrich,et al.  Field application of close‐range digital photogrammetry (CRDP) for grain‐scale fluvial morphology studies , 2016 .

[116]  D. J. Hutchinson,et al.  Automated Terrestrial Laser Scanning with Near Real-Time Change Detection – Monitoring of the Séchilienne Landslide , 2017 .

[117]  J. Dietrich Riverscape mapping with helicopter-based Structure-from-Motion photogrammetry , 2016 .

[118]  S. Robson,et al.  Optimising UAV topographic surveys processed with structure-from-motion: Ground control quality, quantity and bundle adjustment , 2016 .

[119]  S. Ullman The Interpretation of Visual Motion , 1979 .

[120]  P. Tarolli,et al.  Bank erosion in agricultural drainage networks: new challenges from structure‐from‐motion photogrammetry for post‐event analysis , 2015 .

[121]  H. Viles Technology and geomorphology: Are improvements in data collection techniques transforming geomorphic science? , 2016 .

[122]  A. Kaiser,et al.  Addressing uncertainties in interpreting soil surface changes by multitemporal high‐resolution topography data across scales , 2018, Land Degradation & Development.

[123]  Carlos Castillo,et al.  Image-based surface reconstruction in geomorphometry - merits, limits and developments , 2016 .

[124]  M. Goodchild,et al.  Data-driven geography , 2014, GeoJournal.

[125]  Richard J. Hardy,et al.  Optimising 4-D surface change detection: an approach for capturing rockfall magnitude–frequency , 2018 .

[126]  Thomas S. Huang,et al.  Theory of Reconstruction from Image Motion , 1992 .

[127]  P. Tarolli,et al.  Analysis of glacial and periglacial processes using structure from motion , 2015 .

[128]  Eija Honkavaara,et al.  Point Cloud Generation from Aerial Image Data Acquired by a Quadrocopter Type Micro Unmanned Aerial Vehicle and a Digital Still Camera , 2012, Sensors.

[129]  P. Tarolli,et al.  Rainfall simulation and Structure-from-Motion photogrammetry for the analysis of soil water erosion in Mediterranean vineyards. , 2017, The Science of the total environment.

[130]  John Woodward,et al.  Cost-effective erosion monitoring of coastal cliffs , 2018, Coastal Engineering.

[131]  Thomas P. Kersten,et al.  Low-Cost and Open-Source Solutions for Automated Image Orientation - A Critical Overview , 2012, EuroMed.

[132]  Marco Scaioni,et al.  Combination of UAV and terrestrial photogrammetry to assess rapid glacier evolution and map glacier hazards , 2018 .

[133]  Christopher A. Gomez,et al.  A study of Japanese Landscapes using Structure from Motion Derived DSMs and DEMs based on Historical Aerial Photographs: New Opportunities for Vegetation Monitoring and Diachronic Geomorphology , 2015 .

[134]  Edward Park,et al.  Volunteered Geographic Videos in Physical Geography: Data Mining from YouTube , 2018 .

[135]  H. Farid,et al.  Hillslope Topography from Unconstrained Photographs , 2002 .

[136]  Changchang Wu,et al.  Towards Linear-Time Incremental Structure from Motion , 2013, 2013 International Conference on 3D Vision.

[137]  A. Kaiser,et al.  Feasibility of High-Resolution Soil Erosion Measurements by Means of Rainfall Simulations and SfM Photogrammetry , 2016 .

[138]  Simon Lucey,et al.  Object-Centric Photometric Bundle Adjustment with Deep Shape Prior , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[139]  Sara Ibáñez-Asensio,et al.  Quantifying small‐magnitude soil erosion: Geomorphic change detection at plot scale , 2018 .

[140]  L. Ravanel,et al.  Brief communication: 3-D reconstruction of a collapsed rock pillar from Web-retrieved images and terrestrial lidar data – the 2005 event of the west face of the Drus (Mont Blanc massif) , 2016 .

[141]  M. James,et al.  Quantifying ice cliff evolution with multi-temporal point clouds on the debris-covered Khumbu Glacier, Nepal , 2017, Journal of Glaciology.