Field Validation of an Advanced Autonomous Method of Exterior Dam Inspection Using Unmanned Aerial Vehicles

Field Validation of an Advanced Autonomous Method of Exterior Dam Inspection Using Unmanned Aerial Vehicles Benjamin Joseph Barrett Department of Civil and Environmental Engineering, BYU Master of Science The maintenance of infrastructure is critical to the well-being of society. This work focuses on a novel method for inspecting the exterior of dams using unmanned aerial vehicles (UAVs) in an automated fashion. The UAVs are equipped with optical sensors capturing still images. The resulting images are used to generate three-dimensional (3D) models using Structure from Motion (SfM) computer software. The SfM models are then used to inspect the exterior of the dam. As typical dam inspections entail completing a checklist of inspection items with varied degrees of precision (e.g. a concrete spillway may be finely inspected for cracking or joint deterioration while the general stability and water-tightness of a large embankment may be observed from a distance), a targeted inspection is also needed for the UAV method. In conjunction with the work presented in this thesis, a novel algorithm was developed which uses camera view planning across multiple proximity levels to generate a set of camera poses (positions and orientations) which can be collected in an autonomous UAV flight that facilitates generation of SfM models having tiered model quality for targeted inspection of infrastructure features. In this thesis, this novel algorithm and accompanying mobile application (referred to together as the novel advanced autonomous method) were field validated at Tibble Fork Dam, UT. The advanced autonomous method was compared to two other common image acquisition methods—basic autonomous and manual piloted—based on the SfM models produced from the collected image sets. The advanced autonomous method was found to produce models having tiered quality needed for efficient targeted inspection (25% and 50% higher resolution in medium and high priority target areas). The advanced autonomous method was found to produce models having on average 38% higher precise point accuracy (1.3cm) and 53% tighter surface reproducibility (for repeat inspections) (1.9cm) than basic autonomous and manual piloted image acquisition methods. The advanced autonomous method required on average 167% longer flight time and 38% fewer images than the other two methods, resulting in increased field time but decreased processing load. Additionally, viability of the advanced autonomous method for practical dam inspection was assessed through a case study inspection of Tibble Fork Dam using the collected SfM model and corresponding still images. The SfM model and corresponding images were found fully adequate for performing 94% of the inspection tasks and partially adequate for the remaining tasks. In consideration of this and other practical implementation factors such as time and safety, the method appears highly viable as an alternate to or supplement with traditional on-foot visual exterior inspection of dams such as Tibble Fork Dam. Suggestions for future work include adjustments to the optimization framework to improve field efficiency, development of a framework for cooperative inspection using UAV swarms, and development of a more automated workflow that would allow fully-remote dam inspections.

[1]  Gerd Hirzinger,et al.  View Planning for Multi-View Stereo 3D Reconstruction Using an Autonomous Multicopter , 2012, J. Intell. Robotic Syst..

[2]  John D. Hedengren,et al.  Potential Benefits of Combining Anomaly Detection with View Planning for UAV Infrastructure Modeling , 2017, Remote. Sens..

[3]  G. Roth,et al.  View planning for automated three-dimensional object reconstruction and inspection , 2003, CSUR.

[4]  S. M. Jong,et al.  Mapping landslide displacements using Structure from Motion (SfM) and image correlation of multi-temporal UAV photography , 2014 .

[5]  S. Robson,et al.  3‐D uncertainty‐based topographic change detection with structure‐from‐motion photogrammetry: precision maps for ground control and directly georeferenced surveys , 2017 .

[6]  Piergiorgio Manciola,et al.  Accuracy Analysis of a Dam Model from Drone Surveys , 2017, Sensors.

[7]  Nicos Christofides Worst-Case Analysis of a New Heuristic for the Travelling Salesman Problem , 1976, Operations Research Forum.

[8]  Jürgen Schmidt,et al.  Small-Scale Surface Reconstruction and Volume Calculation of Soil Erosion in Complex Moroccan Gully Morphology Using Structure from Motion , 2014, Remote. Sens..

[9]  Bernardino Castillo-Toledo,et al.  Power line inspection via an unmanned aerial system based on the quadrotor helicopter , 2014, MELECON 2014 - 2014 17th IEEE Mediterranean Electrotechnical Conference.

[10]  Ali Khaloo,et al.  Hierarchical Dense Structure-from-Motion Reconstructions for Infrastructure Condition Assessment , 2017, J. Comput. Civ. Eng..

[11]  Arko Lucieer,et al.  Time Series Analysis of Landslide Dynamics Using an Unmanned Aerial Vehicle (UAV) , 2015, Remote. Sens..

[12]  Jochen Teizer,et al.  Mobile 3D mapping for surveying earthwork projects using an Unmanned Aerial Vehicle (UAV) system , 2014 .

[13]  Mani Golparvar-Fard,et al.  Image-Based Automated 3D Crack Detection for Post-disaster Building Assessment , 2014, J. Comput. Civ. Eng..

[14]  M. Westoby,et al.  ‘Structure-from-Motion’ photogrammetry: A low-cost, effective tool for geoscience applications , 2012 .

[15]  Trent James Okeson,et al.  Camera View Planning for Structure from Motion: Achieving Targeted Inspection Through More Intelligent View Planning Methods , 2018 .

[16]  J. Gonçalves,et al.  UAV photogrammetry for topographic monitoring of coastal areas , 2015 .

[17]  Stephan Nebiker,et al.  A LIGHT-WEIGHT MULTISPECTRAL SENSOR FOR MICRO UAV – OPPORTUNITIES FOR VERY HIGH RESOLUTION AIRBORNE REMOTE SENSING , 2008 .

[18]  D. Lague,et al.  Accurate 3D comparison of complex topography with terrestrial laser scanner: Application to the Rangitikei canyon (N-Z) , 2013, 1302.1183.

[19]  John D. Hedengren,et al.  Evolutionary View Planning for Optimized UAV Terrain Modeling in a Simulated Environment , 2015, Remote. Sens..

[20]  Changchang Wu,et al.  Towards Linear-Time Incremental Structure from Motion , 2013, 2013 International Conference on 3D Vision.

[21]  Ann Lehman,et al.  JMP start statistics : a guide to statistics and data analysis using JMP , 2012 .

[22]  P. Grussenmeyer,et al.  Surveying and modeling of rock discontinuities by terrestrial laser scanning and photogrammetry: Semi-automatic approaches for linear outcrop inspection , 2014 .

[23]  J. Travelletti,et al.  UAV-based remote sensing of the Super-Sauze landslide : evaluation and results. , 2012 .

[24]  Ali Khaloo,et al.  Unmanned aerial vehicle inspection of the Placer River Trail Bridge through image-based 3D modelling , 2018 .

[25]  T. Robinson,et al.  Sustainable Development Goals , 2016 .

[26]  Michel Jaboyedoff,et al.  Detection of millimetric deformation using a terrestrial laser scanner: experiment and application to a rockfall event , 2009 .

[27]  Carlos Hernandez,et al.  Multi-View Stereo: A Tutorial , 2015, Found. Trends Comput. Graph. Vis..

[28]  Xiaohua Tong,et al.  Integration of UAV-Based Photogrammetry and Terrestrial Laser Scanning for the Three-Dimensional Mapping and Monitoring of Open-Pit Mine Areas , 2015, Remote. Sens..

[29]  Manolis I. A. Lourakis,et al.  Automated as-built 3D reconstruction of civil infrastructure using computer vision: Achievements, opportunities, and challenges , 2015, Adv. Eng. Informatics.

[30]  K. Oost,et al.  Reproducibility of UAV-based earth topography reconstructions based on Structure-from-Motion algorithms , 2016 .

[31]  Eui-ik Jeon,et al.  Comparative evaluation of commercial softwares in UAV imagery for cultural heritage recording: case study for traditional building in South Korea , 2017, Spatial Information Research.

[32]  Ivan Bartoli,et al.  Use of Unmanned Aerial Vehicle for Quantitative Infrastructure Evaluation , 2015 .

[33]  Srikanth Saripalli,et al.  Rapid mapping of ultrafine fault zone topography with structure from motion , 2014 .

[34]  Arko Lucieer,et al.  Development of a UAV-LiDAR System with Application to Forest Inventory , 2012, Remote. Sens..

[35]  Mani Golparvar-Fard,et al.  Visual monitoring of civil infrastructure systems via camera-equipped Unmanned Aerial Vehicles (UAVs): a review of related works , 2016 .

[36]  G. Buffi,et al.  Survey of the Ridracoli Dam: UAV–based photogrammetry and traditional topographic techniques in the inspection of vertical structures , 2017 .

[37]  Patricio A. Vela,et al.  Construction performance monitoring via still images, time-lapse photos, and video streams: Now, tomorrow, and the future , 2015, Adv. Eng. Informatics.