Quantifying impacts on remote photogrammetric inspection using unmanned aerial vehicles

Abstract Remote photogrammetric inspection is a Non-Destructive Testing method used to quantify surface integrity and detect external discontinuities. The mobility and size of an unmanned aerial vehicle (UAV) offer the flexibility to quickly deploy remote photogrammetric inspections for large-scale assets. In this paper, the results of a photogrammetric inspection are presented as a 3D profile, reconstructed from UAV captured images. Experiments were conducted indoors using a wind turbine blade section obtained from a recently decommissioned asset. The naturally occurring surface features representative of environmental wear were augmented with a small number of artificial features to aid in the visualisation of inspection quality. An autonomous UAV system for photogrammetric inspections is demonstrated and the influence of image parameters such as environmental light levels, motion blur and focal blur quantified in terms of their impact on the inspection accuracy. Over the range of parameter values studied, the poorest scenario was observed to cause a degradation in reconstruction error by a factor of 13 versus the optimal. Reconstruction quality when employing a laser range scanner to maintain standoff distance relative to the object during flight was also investigated. In this schema, the controller automatically generated a real-time adaptive flight path to follow the outer profile of the wind turbine blade and, consequently, demonstrated improved image quality during close-range inspection of an object with complex geometry. Inspection accuracy was quantified using the error of the photogrammetric reconstruction as compared to a model acquired using independent metrology equipment. While utilising the laser-based adaptive path, error in the reconstructed geometry was reduced by a factor of 2.7 versus a precomputed circular path. In the best case, the mean deviation was below 0.25 mm. Instances of wind turbine blade damage such as edge crushing, surface imperfections, early stage leading edge erosion were clearly observed in the textured 3D reconstruction profiles, indicating the utility of the successful inspection process. The results of this paper evaluate the impact of optical environmental effects on photogrammetric inspection accuracy, offering practical insight towards mitigation of negative effects.

[1]  E. V. D. Heide,et al.  Leading edge erosion of coated wind turbine blades: Review of coating life models , 2015 .

[2]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[3]  Junwon Seo,et al.  Drone-enabled bridge inspection methodology and application , 2018, Automation in Construction.

[4]  Mark D. Willis,et al.  Reconstructing Paleolithic cave art: The example of Marsoulas Cave (France) , 2016 .

[5]  Robert Jenssen,et al.  Automatic autonomous vision-based power line inspection: A review of current status and the potential role of deep learning , 2018, International Journal of Electrical Power & Energy Systems.

[6]  Guido Morgenthal,et al.  Quality Assessment of Unmanned Aerial Vehicle (UAV) Based Visual Inspection of Structures , 2014 .

[7]  Sabbah Ataya,et al.  Damages of wind turbine blade trailing edge: Forms, location, and root causes , 2013 .

[8]  Junwon Seo,et al.  Bridge Deterioration Quantification Protocol Using UAV , 2018, Journal of Bridge Engineering.

[9]  Mike J. Smith,et al.  Cameras and settings for aerial surveys in the geosciences , 2017 .

[10]  Gordon Dobie,et al.  Visual odometry and image mosaicing for NDE , 2013 .

[11]  Stephen Gareth Pierce,et al.  Quantifying and Improving Laser Range Data When Scanning Industrial Materials , 2016, IEEE Sensors Journal.

[12]  Zion Tsz Ho Tse,et al.  State-of-the-art technologies for UAV inspections , 2018 .

[13]  Zijun Zhang,et al.  Automatic Detection of Wind Turbine Blade Surface Cracks Based on UAV-Taken Images , 2017, IEEE Transactions on Industrial Electronics.

[14]  Junwon Seo,et al.  Synthesis of Unmanned Aerial Vehicle Applications for Infrastructures , 2018, Journal of Performance of Constructed Facilities.

[15]  Tim Weyrich,et al.  Real-Time 3D Reconstruction in Dynamic Scenes Using Point-Based Fusion , 2013, 2013 International Conference on 3D Vision.

[16]  Gordon Dobie,et al.  Spatial calibration of large volume photogrammetry based metrology systems , 2015 .

[17]  Tor A. Johansen,et al.  Autonomous visual navigation of Unmanned Aerial Vehicle for wind turbine inspection , 2015, 2015 International Conference on Unmanned Aircraft Systems (ICUAS).

[18]  Stephen Gareth Pierce,et al.  Autonomous and scalable control for remote inspection with multiple aerial vehicles , 2017, Robotics Auton. Syst..

[19]  Pedro Arias,et al.  Low-cost aerial unit for outdoor inspection of building façades , 2013 .

[20]  Olaf Hellwich,et al.  A regularized volumetric fusion framework for large-scale 3D reconstruction , 2018 .

[21]  Emil Fresk,et al.  Cooperative coverage path planning for visual inspection , 2018 .

[22]  Hyun Myung,et al.  Mechanism and system design of MAV(Micro Aerial Vehicle)-type wall-climbing robot for inspection of wind blades and non-flat surfaces , 2015, 2015 15th International Conference on Control, Automation and Systems (ICCAS).

[23]  David Lattanzi,et al.  3D Scene Reconstruction for Robotic Bridge Inspection , 2015 .

[24]  Yi-Qing Ni,et al.  A review of full-scale structural testing of wind turbine blades , 2014 .

[25]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Wolfram Burgard,et al.  A Fully Autonomous Indoor Quadrotor , 2012, IEEE Transactions on Robotics.

[27]  Terry Moore,et al.  What is the accuracy of DGPS? , 2005, Journal of Navigation.