Detecting and Positioning of Wind Turbine Blade Tips for UAV-Based Automatic Inspection

Wind turbine detecting and blade tip positioning are essential parts of UAV-based automatic inspection. Previous methods which adopt LiDAR or ultrasonic sensor may cause cost increasement and system instability. We propose a vision-based approach for blade tip detecting and positioning. More precisely, we first detect each structure of wind turbine by combining Mask R-CNN detector and shape constraints. The pixel coordinates of blade tips can be extracted and then be used to solve a PnP problem. Finally we get GPS coordinates of blade tips which are useful for achieving path planning during the inspection. We evaluate the method on a well-annotated wind turbine datasets. The experimental results show the effectiveness and feasibility of the proposed method.

[1]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Sondre Høglund.  Autonomous Inspection of Wind Turbines and Buildings using an UAV , 2014 .

[3]  David Ball,et al.  Vision‐based Obstacle Detection and Navigation for an Agricultural Robot , 2016, J. Field Robotics.

[4]  Wei Guo,et al.  Bottle Detection in the Wild Using Low-Altitude Unmanned Aerial Vehicles , 2018, 2018 21st International Conference on Information Fusion (FUSION).

[5]  Wei Qiao,et al.  A Survey on Wind Turbine Condition Monitoring and Fault Diagnosis—Part I: Components and Subsystems , 2015, IEEE Transactions on Industrial Electronics.

[6]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[8]  Fouad Slaoui-Hasnaoui,et al.  Wind Turbine Condition Monitoring: State-of-the-Art Review, New Trends, and Future Challenges , 2014 .