Deep-learning-based autonomous navigation approach for UAV transmission line inspection

This paper aims to resolve the problem of UAV robustly continuous navigation along one side of overhead transmission lines. To this end, we develop a corresponding navigation scheme and address the following three key issues. First, we integrate the tracking and deep-learning-based detection for the real-time and reliable transmission tower localization. Second, to provide UAV with a robust and precise heading, we compute and optimize the vanishing point of transmission lines. Third, to solve the problem of measurement of distance from transmission lines, we turn to estimate the distance from UAV to transmission tower by triangulation following the multiple-view strategy. Finally, by the designed UAV platform, the whole system is tested in a practical field environment and achieves an encouraging result. To the best of our knowledge, this paper marks the first time that a continuous flight scheme a long o ne s ide o f transmission lines is put forward and well implemented.

[1]  Yang Li,et al.  Automatic power line extraction from high resolution remote sensing imagery based on an improved Radon transform , 2016, Pattern Recognit..

[2]  Xiaoyu Wang,et al.  Learning for Tower Detection of Power Line Inspection , 2017 .

[3]  Qian Wang,et al.  High Speed Automatic Power Line Detection and Tracking for a UAV-Based Inspection , 2012, 2012 International Conference on Industrial Control and Electronics Engineering.

[4]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[5]  Bernardino Castillo-Toledo,et al.  Power line inspection via an unmanned aerial system based on the quadrotor helicopter , 2014, MELECON 2014 - 2014 17th IEEE Mediterranean Electrotechnical Conference.

[6]  Flavio Prieto,et al.  Power line detection using a circle based search with UAV images , 2014, 2014 International Conference on Unmanned Aircraft Systems (ICUAS).

[7]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[8]  韩建达,et al.  High voltage transmission line detection for uav based routing inspection , 2013 .

[9]  Hyunchul Shin,et al.  Road vanishing point detection using weber adaptive local filter and salient-block-wise weighted soft voting , 2016, IET Comput. Vis..

[10]  Iván Fernando Mondragón,et al.  Towards Visual Based Navigation with Power Line Detection , 2014, ISVC.

[11]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[12]  Pascual Campoy Cervera,et al.  A supervised approach to electric tower detection and classification for power line inspection , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[13]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Pierre-Luc Richard,et al.  LineScout Technology Opens the Way to Robotic Inspection and Maintenance of High-Voltage Power Lines , 2015, IEEE Power and Energy Technology Systems Journal.

[15]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[17]  Bruno Emile,et al.  Indoor navigation assistance with a Smartphone camera based on vanishing points , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[18]  Luís Tavares,et al.  RIOL—Robotic inspection over power lines , 2007 .

[19]  Gehao Sheng,et al.  Research on Auto-Tracking Algorithm for Power Line Inspection Based on Unmanned Aerial Vehicle , 2012, 2012 Asia-Pacific Power and Energy Engineering Conference.

[20]  Roberto Teti,et al.  A roadmap for automated power line inspection. Maintenance and repair. , 2013 .

[21]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Iván Fernando Mondragón,et al.  Real-time transmission tower detection from video based on a feature descriptor , 2017, IET Comput. Vis..