Power Line Segmentation in Aerial Images Using Convolutional Neural Networks

Visual inspection of transmission and distribution networks is often carried out by various electricity companies on a regular basis to maintain the reliability, availability, and sustainability of electricity supply. Till date the widely used technique for carrying out an inspection is done manually either using foot patrol and/or helicopter operated manually. However, recently due to the widespread use of quadcopters/UAVs powered by deep learning algorithms, there have been requirements to automate the visual inspection of the power lines. With this objective in mind, this paper presents an approach towards automatic autonomous vision-based power line segmentation in optical images captured by Unmanned Aerial Vehicle (UAV) using deep learning backbone for data analysis. Power line segmentation is often considered as a first step required for power line inspection. Different state-of-the-art semantic segmentation techniques available in the literature have been used and a comparative analysis has been done in terms of the Jaccard index on two different power line databases. This paper also presents a new power line database captured using UAV along with the baseline results. Experimental results show that out of the four deep learning-based segmentation architectures used in our experiments the Nested U-Net architecture out-performed others in terms of line segmentation accuracy in various background scenarios.

[1]  Francois Miralles,et al.  State-of-the-art review of computer vision for the management of power transmission lines , 2014, Proceedings of the 2014 3rd International Conference on Applied Robotics for the Power Industry.

[2]  Xiaolong Hui,et al.  Vision-based autonomous navigation approach for unmanned aerial vehicle transmission-line inspection , 2018 .

[3]  Flavio Prieto,et al.  Power line detection using a circle based search with UAV images , 2014, 2014 International Conference on Unmanned Aircraft Systems (ICUAS).

[4]  Alexey Shvets,et al.  TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation , 2018, Computer-Aided Analysis of Gastrointestinal Videos.

[5]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[6]  Omer Emre Yetgin,et al.  Powerline Image Dataset (Infrared-IR and Visible Light-VL) , 2017 .

[7]  Robert Jenssen,et al.  Automatic autonomous vision-based power line inspection: A review of current status and the potential role of deep learning , 2018, International Journal of Electrical Power & Energy Systems.

[8]  Abhishek Dutta,et al.  The VGG Image Annotator (VIA) , 2019, ArXiv.

[9]  André Dias,et al.  PLineD: Vision-based power lines detection for Unmanned Aerial Vehicles , 2017, 2017 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[10]  J. Katrasnik,et al.  A Survey of Mobile Robots for Distribution Power Line Inspection , 2010, IEEE Transactions on Power Delivery.

[11]  Jayavardhana Gubbi,et al.  Power infrastructure monitoring and damage detection using drone captured images , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[12]  Juha Hyyppä,et al.  Remote sensing methods for power line corridor surveys , 2016 .

[13]  Takio Kurita,et al.  Fast and Accurate Image Super Resolution by Deep CNN with Skip Connection and Network in Network , 2017, ICONIP.

[14]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.