The Power Line Inspection Software (PoLIS): A versatile system for automating power line inspection

Abstract A large amount of data, provided in the form of video data, is acquired during manned inspections flights of electric power lines. This data is analyzed by expert human inspectors to detect faults in the power lines infrastructure and prepare the inspection reports. This process is extremely time consuming, very expensive and prone to human error. In this paper, we present PoLIS: the Power Line Inspection Software, which has been developed with the objective of assisting the analysis of the data acquired during inspection flights. PoLIS is based on the cooperation between computer vision and machine learning techniques to automatically process video sequences acquired during inspection flights, resulting in a set of representative images per electric tower which we call Key Frames. These representative images can then be used for inspection purposes, leading to a drastic reduction of the human operators’ workload. At the core of the strategy lies an electric tower detector, which is in charge of estimating the location of the towers within the images based on the combination of a sliding window search technique and a supervised classifier. The location of the tower is then tracked using a tracking-by-registration algorithm based on direct methods, estimating the position of the tower in different images. Finally, different criteria are applied for defining whether the image corresponds to a Key Frame image or not. Extensive evaluation of the proposed strategy is conducted using videos acquired during manned helicopter inspections. The videos constituting this database contain several thousand frames representing both medium and high voltage power transmission lines in the infra-red (IR) and visible spectra. The obtained results show that the proposed strategy can reduce the large amount of data present in the inspection videos to a few Key Frames for each tower. It is also demonstrated that the learning-based approach proposed in PoLIS is appropriate for detecting electric towers, a process which is made faster and more robust by coupling it with a tower tracking algorithm. A Graphical User Interface allowing the application of PoLIS to user-provided videos is also presented in this paper, illustrating the whole process and the automated generation of an inspection report.

[1]  Jayavardhana Gubbi,et al.  A new deep learning architecture for detection of long linear infrastructure , 2017, 2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA).

[2]  Ye Gao-sheng.  Recognition of Insulator Based on Developed MPEG-7 Texture Feature , 2010 .

[3]  Pascual Campoy Cervera,et al.  A supervised approach to electric tower detection and classification for power line inspection , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[4]  Richard M. Leahy,et al.  An Optimal Graph Theoretic Approach to Data Clustering: Theory and Its Application to Image Segmentation , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Horst Bischof,et al.  Visual Recognition and Fault Detection for Power Line Insulators , 2014 .

[6]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[7]  Jayavardhana Gubbi,et al.  Power infrastructure monitoring and damage detection using drone captured images , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[8]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Javier R. Movellan,et al.  Whose Vote Should Count More: Optimal Integration of Labels from Labelers of Unknown Expertise , 2009, NIPS.

[10]  Xiaoyu Wang,et al.  Learning for Tower Detection of Power Line Inspection , 2017 .

[11]  Pietro Perona,et al.  Inferring Ground Truth from Subjective Labelling of Venus Images , 1994, NIPS.

[12]  D. I. Jones,et al.  Aerial video inspection of overhead power lines , 2001 .

[13]  Simon Baker,et al.  Equivalence and efficiency of image alignment algorithms , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[14]  Irene Y. H. Gu,et al.  Automatic Surveillance and Analysis of Snow and Ice Coverage on Electrical Insulators of Power Transmission Lines , 2008, ICCVG.

[15]  Changming Sun,et al.  Measuring the distance of vegetation from powerlines using stereo vision , 2006 .

[16]  Roberto Teti,et al.  A roadmap for automated power line inspection. Maintenance and repair. , 2013 .

[17]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[18]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Yincheng Qi,et al.  Multi-patch deep features for power line insulator status classification from aerial images , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[20]  Sansanee Auephanwiriyakul,et al.  Automatic detection of electricity pylons in aerial video sequences , 2010, 2010 International Conference on Electronics and Information Engineering.

[21]  James W. Cooper,et al.  Early jump-out corner detectors , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Miguel A. Olivares-Méndez,et al.  A Hierarchical Tracking Strategy for Vision-Based Applications On-Board UAVs , 2013, J. Intell. Robotic Syst..

[23]  Miguel A. Olivares-Méndez,et al.  HMPMR strategy for real-time tracking in aerial images, using direct methods , 2014, Machine Vision and Applications.

[24]  Edward H. Adelson,et al.  PYRAMID METHODS IN IMAGE PROCESSING. , 1984 .

[25]  Youmin Zhang,et al.  Insulator identification from aerial images using Support Vector Machine with background suppression , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).

[26]  Eugeniusz Rosolowski,et al.  Fault Location on Power Networks , 2009 .

[27]  P. Anandan,et al.  About Direct Methods , 1999, Workshop on Vision Algorithms.

[28]  Dewi I. Jones,et al.  Corner detection and matching for visual tracking during power line inspection , 2003, Image Vis. Comput..

[29]  Wengang Cheng,et al.  Power Pole Detection Based on Graph Cut , 2008, 2008 Congress on Image and Signal Processing.

[30]  Carlos Sampedro,et al.  Towards autonomous detection and tracking of electric towers for aerial power line inspection , 2014, 2014 International Conference on Unmanned Aircraft Systems (ICUAS).