Power infrastructure monitoring and damage detection using drone captured images

Infrastructure detection and monitoring is a difficult task. Due to the advances in unmanned vehicles and image analytics, it is possible to decrease the human effort and achieve consistent results in infrastructure assessments using aerial image processing. Reliable detection and integrity checking of power infrastructure including conductor lines, pylons and insulators in a diverse background is the most challenging task in drone based automatic infrastructure monitoring. Most techniques in literature use first principle approach that tries to represent the image as features of interest. This paper proposes a deep learning approach for power infrastructure detection. Graph based post processing is applied for improving the outcomes of the generated deep model. A f-score of 75% is achieved using the deep model which is further improved using spectral clustering for the conductor lines, pylons and insulators that form the core parts of power infrastructure.

[1]  Wengang Cheng,et al.  Power Pole Detection Based on Graph Cut , 2008, 2008 Congress on Image and Signal Processing.

[2]  Jayavardhana Gubbi,et al.  A new deep learning architecture for detection of long linear infrastructure , 2017, 2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA).

[3]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Qian Wang,et al.  Power line inspection with a flying robot , 2010, 2010 1st International Conference on Applied Robotics for the Power Industry.

[5]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[7]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[8]  Tanima Dutta,et al.  A Real-Time Framework for Detection of Long Linear Infrastructural Objects in Aerial Imagery , 2015, ICIAR.

[9]  J. Senthilnath,et al.  Automatic detection of powerlines in UAV remote sensed images , 2015, 2015 International Conference on Condition Assessment Techniques in Electrical Systems (CATCON).

[10]  Rafael Grompone von Gioi,et al.  LSD: a Line Segment Detector , 2012, Image Process. Line.

[11]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[13]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[14]  Sansanee Auephanwiriyakul,et al.  Automatic detection of electricity pylons in aerial video sequences , 2010, 2010 International Conference on Electronics and Information Engineering.

[15]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[16]  Pascual Campoy Cervera,et al.  A supervised approach to electric tower detection and classification for power line inspection , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[17]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[18]  Flavio Prieto,et al.  Power line detection using a circle based search with UAV images , 2014, 2014 International Conference on Unmanned Aircraft Systems (ICUAS).

[19]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[20]  D. I. Jones,et al.  Aerial video inspection of overhead power lines , 2001 .