Insulator Fault Detection in Aerial Images Based on Ensemble Learning With Multi-Level Perception

Insulator fault in the transmission lines is the main factor of power transmission accident. The images captured from the aerial inspection can be utilized to detect the fault of insulators for further maintenance. For automatic transmission lines inspection system, the insulator fault detection is an interesting and challenging task due to the complex background and diversified insulators. In this paper, we propose a novel insulator fault detection method based on multi-level perception for aerial images. The multi-level perception is implemented by an ensemble architecture which combines three single-level perceptions. These single-level perceptions include the low level, middle level, and high level that are named by the attention to the insulator fault. They detect the insulator fault in the entire image, multi-insulator image, and single-insulator image, respectively. To address the filtering problem in the combination of three single-level perceptions, an ensemble method is proposed for generating the final results. For training the detection models employed in the multi-level perception, a powerful deep meta-architecture so-called single shot multibox detector (SSD) is utilized. The well-trained SSD models can automatically extract high quality features from aerial images instead of manually extracting features. By using the multi-level perception, the advantages of global and local information can achieve a favorable balance. Moreover, limited inspection images are fully utilized by the proposed method. Fault detection recall and precision of the proposed method are 93.69% and 91.23% testing in the practical inspection data, and insulator fault under various conditions can be correctly detected in the aerial images. The experimental results show that the proposed method can enhance the accuracy and robustness significantly.

[1]  Di Wang,et al.  Fault detection of insulator based on saliency and adaptive morphology , 2017, Multimedia Tools and Applications.

[2]  Jeremiah Neubert,et al.  DEBC Detection with Deep Learning , 2017, SCIA.

[3]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[4]  Jianwei Zhang,et al.  A Vision-Based Broken Strand Detection Method for a Power-Line Maintenance Robot , 2014, IEEE Transactions on Power Delivery.

[5]  Pascual Campoy Cervera,et al.  A supervised approach to electric tower detection and classification for power line inspection , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[6]  Zhenbing Zhao,et al.  Insulator Fault Detection Based on Spatial Morphological Features of Aerial Images , 2018, IEEE Access.

[7]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[10]  Yincheng Qi,et al.  Multi-patch deep features for power line insulator status classification from aerial images , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[11]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[12]  Robert Jenssen,et al.  Automatic autonomous vision-based power line inspection: A review of current status and the potential role of deep learning , 2018, International Journal of Electrical Power & Energy Systems.

[13]  Hao Jiang,et al.  Insulator Detection in Aerial Images Based on Faster Regions with Convolutional Neural Network , 2018, 2018 IEEE 14th International Conference on Control and Automation (ICCA).

[14]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[15]  Yue Liu,et al.  Recognition and Drop-Off Detection of Insulator Based on Aerial Image , 2016, 2016 9th International Symposium on Computational Intelligence and Design (ISCID).

[16]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[17]  Sergio Guadarrama,et al.  Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[19]  Horst Bischof,et al.  Visual Recognition and Fault Detection for Power Line Insulators , 2014 .

[20]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[21]  Zhenbing Zhao,et al.  Localization of multiple insulators by orientation angle detection and binary shape prior knowledge , 2015, IEEE Transactions on Dielectrics and Electrical Insulation.

[22]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[24]  Luc Van Gool,et al.  Efficient Non-Maximum Suppression , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[25]  Nikos Komodakis,et al.  Object Detection via a Multi-region and Semantic Segmentation-Aware CNN Model , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[26]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[27]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.