Search Like an Eagle: A Cascaded Model for Insulator Missing Faults Detection in Aerial Images

Insulator missing fault is a serious accident of high-voltage transmission lines, which can cause abnormal energy supply. Recently, a lot of vision-based methods are proposed for detecting an insulator missing fault in aerial images. However, these methods usually lack efficiency and robustness due to the effect of the complex background interferences in the aerial images. More importantly, most of these methods cannot address the insulator multi-fault detection. This paper proposes an unprecedented cascaded model to detect insulator multi-fault in the aerial images to solve the existing challenges. Firstly, a total of 764 images are adopted to create a novel insulator missing faults dataset ‘IMF-detection’. Secondly, a new network is proposed to locate the insulator string from the complex background. Then, the located region that contains the insulator string is set to be an RoI (region of interest) region. Finally, the YOLO-v3 tiny network is trained and then used to detect the insulator missing faults in the RoI region. Experimental results and analysis validate that the proposed method is more efficient and robust than some previous works. Most importantly, the average running time of the proposed method is about 30ms, which demonstrates that it has the potential to be adopted for the on-line detection of insulator missing faults.

[1]  Silvio Savarese,et al.  Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Samir Kouro,et al.  Robotics in Power Systems: Enabling a More Reliable and Safe Grid , 2017, IEEE Industrial Electronics Magazine.

[3]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[4]  Yi Fang,et al.  UAV Low Altitude Photogrammetry for Power Line Inspection , 2016, ISPRS Int. J. Geo Inf..

[5]  Xusheng Lei,et al.  Intelligent fault detection of high voltage line based on the Faster R-CNN , 2019, Measurement.

[6]  Pengyi Zhang,et al.  SlimYOLOv3: Narrower, Faster and Better for Real-Time UAV Applications , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[7]  Haiyan Cheng,et al.  Multi-Saliency Aggregation-Based Approach for Insulator Flashover Fault Detection Using Aerial Images , 2018 .

[8]  Hao Jiang,et al.  Insulator Detection in Aerial Images Based on Faster Regions with Convolutional Neural Network , 2018, 2018 IEEE 14th International Conference on Control and Automation (ICCA).

[9]  Carlos Vallespi-Gonzalez,et al.  LaserNet: An Efficient Probabilistic 3D Object Detector for Autonomous Driving , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[11]  Hao Jiang,et al.  Insulator Detection in Aerial Images for Transmission Line Inspection Using Single Shot Multibox Detector , 2019, IEEE Access.

[12]  Shengquan Xie,et al.  Texture-and-Shape Based Active Contour Model for Insulator Segmentation , 2019, IEEE Access.

[13]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Zhang Xiao,et al.  An Extreme-Learning-Machine-Based Hyperspectral Detection Method of Insulator Pollution Degree , 2019, IEEE Access.

[15]  Zhenbing Zhao,et al.  Insulator Fault Detection Based on Spatial Morphological Features of Aerial Images , 2018, IEEE Access.

[16]  Hao Xu,et al.  A Method of Insulator Faults Detection in Aerial Images for High-Voltage Transmission Lines Inspection , 2019, Applied Sciences.

[17]  Lei Ma,et al.  Detection Method of Insulator Based on Faster R-CNN , 2017, 2017 IEEE 7th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER).

[18]  Stefan Leutenegger,et al.  SceneCode: Monocular Dense Semantic Reconstruction Using Learned Encoded Scene Representations , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Guodong Yang,et al.  Real-time segmentation of various insulators using generative adversarial networks , 2018, IET Comput. Vis..

[20]  Wang Wei,et al.  Electric insulator detection of UAV images based on depth learning , 2017, 2017 2nd International Conference on Power and Renewable Energy (ICPRE).

[21]  Xinbo Huang,et al.  A Recognition Technology of Transmission Lines Conductor Break and Surface Damage Based on Aerial Image , 2019, IEEE Access.

[22]  Liang Yang,et al.  UAV-Based Oblique Photogrammetry for Outdoor Data Acquisition and Offsite Visual Inspection of Transmission Line , 2017, Remote. Sens..

[23]  Zhenbing Zhao,et al.  Localization of Multiple Power Line Insulators Based on Shape Feature Points and Equidistant Model in Aerial Images , 2018, 2018 IEEE Fourth International Conference on Multimedia Big Data (BigMM).

[24]  Di Wang,et al.  Fault detection of insulator based on saliency and adaptive morphology , 2017, Multimedia Tools and Applications.

[25]  Bin Yan,et al.  Insulator detection and recognition of explosion based on convolutional neural networks , 2019, Int. J. Wavelets Multiresolution Inf. Process..

[26]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .

[27]  Guodong Yang,et al.  Learning Insulators Segmentation from Synthetic Samples* , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[28]  Lei Zhang,et al.  A Generation Method of Insulator Region Proposals Based on Edge Boxes , 2017, CCCV.

[29]  Zhenbing Zhao,et al.  The recognition and localization of insulators adopting SURF and IFS based on correlation coefficient , 2014 .

[30]  Xin Xu,et al.  Fault Detection of Insulators Using Second-order Fully Convolutional Network Model , 2019, Mathematical Problems in Engineering.

[31]  Ke Zhang,et al.  Insulator Detection Method in Inspection Image Based on Improved Faster R-CNN , 2019, Energies.

[32]  Feng Gao,et al.  Recognition of insulator explosion based on deep learning , 2017, 2017 14th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP).

[33]  Jorge Valenzuela,et al.  Unmanned Aircraft System Path Planning for Visually Inspecting Electric Transmission Towers , 2018, J. Intell. Robotic Syst..

[34]  Bin Li,et al.  Image Segmentation Method of Insulator in Transmission Line Based on Weighted Variable Fuzzy C-Means , 2017 .

[35]  Felipe V. Lopes,et al.  Accurate Two-Terminal Transmission Line Fault Location Using Traveling Waves , 2018, IEEE Transactions on Power Delivery.

[36]  Zihui Yin,et al.  The discrimination method as applied to a deteriorated porcelain insulator used in transmission lines on the basis of a convolution neural network , 2017, IEEE Transactions on Dielectrics and Electrical Insulation.

[37]  Hao Jiang,et al.  Insulator Fault Detection in Aerial Images Based on Ensemble Learning With Multi-Level Perception , 2019, IEEE Access.

[38]  Zhenbing Zhao,et al.  Localization of multiple insulators by orientation angle detection and binary shape prior knowledge , 2015, IEEE Transactions on Dielectrics and Electrical Insulation.

[39]  Jianlin Wang,et al.  DC-SPP-YOLO: Dense Connection and Spatial Pyramid Pooling Based YOLO for Object Detection , 2019, Inf. Sci..

[40]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Bowen Shi,et al.  Research on Recognition Method of Electrical Components Based on YOLO V3 , 2019, IEEE Access.

[42]  Zhedong Zheng,et al.  Joint Discriminative and Generative Learning for Person Re-Identification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Alex Pappachen James,et al.  IN-YOLO: Real-Time Detection of Outdoor High Voltage Insulators Using UAV Imaging , 2020, IEEE Transactions on Power Delivery.

[44]  Xin Li,et al.  Detection of Bird’s Nest in High Power Lines in the Vicinity of Remote Campus Based on Combination Features and Cascade Classifier , 2018, IEEE Access.

[45]  Robert Jenssen,et al.  Intelligent Monitoring and Inspection of Power Line Components Powered by UAVs and Deep Learning , 2019, IEEE Power and Energy Technology Systems Journal.

[46]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[47]  Xian Tao,et al.  Detection of Power Line Insulator Defects Using Aerial Images Analyzed With Convolutional Neural Networks , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[48]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[49]  Robert Jenssen,et al.  Automatic autonomous vision-based power line inspection: A review of current status and the potential role of deep learning , 2018, International Journal of Electrical Power & Energy Systems.

[50]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Yang Guodong,et al.  Feature fusion based insulator detection for aerial inspection , 2017, 2017 36th Chinese Control Conference (CCC).

[52]  Ying Wang,et al.  Insulator identification and self-shattering detection based on mask region with convolutional neural network , 2019, J. Electronic Imaging.

[53]  Zion Tsz Ho Tse,et al.  State-of-the-art technologies for UAV inspections , 2018 .

[54]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Carlos Sampedro,et al.  Deep Learning-Based System for Automatic Recognition and Diagnosis of Electrical Insulator Strings , 2019, IEEE Access.