Insulator Detection in Aerial Images for Transmission Line Inspection Using Single Shot Multibox Detector

The detection of insulators with cluttered backgrounds in aerial images is a challenging task for an automatic transmission line inspection system. In this paper, we propose an effective and reliable insulator detection method based on a deep learning technique for aerial images. In the proposed deep detection approach, the single shot multibox detector (SSD), a powerful deep meta-architecture, is incorporated with a strategy of two-stage fine-tuning. The SSD-based model can realize automatic multi-level feature extractor from aerial images instead of manually extracting features. Inspired by transfer learning, a two-stage fine-tuning strategy is implemented using separate training sets. In the first stage, the basic insulator model is obtained by fine-tuning the COCO model with aerial images, including different types of insulators and various backgrounds. In the second stage, the basic model is fine-tuned by the training sets of the specific insulator types and specific situations to be detected. After the two-stage fine-tuning, the well-trained SSD model can directly and accurately identify the insulator by feeding the aerial images. The results show that both the porcelain insulator and composite insulator can be quickly and accurately identified in the aerial images with complex background. The proposed approach can enhance the accuracy, efficiency, and robustness significantly.

[1]  Gregory Shakhnarovich,et al.  Regularizing Deep Networks by Modeling and Predicting Label Structure , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[2]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[3]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  M. Jaya Bharata Reddy,et al.  Condition monitoring of 11 kV distribution system insulators incorporating complex imagery using combined DOST-SVM approach , 2013, IEEE Transactions on Dielectrics and Electrical Insulation.

[5]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[6]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[7]  Jubai An,et al.  A Texture Segmentation Algorithm Based on PCA and Global Minimization Active Contour Model for Aerial Insulator Images , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  Sergio Guadarrama,et al.  Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Jonathan T. Barron,et al.  Semantic Image Segmentation with Task-Specific Edge Detection Using CNNs and a Discriminatively Trained Domain Transform , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Yue Liu,et al.  Recognition and Drop-Off Detection of Insulator Based on Aerial Image , 2016, 2016 9th International Symposium on Computational Intelligence and Design (ISCID).

[11]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[12]  Jubai An,et al.  A Robust Insulator Detection Algorithm Based on Local Features and Spatial Orders for Aerial Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[13]  Jianwei Zhang,et al.  A Vision-Based Broken Strand Detection Method for a Power-Line Maintenance Robot , 2014, IEEE Transactions on Power Delivery.

[14]  Jubai An,et al.  An Active Contour Model Based on Texture Distribution for Extracting Inhomogeneous Insulators From Aerial Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[16]  Bingfeng Li,et al.  A Method of Insulator Detection from Video Sequence , 2012, 2012 Fourth International Symposium on Information Science and Engineering.

[17]  Pascual Campoy Cervera,et al.  A supervised approach to electric tower detection and classification for power line inspection , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[18]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[20]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[21]  M. J. B. Reddy,et al.  A DOST based approach for the condition monitoring of 11 kV distribution line insulators , 2011, IEEE Transactions on Dielectrics and Electrical Insulation.

[22]  Robert Jenssen,et al.  Automatic autonomous vision-based power line inspection: A review of current status and the potential role of deep learning , 2018, International Journal of Electrical Power & Energy Systems.

[23]  Jubai An,et al.  A Simple Method of Tempered Glass Insulator Recognition from Airborne Image , 2010, 2010 International Conference on Optoelectronics and Image Processing.

[24]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[25]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[26]  Horst Bischof,et al.  Visual Recognition and Fault Detection for Power Line Insulators , 2014 .

[27]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[28]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Zhenbing Zhao,et al.  Localization of multiple insulators by orientation angle detection and binary shape prior knowledge , 2015, IEEE Transactions on Dielectrics and Electrical Insulation.