Analysis on the Impact of Data Augmentation on Target Recognition for UAV-Based Transmission Line Inspection

Target recognition is one of the core tasks of transmission line inspection based on Unmanned Aerial Vehicle (UAV), and at present plenty of deep learning-based methods have been developed for it. To enhance the generalization ability of the recognition models, a huge number of training samples are needed to cover most of all possible situations. However, due to the complexity of the environmental conditions and targets, and the limitations of images’ collection and annotation, the samples usually are insufficient when training a deep learning model for target recognition, which is one of the main factors reducing the performance of the model. To overcome this issue, some data augmentation methods have been developed to generate additional samples for model training. Although these methods have been widely used, currently there is no quantitative study on the impact of the data augmentation methods on target recognition. In this paper, taking insulator strings as the target, the impact of a series of widely used data augmentation methods on the accuracy of target recognition is studied, including histogram equalization, Gaussian blur, random translation, scaling, cutout, and rotation. Extensive tests are carried out to verify the impact of the augmented samples in the training set, the test set, or the both. Experimental results show that data augmentation plays an important role in improving the accuracy of recognition models, in which the impacts of the data augmentation methods such as Gaussian blur, scaling, and rotation are significant.

[1]  Bowen Shi,et al.  Research on Recognition Method of Electrical Components Based on YOLO V3 , 2019, IEEE Access.

[2]  Chunhe Song,et al.  Image Forgery Detection Based on Motion Blur Estimated Using Convolutional Neural Network , 2019, IEEE Sensors Journal.

[3]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Alex Pappachen James,et al.  IN-YOLO: Real-Time Detection of Outdoor High Voltage Insulators Using UAV Imaging , 2020, IEEE Transactions on Power Delivery.

[5]  Catherine Rosenberg,et al.  Energy consumption analysis of residential swimming pools for peak load shaving , 2018, Applied Energy.

[6]  Zhenbing Zhao,et al.  Localization of multiple insulators by orientation angle detection and binary shape prior knowledge , 2015, IEEE Transactions on Dielectrics and Electrical Insulation.

[7]  Xian Tao,et al.  Detection of Power Line Insulator Defects Using Aerial Images Analyzed With Convolutional Neural Networks , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[8]  Yincheng Qi,et al.  Representation of binary feature pooling for detection of insulator strings in infrared images , 2016, IEEE Transactions on Dielectrics and Electrical Insulation.

[9]  Carlos Sampedro,et al.  Deep Learning-Based System for Automatic Recognition and Diagnosis of Electrical Insulator Strings , 2019, IEEE Access.

[10]  Hao Jiang,et al.  Insulator Fault Detection in Aerial Images Based on Ensemble Learning With Multi-Level Perception , 2019, IEEE Access.

[11]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Hai Zhao,et al.  Wearable Continuous Body Temperature Measurement Using Multiple Artificial Neural Networks , 2018, IEEE Transactions on Industrial Informatics.

[13]  Xuefeng Li,et al.  Insulator Defect Recognition Based on Global Detection and Local Segmentation , 2020, IEEE Access.

[14]  Hao Jiang,et al.  Insulator Detection in Aerial Images for Transmission Line Inspection Using Single Shot Multibox Detector , 2019, IEEE Access.

[15]  Xiaojin Gong,et al.  A Deep Learning Approach for Oriented Electrical Equipment Detection in Thermal Images , 2018, IEEE Access.

[16]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[17]  Ke Zhang,et al.  Aggregating Deep Convolutional Feature Maps for Insulator Detection in Infrared Images , 2017, IEEE Access.

[18]  Chunhe Song,et al.  An analysis on the energy consumption of circulating pumps of residential swimming pools for peak load management , 2017 .

[19]  Shibin Gao,et al.  Deep Architecture for High-Speed Railway Insulator Surface Defect Detection: Denoising Autoencoder With Multitask Learning , 2019, IEEE Transactions on Instrumentation and Measurement.