Automatic Fault Diagnosis of Infrared Insulator Images Based on Image Instance Segmentation and Temperature Analysis

As an onsite condition monitoring method, an infrared inspection can help to discover and analyze abnormal temperature increases in power equipment. For improving the efficiency of the onsite diagnosis of insulators in substations, this article proposes an automatic diagnosis method using instance segmentation and temperature analysis of infrared insulator images. For developing this method, thousands of infrared images from field inspection databases were collected to establish an annotated data set of insulator images. With the aid of the Mask R-convolutional neural network (CNN), it was possible to extract multiple insulators automatically in the infrared images. Transfer learning, as well as the dynamic learning rate algorithm, were then employed to realize the training process of Mask R-CNN with the annotated image data set. The result of the testing experiment showed that the mean Average Precision (mAP) of the model is 0.77, and the frame per second (FPS) is 5.07, which indicated great identification accuracy and computing speed of the proposed model. Next, function fitting was realized to extract the temperature distribution of each insulator. Finally, to evaluate the condition of each insulator, rules, which are based on the related standards, were established using machine language. This is the first time that the machine could independently realize fault analysis of multiple insulators in the infrared images, which is a great attempt to adapt the development of the Internet of Things and the tendency of predictive maintenance. Moreover, because of the universality of the model algorithm used, automatic infrared fault diagnosis for other power equipment could also be performed in a similar manner, which has significant potential applicability in the area of power equipment diagnosis.

[1]  Yan Huang,et al.  Mapping Vegetation-Covered Urban Surfaces Using Seeded Region Growing in Visible-NIR Air Photos , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Haihong Hu,et al.  Instance Segmentation of Auroral Images for Automatic Computation of Arc Width , 2019, IEEE Geoscience and Remote Sensing Letters.

[3]  Ming Dong,et al.  Joint Visualization Diagnosis of Outdoor Insulation Status With Optical and Acoustical Detections , 2019, IEEE Transactions on Power Delivery.

[4]  Eckehard G. Steinbach,et al.  A Novel Rate Control Framework for SIFT/SURF Feature Preservation in H.264/AVC Video Compression , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[6]  Song Han,et al.  Industrial Internet of Things: Challenges, Opportunities, and Directions , 2018, IEEE Transactions on Industrial Informatics.

[7]  H. Griffiths,et al.  Infrared analysis of dry-band flashover of silicone rubber insulators , 2016, IEEE Transactions on Dielectrics and Electrical Insulation.

[8]  Lihua Yang,et al.  Based on k-Means and Fuzzy k-Means Algorithm Classification of Precipitation , 2010, 2010 International Symposium on Computational Intelligence and Design.

[9]  Liying Yuan,et al.  Adaptive Image Edge Detection Algorithm Based on Canny Operator , 2015, 2015 4th International Conference on Advanced Information Technology and Sensor Application (AITS).

[10]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[11]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Ruben Usamentiaga,et al.  Temperature Monitoring for Electrical Substations Using Infrared Thermography: Architecture for Industrial Internet of Things , 2018, IEEE Transactions on Industrial Informatics.

[13]  Rene de Jesus Romero-Troncoso,et al.  Recent Industrial Applications of Infrared Thermography: A Review , 2019, IEEE Transactions on Industrial Informatics.

[14]  Carlos Guindel,et al.  Fast Joint Object Detection and Viewpoint Estimation for Traffic Scene Understanding , 2018, IEEE Intelligent Transportation Systems Magazine.

[15]  Jin Zhao,et al.  Superpixel-Based Multiple Local CNN for Panchromatic and Multispectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Changick Kim,et al.  Ramp Distribution-Based Image Enhancement Techniques for Infrared Images , 2018, IEEE Signal Processing Letters.

[17]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Kai Gao,et al.  Condition Evaluation of the Contaminated Insulators by Visible Light Images Assisted With Infrared Information , 2018, IEEE Transactions on Instrumentation and Measurement.

[19]  Sheng Liu,et al.  Towards Clinical Diagnosis: Automated Stroke Lesion Segmentation on Multi-Spectral MR Image Using Convolutional Neural Network , 2018, IEEE Access.

[20]  Duan-Yu Chen,et al.  A Novel HVDC Double-Terminal Non-Synchronous Fault Location Method Based on Convolutional Neural Network , 2019, IEEE Transactions on Power Delivery.

[21]  Yugyung Lee,et al.  Utilizing Mask R-CNN for Detection and Segmentation of Oral Diseases , 2018, 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[22]  Song Wang,et al.  Broken Corn Detection Based on an Adjusted YOLO With Focal Loss , 2019, IEEE Access.

[23]  Martin D. Judd,et al.  A Convolutional Neural Network-Based Deep Learning Methodology for Recognition of Partial Discharge Patterns from High-Voltage Cables , 2019, IEEE Transactions on Power Delivery.

[24]  C. Pintavirooj,et al.  A comparative study of 3 deep learning models for Pap smear screening , 2018, 2018 11th Biomedical Engineering International Conference (BMEiCON).

[25]  Xi-Lin Li,et al.  Preconditioned Stochastic Gradient Descent , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[26]  De Xu,et al.  Face Detection With Different Scales Based on Faster R-CNN , 2019, IEEE Transactions on Cybernetics.

[27]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Diansheng Luo,et al.  Insulator Infrared Image Denoising Method Based on Wavelet Generic Gaussian Distribution and MAP Estimation , 2017, IEEE Transactions on Industry Applications.

[29]  Yincheng Qi,et al.  Representation of binary feature pooling for detection of insulator strings in infrared images , 2016, IEEE Transactions on Dielectrics and Electrical Insulation.

[30]  Caner Özdemii̇r Wiley Series in Microwave and Optical Engineering , 2012 .

[31]  E da Costa Bortoni,et al.  Extracting Load Current Influence From Infrared Thermal Inspections , 2011, IEEE Transactions on Power Delivery.

[32]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.