Short Circuit Recognition for Metal Electrorefining Using an Improved Faster R-CNN With Synthetic Infrared Images

This paper is concerned with the problem of short circuit detection in infrared image for metal electrorefining with an improved Faster Region-based Convolutional Neural Network (Faster R-CNN). To address the problem of insufficient label data, a framework for automatically generating labeled infrared images is proposed. After discussing factors that affect sample diversity, background, object shape, and gray scale distribution are established as three key variables for synthesis. Raw infrared images without fault are used as backgrounds. By simulating the other two key variables on the background, different classes of objects are synthesized. To improve the detection rate of small scale targets, an attention module is introduced in the network to fuse the semantic segment results of U-Net and the synthetic dataset. In this way, the Faster R-CNN can obtain rich representation ability about small scale object on the infrared images. Strategies of parameter tuning and transfer learning are also applied to improve the detection precision. The detection system trains on only synthetic dataset and tests on actual images. Extensive experiments on different infrared datasets demonstrate the effectiveness of the synthetic methods. The synthetically trained network obtains a mAP of 0.826, and the recall rate of small latent short circuit is superior to that of Faster R-CNN and U-Net, effectively avoiding short-circuit missed detection.

[1]  Yuan Yan Tang,et al.  A Local Contrast Method for Small Infrared Target Detection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Tsuhan Chen,et al.  A framework of extracting multi-scale features using multiple convolutional neural networks , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[3]  Dehui Kong,et al.  Infrared Dim and Small Target Detection Based on Stable Multisubspace Learning in Heterogeneous Scene , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Olaf Ronneberger,et al.  Invited Talk: U-Net Convolutional Networks for Biomedical Image Segmentation , 2017, Bildverarbeitung für die Medizin.

[5]  Steven C. H. Hoi,et al.  Face Detection using Deep Learning: An Improved Faster RCNN Approach , 2017, Neurocomputing.

[6]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Juha T. Tanttu,et al.  IR-based method for copper electrolysis short circuit detection , 1997, Defense, Security, and Sensing.

[8]  Dimitris N. Metaxas,et al.  StackGAN: Text to Photo-Realistic Image Synthesis with Stacked Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[9]  Enrico Magli,et al.  Robust license plate recognition using neural networks trained on synthetic images , 2019, Pattern Recognit..

[10]  Gholamreza Akbarizadeh,et al.  Change detection in SAR images using deep belief network: a new training approach based on morphological images , 2019, IET Image Process..

[11]  Daniel Cremers,et al.  What Makes Good Synthetic Training Data for Learning Disparity and Optical Flow Estimation? , 2018, International Journal of Computer Vision.

[12]  H. Redkey,et al.  A new approach. , 1967, Rehabilitation record.

[13]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[14]  Donald P. Greenberg,et al.  A model of visual adaptation for realistic image synthesis , 1996, SIGGRAPH.

[15]  Vijayan K. Asari,et al.  A new approach for nonlinear distortion correction in endoscopic images based on least squares estimation , 1999, IEEE Transactions on Medical Imaging.

[16]  Qiang Mao,et al.  A Fault Diagnosis Method of Insulator String Based on Infrared Image Feature Extraction and Probabilistic Neural Network , 2017, 2017 10th International Conference on Intelligent Computation Technology and Automation (ICICTA).

[17]  Michael Burke,et al.  DepthwiseGANs: Fast Training Generative Adversarial Networks for Realistic Image Synthesis , 2019, 2019 Southern African Universities Power Engineering Conference/Robotics and Mechatronics/Pattern Recognition Association of South Africa (SAUPEC/RobMech/PRASA).

[18]  Qingling Wang,et al.  A new processing method of infrared temperature images in copper electrolysis , 2017, IECON 2017 - 43rd Annual Conference of the IEEE Industrial Electronics Society.

[19]  Kang Ryoung Park,et al.  Pedestrian detection based on faster R-CNN in nighttime by fusing deep convolutional features of successive images , 2018, Expert Syst. Appl..

[20]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[21]  Heba Saadeh,et al.  Flower classification using deep convolutional neural networks , 2018, IET Comput. Vis..

[22]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[23]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Hao Zhou,et al.  Faster R-CNN for marine organisms detection and recognition using data augmentation , 2019, Neurocomputing.

[25]  Sungho Kim,et al.  Scale invariant small target detection by optimizing signal-to-clutter ratio in heterogeneous background for infrared search and track , 2012, Pattern Recognit..

[26]  Jonathon Shlens,et al.  Conditional Image Synthesis with Auxiliary Classifier GANs , 2016, ICML.

[27]  Zhisheng Wang,et al.  Fusion of infrared and visible images with Gaussian smoothness and joint bilateral filtering iteration decomposition , 2019, IET Comput. Vis..

[28]  Christopher Ré,et al.  Learning to Compose Domain-Specific Transformations for Data Augmentation , 2017, NIPS.

[29]  Yang Li,et al.  Ship detection in spaceborne infrared images based on Convolutional Neural Networks and synthetic targets , 2019, Infrared Physics & Technology.

[30]  R.P. Burgos,et al.  Short-Circuit Detection for Electrolytic Processes Employing Optibar Intercell Bars , 2009, IEEE Transactions on Industry Applications.

[31]  Bruno Brandoli Machado,et al.  Estimating soybean leaf defoliation using convolutional neural networks and synthetic images , 2019, Comput. Electron. Agric..

[32]  Yingjun Zhang,et al.  Extracting features from infrared images using convolutional neural networks and transfer learning , 2020 .

[33]  Lei Xiong,et al.  Dim infrared image enhancement based on convolutional neural network , 2018, Neurocomputing.

[34]  Baochang Zhang,et al.  Enhanced Bird Detection from Low-Resolution Aerial Image Using Deep Neural Networks , 2018, Neural Processing Letters.

[35]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.