An intelligent vision recognition method based on deep learning for pointer meters

Nowadays, pointer instruments remain the main state monitoring devices in the power industry, because they have strong mechanical stability to resist electromagnetic interferences compared with digital instruments. Although the object detection algorithms based on deep learning have widely been used in the field of instrument detection, the meter recognition process still relies on threshold segmentation to recognize object points and on Hough transform to extract the meter pointer. An intelligent vision recognition method based on YOLOv5 and U2-Net network (YLU2-Net) is proposed to improve the accuracy and efficiency of meter recognition in a complex environment. Firstly, the pointer meter is located in the instrument images by using the YOLOv5 network as a region of interest (RoI). Then, the instrument RoI is processed by means of perspective transformation and image resizing. Thirdly, an improved U2-Net image segmentation method with the deep separable convolution and the focal loss function is devised to distinguish the pointers and scales from the background in the instrument RoI. Further, a dimension reduction reading method with the polar coordinate transformation is developed to calculate the meter reading accurately and efficiently. Finally, the ablation experiment is conducted to test the performance of each algorithm module in our method, and the competition experiment is completed to compare our method with other state-of-the-art ones. The experimental results verify the accuracy and efficiency of the YLU2-Net recognition method proposed.

[1]  Songyu Hu,et al.  A novel CNN ensemble framework for bearing surface defects classification based on transfer learning , 2022, Measurement Science and Technology.

[2]  Chao Sun,et al.  Adaptive ORB feature detection with a variable extraction radius in RoI for complex illumination scenes , 2022, Robotics Auton. Syst..

[3]  Jie Zhu,et al.  Intelligent reading recognition method of a pointer meter based on deep learning in a real environment , 2021, Measurement Science and Technology.

[4]  Huaisheng Qu,et al.  Automatic recognition system of pointer meters based on lightweight CNN and WSNs with on-sensor image processing , 2021 .

[5]  Martin Jägersand,et al.  U2-Net: Going Deeper with Nested U-Structure for Salient Object Detection , 2020, Pattern Recognit..

[6]  Peilin He,et al.  A robust approach to reading recognition of pointer meters based on improved mask-RCNN , 2020, Neurocomputing.

[7]  Hong-Yuan Mark Liao,et al.  YOLOv4: Optimal Speed and Accuracy of Object Detection , 2020, ArXiv.

[8]  Chao Sun,et al.  SVM-based image partitioning for vision recognition of AGV guide paths under complex illumination conditions , 2020, Robotics Comput. Integr. Manuf..

[9]  Jun Liu,et al.  A detection and recognition system of pointer meters in substations based on computer vision , 2020 .

[10]  Sun,et al.  Intelligent Path Recognition against Image Noises for Vision Guidance of Automated Guided Vehicles in a Complex Workspace , 2019, Applied Sciences.

[11]  Victor A. N. Barroso,et al.  Convolutional neural networks for automatic meter reading , 2019, J. Electronic Imaging.

[12]  Qi Jiang,et al.  A robust and high-precision automatic reading algorithm of pointer meters based on machine vision , 2018, Measurement Science and Technology.

[13]  Qingwen Wu,et al.  Research on Algorithm of Pointer Instrument Recognition and Reading Based on the Location of the Rotation Center of the Pointer , 2018, 2018 IEEE International Conference on Mechatronics and Automation (ICMA).

[14]  Shu Liu,et al.  Path Aggregation Network for Instance Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[16]  Serge J. Belongie,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Yong Zhao,et al.  A robust and automatic recognition system of analog instruments in power system by using computer vision , 2016 .

[19]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[20]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[23]  Changyin Sun,et al.  Robust Pose Estimation via Hybrid Point and Twin Line Reprojection for RGB-D Vision Navigation , 2022, IEEE Transactions on Instrumentation and Measurement.