A multi-scale image and dynamic candidate region-based automatic detection of foreign targets intruding the railway perimeter

Abstract This paper focuses on image characteristics of railway monitoring scenes, and proposed a multi-scale image and dynamic candidate region-based automatic detection of foreign targets intruding the railway perimeter. The algorithm first constructs a multi-scale image set for each frame, then obtains a dynamic candidate region of the intrusion target according to the law of gray projection curve variation for the low-resolution image. The foreground image, containing the intrusion target, is obtained using the background differential method for the high-resolution image, then the intruding target is identified before fusion of the results from the two methods. Three railway surveillance videos are used to validate the algorithm comparing with other methods, currently used in the railway scene. Overall, the proposed algorithm guarantees high-accuracy real-time detection of intruding targets, while requiring little computational resources, which is able to achieve 89.3% Precision and 0.028 s/frame with CPU. This technology can reduce the workload of manual inspections, and improve the detection accuracy through the improvement of the model can also reduce the manual review work caused by false alarms.

[1]  Suvendu Rup,et al.  An improved scheme for multifeature-based foreground detection using challenging conditions , 2021, Digit. Signal Process..

[2]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[3]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Sukadev Meher,et al.  A new Wronskian change detection model based codebook background subtraction for visual surveillance applications , 2018, J. Vis. Commun. Image Represent..

[5]  Benjamin Höferlin,et al.  Evaluation of background subtraction techniques for video surveillance , 2011, CVPR 2011.

[6]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[7]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Ferdinand van der Heijden,et al.  Efficient adaptive density estimation per image pixel for the task of background subtraction , 2006, Pattern Recognit. Lett..

[9]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[10]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[11]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[12]  Joachim Weickert,et al.  Combining the Advantages of Local and Global Optic Flow Methods , 2002, DAGM-Symposium.

[13]  M. L. Dewal,et al.  Gaussian image pyramid based texture features for classification of microscopic images of hardwood species , 2015 .

[14]  Alan L. Jennings,et al.  Optical Flow Background Estimation for Real-time Pan/tilt Camera Object Tracking , 2014 .

[15]  Muhammad Haroon Yousaf,et al.  Efficient foreground object segmentation from video by Probability Weighted Moments , 2021 .

[16]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[17]  Lei Liu,et al.  The infrared moving object detection and security detection related algorithms based on W4 and frame difference , 2016 .