Abnormal Behavior Detection of ATM Surveillance Videos Based on Pseudo-3D Residual Network

As a major source of social big data, surveillance videos of self-service banks have been an important part of social security. Automated video analysis is required since manual screening of these video streams is costly and slow. Among current automated video analysis methods, automated 3D convolution networks are effective on video analysis but consume exceptional time and memory overheads. In this paper, we propose to apply Pseudo-3D Residual network (P3D ResNet) to replace 3*3*3 convolution, which can reduce the amount of calculation. To improve the accuracy of P3D ResNet on our videos, we further preprocess the videos by extracting human pose information with ‘openpose’ tools. With the P3D ResNet model and ‘openpose’ preprocessing tools, we build an abnormal behavior detection prototype for self-service banks surveillance videos. Due to the help of the pose information, the accuracy of behavior classification of video from banks is improved by at least 7%, which cannot be disclosed to the public. To ensure the audience can repeat our experiments, we further evaluated our prototyping system with self-made videos emulating bank settings to show that the accuracy of our system is improved by 11%.