Detecting Suspicious Behavior on Surveillance Videos: Dealing with Visual Behavior Similarity between Bystanders and Offenders

Suspicious behavior is likely to threaten security, assets, life, or freedom. This behavior has no particular pattern, which complicates the tasks to detect it and define it. Even for human observers, it is complex to spot suspicious behavior in surveillance videos. Some proposals to tackle abnormal and suspicious behavior-related problems are available in the literature. However, they usually suffer from high false-positive rates due to different classes with high visual similarity. The PreCrime Behavior method removes information related to a crime commission to focus on suspicious behavior before the crime happens. The resulting samples from different types of crime have a high-visual similarity with normal-behavior samples. To address this problem, we implemented 3D Convolutional Neural Networks and trained them under different approaches. Also, we tested different values in the number-of-filter parameter to optimize computational resources. Finally, the comparison between the performance using different training approaches shows the best option to improve the suspicious behavior detection on surveillance videos.

[1]  Kazunori Sato,et al.  An Age Estimation Method Using 3D-CNN From Brain MRI Images , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[2]  Guillermo A. Mart'inez-Mascorro,et al.  Suspicious Behavior Detection on Shoplifting Cases for Crime Prevention by Using 3D Convolutional Neural Networks , 2020, ArXiv.

[3]  Robert A. Bridges,et al.  Situ: Identifying and Explaining Suspicious Behavior in Networks , 2019, IEEE Transactions on Visualization and Computer Graphics.

[4]  Rama Chellappa,et al.  Activity recognition using the dynamics of the configuration of interacting objects , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[5]  Chunyan Miao,et al.  3D CNN Based Automatic Diagnosis of Attention Deficit Hyperactivity Disorder Using Functional and Structural MRI , 2017, IEEE Access.

[6]  Aggelos K. Katsaggelos,et al.  Anomalous video event detection using spatiotemporal context , 2011 .

[7]  Kuldeep Singh,et al.  Convolutional neural networks for crowd behaviour analysis: a survey , 2019, The Visual Computer.

[8]  Juan Song,et al.  Learning Spatiotemporal Features Using 3DCNN and Convolutional LSTM for Gesture Recognition , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[9]  H. Wells,et al.  Crime and CCTV in Australia: Understanding the Relationship , 2006 .

[10]  Tong Liu,et al.  A fast recognition algorithm for suspicious behavior in high definition videos , 2015, Multimedia Systems.

[11]  Neil C. Rowe Detecting Suspicious Behavior From Only Positional Data With Distributed Sensor Networks , 2005 .

[12]  Liang Zhang,et al.  A weakly supervised framework for abnormal behavior detection and localization in crowded scenes , 2020, Neurocomputing.

[13]  Venu Govindaraju,et al.  Knowledge Transfer Using Neural Network Based Approach for Handwritten Text Recognition , 2018, 2018 13th IAPR International Workshop on Document Analysis Systems (DAS).

[14]  Xiao Mei Tang,et al.  Abnormal Motion Detection for Intelligent Video Surveillance , 2011 .

[15]  Xuan Wang,et al.  Pedestrian abnormal event detection based on multi-feature fusion in traffic video , 2018 .

[16]  Gregory R. Ganger,et al.  Storage-Based Intrusion Detection , 2010, TSEC.

[17]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Amarjot Singh,et al.  Autonomous UAV for Suspicious Action Detection using Pictorial Human Pose Estimation and Classification , 2014 .

[19]  Chih-Yang Lin,et al.  Dynamic Hand Gesture Recognition Using 3DCNN and LSTM with FSM Context-Aware Model , 2019, Sensors.

[20]  Goo-Rak Kwon,et al.  Alzheimer’s disease Classification from Brain MRI based on transfer learning from CNN , 2018, 2018 11th Biomedical Engineering International Conference (BMEiCON).

[21]  Mahmood Fathy,et al.  Video anomaly detection and localisation based on the sparsity and reconstruction error of auto-encoder , 2016 .

[22]  Mahmood Fathy,et al.  Deep-Cascade: Cascading 3D Deep Neural Networks for Fast Anomaly Detection and Localization in Crowded Scenes , 2017, IEEE Transactions on Image Processing.

[23]  Seong-Il Yang,et al.  An Ensemble Method of CNN Models for Object Detection , 2018, 2018 International Conference on Information and Communication Technology Convergence (ICTC).

[24]  David S. Doermann,et al.  IOD-CNN: Integrating object detection networks for event recognition , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[25]  Houqiang Li,et al.  Convolutional Neural Networks with Generalized Attentional Pooling for Action Recognition , 2018, 2018 IEEE Visual Communications and Image Processing (VCIP).

[26]  Wageeh Boles,et al.  A suspicious behaviour detection using a context space model for smart surveillance systems , 2012, Comput. Vis. Image Underst..

[27]  Tang Jun,et al.  Genetic Optimization of BP Neural Network in the Application of Suspicious Financial Transactions Pattern Recognition , 2012, 2012 International Conference on Management of e-Commerce and e-Government.

[28]  Li-min Xia,et al.  Recognition of suspicious behavior using case-based reasoning , 2015 .

[29]  Mubarak Shah,et al.  Real-World Anomaly Detection in Surveillance Videos , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[30]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[31]  Jing Zhang,et al.  Extracting Deep Video Feature for Mobile Video Classification with ELU-3DCNN , 2017, ICIMCS.

[32]  Peter Bull,et al.  Body movement and interpersonal communication , 1983 .