AED-Net: An Abnormal Event Detection Network

Abstract It has long been a challenging task to detect an anomaly in a crowded scene. In this paper, a self-supervised framework called the abnormal event detection network (AED-Net), which is composed of a principal component analysis network (PCAnet) and kernel principal component analysis (kPCA), is proposed to address this problem. Using surveillance video sequences of different scenes as raw data, the PCAnet is trained to extract high-level semantics of the crowd’s situation. Next, kPCA, a one-class classifier, is trained to identify anomalies within the scene. In contrast to some prevailing deep learning methods, this framework is completely self-supervised because it utilizes only video sequences of a normal situation. Experiments in global and local abnormal event detection are carried out on Monitoring Human Activity dataset from University of Minnesota (UMN dataset) and Anomaly Detection dataset from University of California, San Diego (UCSD dataset), and competitive results that yield a better equal error rate (EER) and area under curve (AUC) than other state-of-the-art methods are observed. Furthermore, by adding a local response normalization (LRN) layer, we propose an improvement to the original AED-Net. The results demonstrate that this proposed version performs better by promoting the framework’s generalization capacity.

[1]  Joachim Denzler,et al.  One-class classification with Gaussian processes , 2013, Pattern Recognit..

[2]  Gaurav Bhatnagar,et al.  Discrete fractional wavelet transform and its application to multiple encryption , 2013, Inf. Sci..

[3]  Pengtao Xie,et al.  Strategies and Principles of Distributed Machine Learning on Big Data , 2015, ArXiv.

[4]  Daksh Thapar,et al.  VGR-net: A view invariant gait recognition network , 2017, 2018 IEEE 4th International Conference on Identity, Security, and Behavior Analysis (ISBA).

[5]  Qi Wang,et al.  Online Anomaly Detection in Crowd Scenes via Structure Analysis , 2015, IEEE Transactions on Cybernetics.

[6]  Hichem Snoussi,et al.  Detection of Abnormal Visual Events via Global Optical Flow Orientation Histogram , 2014, IEEE Transactions on Information Forensics and Security.

[7]  Mubarak Shah,et al.  Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Ming Zhu,et al.  Abnormal event detection and localization in crowded scenes based on PCANet , 2016, Multimedia Tools and Applications.

[9]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[10]  Ramin Mehran,et al.  Abnormal crowd behavior detection using social force model , 2009, CVPR.

[11]  Hichem Snoussi,et al.  Internal Transfer Learning for Improving Performance in Human Action Recognition for Small Datasets , 2017, IEEE Access.

[12]  Jiri Matas,et al.  P-N learning: Bootstrapping binary classifiers by structural constraints , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Moncef Gabbouj,et al.  Sport Type Classification of Mobile Videos , 2014, IEEE Transactions on Multimedia.

[14]  Hugo Jiménez-Hernández,et al.  Detecting Abnormal Vehicular Dynamics at Intersections Based on an Unsupervised Learning Approach and a Stochastic Model , 2010, Sensors.

[15]  Rongrong Ji,et al.  Social Attribute-Aware Force Model: Exploiting Richness of Interaction for Abnormal Crowd Detection , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Cordelia Schmid,et al.  Finding Actors and Actions in Movies , 2013, 2013 IEEE International Conference on Computer Vision.

[17]  Christophe Rosenberger,et al.  Abnormal events detection based on spatio-temporal co-occurences , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Shehzad Khalid,et al.  Activity classification and anomaly detection using m-mediods based modelling of motion patterns , 2010, Pattern Recognit..

[19]  Fei-Fei Li,et al.  Online detection of unusual events in videos via dynamic sparse coding , 2011, CVPR 2011.

[20]  Yunhe Pan,et al.  Heading toward Artificial Intelligence 2.0 , 2016 .

[21]  Nuno Vasconcelos,et al.  Anomaly Detection and Localization in Crowded Scenes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[23]  Hichem Snoussi,et al.  A fast and robust convolutional neural network-based defect detection model in product quality control , 2017, The International Journal of Advanced Manufacturing Technology.

[24]  Stephen J. Maybank,et al.  Fusion of Multiple Tracking Algorithms for Robust People Tracking , 2002, ECCV.

[25]  Nuno Vasconcelos,et al.  Anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  Tianzhu Zhang,et al.  Learning semantic scene models by object classification and trajectory clustering , 2009, CVPR.

[27]  Heiko Hoffmann,et al.  Kernel PCA for novelty detection , 2007, Pattern Recognit..

[28]  Ellen M. Markman,et al.  Thinking in perspective: Critical essays in the study of thought processes. , 1979 .

[29]  Shoab A. Khan,et al.  Tracking and Abnormal Behavior Detection in Video Surveillance Using Optical Flow and Neural Networks , 2014, 2014 28th International Conference on Advanced Information Networking and Applications Workshops.

[30]  Sotirios Chatzis,et al.  Robust Visual Behavior Recognition , 2010, IEEE Signal Processing Magazine.

[31]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Ehud Rivlin,et al.  Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Hichem Snoussi,et al.  Abnormal event detection via covariance matrix for optical flow based feature , 2018, Multimedia Tools and Applications.

[34]  Xinge You,et al.  A Blind Watermarking Scheme Using New Nontensor Product Wavelet Filter Banks , 2010, IEEE Transactions on Image Processing.

[35]  Junsong Yuan,et al.  Sparse reconstruction cost for abnormal event detection , 2011, CVPR 2011.

[36]  Xiaogang Wang,et al.  A Comprehensive Study on Cross-View Gait Based Human Identification with Deep CNNs , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Qingshan Liu,et al.  Abnormal detection using interaction energy potentials , 2011, CVPR 2011.

[38]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[39]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[40]  Venkatesh Saligrama,et al.  Abnormality detection using low-level co-occurring events , 2011, Pattern Recognit. Lett..

[41]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[42]  Lei Zhang,et al.  Fast Compressive Tracking , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.