Fractional Data Distillation Model for Anomaly Detection in Traffic Videos

Timely automatic detection of anomalies like road accidents forms the key to any intelligent traffic monitoring system. In this paper, we propose a novel Fractional Data Distillation model for segregating traffic anomaly videos from a test dataset, with a precise estimation of the start time of the anomalous event. The model follows a similar approach to that of the typical fractional distillation procedure, where the compounds are separated by varying the temperature. Our model fractionally extracts the anomalous events depending on their nature as the detection process progresses. Here, we employ two anomaly extractors namely Normal and Zoom, of which former works on the normal scale of video and the latter works on the magnified scale on the videos missed by the former, to separate the anomalies. The backbone of this segregation is scanning the background frames using the YOLOv3 detector for spotting possible anomalies. These anomaly candidates are further filtered and compared with detection on the foreground for matching detections to estimate the start time of the anomalous event. Experimental validation on track 4 of 2020 AI City Challenge shows an s4 score of 0.5438, with an F1 score of 0.7018.

[1]  Tieniu Tan,et al.  Similarity based vehicle trajectory clustering and anomaly detection , 2005, IEEE International Conference on Image Processing 2005.

[2]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[3]  Jenq-Neng Hwang,et al.  The 2019 AI City Challenge , 2019, CVPR Workshops.

[4]  Hichem Snoussi,et al.  Abnormal event detection based on analysis of movement information of video sequence , 2018 .

[5]  Linu Shine,et al.  A Comparative Study of Faster R-CNN Models for Anomaly Detection in 2019 AI City Challenge , 2019, CVPR Workshops.

[6]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[7]  Bin Wang,et al.  A Fast Self-Tuning Background Subtraction Algorithm , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[8]  Shenghua Gao,et al.  Future Frame Prediction for Anomaly Detection - A New Baseline , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  William Robson Schwartz,et al.  Histograms of Optical Flow Orientation and Magnitude and Entropy to Detect Anomalous Events in Videos , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Qinghua Huang,et al.  Traffic anomaly detection based on image descriptor in videos , 2015, Multimedia Tools and Applications.

[11]  Wei Wu,et al.  Traffic Anomaly Detection via Perspective Map based on Spatial-temporal Information Matrix , 2019, CVPR Workshops.

[12]  Z. Zivkovic Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[13]  Yong Haur Tay,et al.  Abnormal Event Detection in Videos using Spatiotemporal Autoencoder , 2017, ISNN.

[14]  Li Fei-Fei,et al.  ImageNet: Constructing a large-scale image database , 2010 .

[15]  Murari Mandal,et al.  Challenges in Time-Stamp Aware Anomaly Detection in Traffic Videos , 2019, CVPR Workshops.

[16]  Jenq-Neng Hwang,et al.  Anomaly Candidate Identification and Starting Time Estimation of Vehicles from Traffic Videos , 2019, CVPR Workshops.

[17]  Debi Prosad Dogra,et al.  Anomaly Detection in Road Traffic Using Visual Surveillance: A Survey , 2019, ArXiv.

[18]  Mubarak Shah,et al.  Real-World Anomaly Detection in Surveillance Videos , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.