Dynamic scene modelling and anomaly detection based on trajectory analysis

A real-time scene modelling approach is presented that recognises temporary and permanent road structure change resulting from construction, accident or lane expansion and other obstructions. The system defined utilises a two-phase approach to modelling the scene. In the transitional phase, a dominant set-based graphical clustering approach is applied to understand the current scene structure from trajectory groupings, whereas the operational phase analyses the trajectories in real-time to detect anomalies such as u-turns, wrong-way or erratic drivers based on the acquired model of the scene structure and normal traffic patterns. In addition, the concept of dynamic traffic flow analysis is utilised to identify and remember temporary additions and removals of paths due to construction and accidents, as well as permanent road structure changes. An intuitive equal-arc-length sampling is applied to extract only the spatial information from the trajectory comparisons, since the spatial characteristics alone are sufficient for road structure understanding. A distance metric is developed to measure spatial difference and directional change of the path with entrance and exit awareness. Results for a publicly available dataset are provided, demonstrating that the method can efficiently model the scene, detect anomalies and capture both temporary and permanent scene reconstructions.

[1]  Soraia Raupp Musse,et al.  Event Detection Using Trajectory Clustering and 4-D Histograms , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Marcello Pelillo,et al.  Dominant Sets and Pairwise Clustering , 2007 .

[3]  Imran N. Junejo,et al.  Multi feature path modeling for video surveillance , 2004, ICPR 2004.

[4]  Jörgen W. Weibull,et al.  Evolutionary Game Theory , 1996 .

[5]  John Soldera,et al.  Detection of Unusual Motion Using Computer Vision , 2006, 2006 19th Brazilian Symposium on Computer Graphics and Image Processing.

[6]  Mohan M. Trivedi,et al.  A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Z. Papp,et al.  Traffic control and intelligent vehicle highway systems: a survey , 2011 .

[8]  Zu Whan Kim,et al.  High-quality vehicle trajectory generation from video data based on vehicle detection and description , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[9]  H Jianming,et al.  Traffic congestion identification based on image processing , 2012 .

[10]  Wei Hu,et al.  A Coarse-to-Fine Strategy for Vehicle Motion Trajectory Clustering , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[11]  Tieniu Tan,et al.  Comparison of Similarity Measures for Trajectory Clustering in Outdoor Surveillance Scenes , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[12]  Gian Luca Foresti,et al.  On-line trajectory clustering for anomalous events detection , 2006, Pattern Recognit. Lett..

[13]  Shuicheng Yan,et al.  Detecting Anomaly in Videos from Trajectory Similarity Analysis , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[14]  Gian Luca Foresti,et al.  Trajectory-Based Anomalous Event Detection , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Tieniu Tan,et al.  Similarity based vehicle trajectory clustering and anomaly detection , 2005, IEEE International Conference on Image Processing 2005.

[16]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[17]  Pabitra Mitra,et al.  Dynamic Algorithm for Graph Clustering Using Minimum Cut Tree , 2006, Sixth IEEE International Conference on Data Mining - Workshops (ICDMW'06).

[18]  Tarek Sayed,et al.  Clustering Vehicle Trajectories with Hidden Markov Models Application to Automated Traffic Safety Analysis , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[19]  Liang Lin,et al.  Trajectory parsing by cluster sampling in spatio-temporal graph , 2009, CVPR.

[20]  Qi Tian,et al.  Trajectory-Based Ball Detection and Tracking in Broadcast Soccer Video , 2006, IEEE Transactions on Multimedia.

[21]  Jae-Gil Lee,et al.  Trajectory Outlier Detection: A Partition-and-Detect Framework , 2008, 2008 IEEE 24th International Conference on Data Engineering.

[22]  Hsu-Yung Cheng,et al.  Intelligent Highway Traffic Surveillance With Self-Diagnosis Abilities , 2011, IEEE Transactions on Intelligent Transportation Systems.

[23]  W. Eric L. Grimson,et al.  Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Andrea Cavallaro,et al.  Multifeature Object Trajectory Clustering for Video Analysis , 2008, IEEE Transactions on Circuits and Systems for Video Technology.