Traffic Behavior Recognition Using the Pachinko Allocation Model

CCTV-based behavior recognition systems have gained considerable attention in recent years in the transportation surveillance domain for identifying unusual patterns, such as traffic jams, accidents, dangerous driving and other abnormal behaviors. In this paper, a novel approach for traffic behavior modeling is presented for video-based road surveillance. The proposed system combines the pachinko allocation model (PAM) and support vector machine (SVM) for a hierarchical representation and identification of traffic behavior. A background subtraction technique using Gaussian mixture models (GMMs) and an object tracking mechanism based on Kalman filters are utilized to firstly construct the object trajectories. Then, the sparse features comprising the locations and directions of the moving objects are modeled by PAM into traffic topics, namely activities and behaviors. As a key innovation, PAM captures not only the correlation among the activities, but also among the behaviors based on the arbitrary directed acyclic graph (DAG). The SVM classifier is then utilized on top to train and recognize the traffic activity and behavior. The proposed model shows more flexibility and greater expressive power than the commonly-used latent Dirichlet allocation (LDA) approach, leading to a higher recognition accuracy in the behavior classification.

[1]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[2]  Yangsheng Xu,et al.  Abnormal Behavior Detection by Multi-SVM-Based Bayesian Network , 2007, 2007 International Conference on Information Acquisition.

[3]  Tao Xiang,et al.  Identifying Rare and Subtle Behaviors: A Weakly Supervised Joint Topic Model , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Tao Xiang,et al.  Delta-Dual Hierarchical Dirichlet Processes: A pragmatic abnormal behaviour detector , 2011, 2011 International Conference on Computer Vision.

[5]  R. Hariharan,et al.  Cluster based human action recognition using latent dirichlet allocation , 2013, 2013 International conference on Circuits, Controls and Communications (CCUBE).

[6]  Ramakant Nevatia,et al.  Event Detection and Analysis from Video Streams , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Satish V. Ukkusuri,et al.  Urban activity pattern classification using topic models from online geo-location data , 2014 .

[8]  Shaogang Gong,et al.  Incremental Activity Modeling in Multiple Disjoint Cameras , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Wei Li,et al.  Pachinko Allocation: Scalable Mixture Models of Topic Correlations , 2008 .

[10]  Lu Haixian,et al.  Star skeleton for human behavior recognition , 2012, 2012 International Conference on Audio, Language and Image Processing.

[11]  Dmitry B. Goldgof,et al.  Understanding Transit Scenes: A Survey on Human Behavior-Recognition Algorithms , 2010, IEEE Transactions on Intelligent Transportation Systems.

[12]  Klamer Schutte,et al.  A unified approach to the recognition of complex actions from sequences of zone-crossings , 2014, Image Vis. Comput..

[13]  Wei Li,et al.  Pachinko allocation: DAG-structured mixture models of topic correlations , 2006, ICML.

[14]  Meng Wang,et al.  Detecting Group Activities With Multi-Camera Context , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[16]  Svetha Venkatesh,et al.  Activity recognition and abnormality detection with the switching hidden semi-Markov model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Matthew Brand,et al.  Discovery and Segmentation of Activities in Video , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Davud Asemani,et al.  A robust adaptive algorithm of moving object detection for video surveillance , 2014, EURASIP J. Image Video Process..

[20]  Yang Gao,et al.  Video Behavior Analysis Using Topic Models and Rough Sets [Applications Notes] , 2013, IEEE Computational Intelligence Magazine.

[21]  Hichem Snoussi,et al.  Detection of Abnormal Events via Optical Flow Feature Analysis , 2015, Sensors.

[22]  Shaogang Gong,et al.  Video Behaviour Mining Using a Dynamic Topic Model , 2011, International Journal of Computer Vision.

[23]  Shaogang Gong,et al.  Video Behavior Profiling for Anomaly Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  K. Shadan,et al.  Available online: , 2012 .

[25]  Soo-Young Lee,et al.  Support Vector Machines with Binary Tree Architecture for Multi-Class Classification , 2004 .

[26]  Thuong Le-Tien,et al.  Using weighted dynamic range for histogram equalization to improve the image contrast , 2014, EURASIP J. Image Video Process..

[27]  Wageeh Boles,et al.  A suspicious behaviour detection using a context space model for smart surveillance systems , 2012, Comput. Vis. Image Underst..

[28]  Oliver Brdiczka,et al.  Detecting Human Behavior Models From Multimodal Observation in a Smart Home , 2009, IEEE Transactions on Automation Science and Engineering.

[29]  Mohsen Soryani,et al.  Body posture graph: a new graph-based posture descriptor for human behaviour recognition , 2013, IET Comput. Vis..

[30]  Alexandros André Chaaraoui,et al.  A review on vision techniques applied to Human Behaviour Analysis for Ambient-Assisted Living , 2012, Expert Syst. Appl..

[31]  Hao Wu,et al.  A method of abnormal habits recognition in intelligent space , 2014, Eng. Appl. Artif. Intell..

[32]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[33]  Kaiqi Huang,et al.  An Extended Grammar System for Learning and Recognizing Complex Visual Events , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Qixiang Ye,et al.  Abnormal Behavior Detection via Sparse Reconstruction Analysis of Trajectory , 2011, 2011 Sixth International Conference on Image and Graphics.

[35]  Xuejie Zhang,et al.  Video background subtracion using improved Adaptive-K Gaussian Mixture Model , 2010, 2010 3rd International Conference on Advanced Computer Theory and Engineering(ICACTE).

[36]  Deshi Li,et al.  Applying behavior recognition in road detection using vehicle sensor networks , 2012, 2012 International Conference on Computing, Networking and Communications (ICNC).

[37]  Shaogang Gong,et al.  Beyond Tracking: Modelling Activity and Understanding Behaviour , 2006, International Journal of Computer Vision.

[38]  Jordi Gonzàlez,et al.  View-invariant human-body detection with extension to human action recognition using component-wise HMM of body parts , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[39]  Shaogang Gong,et al.  Activity based surveillance video content modelling , 2008, Pattern Recognit..

[40]  W. Eric L. Grimson,et al.  Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.