Learning, Modeling, and Classification of Vehicle Track Patterns from Live Video

This paper presents two different types of visual activity analysis modules based on vehicle tracking. The highway monitoring module accurately classifies vehicles into eight different types and collects traffic flow statistics by leveraging tracking information. These statistics are continuously accumulated to maintain daily highway models that are used to categorize traffic flow in real time. The path modeling block is a more general analysis tool that learns the normal motions encountered in a scene in an unsupervised fashion. The spatiotemporal motion characteristics of these motion paths are encoded by a hidden Markov model. With the path definitions, abnormal trajectories are detected and future intent is predicted. These modules add realtime situational awareness to highway monitoring for high-level activity and behavior analysis.

[1]  Wei-bang Chen,et al.  A PCA-Based Vehicle Classification Framework , 2006, 22nd International Conference on Data Engineering Workshops (ICDEW'06).

[2]  Bo Hu,et al.  Robust Occlusion Handling in Object Tracking , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Mohan M. Trivedi,et al.  Improved Vehicle Classification in Long Traffic Video by Cooperating Tracker and Classifier Modules , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[4]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[5]  Pravin Varaiya,et al.  Causes and cures of highway congestion , 2001 .

[6]  Mohan M. Trivedi,et al.  Database-centered architecture for traffic incident detection, management, and analysis , 2000, ITSC2000. 2000 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.00TH8493).

[7]  Tieniu Tan,et al.  A system for learning statistical motion patterns , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[9]  Nelson H. C. Yung,et al.  Vehicle-type identification through automated virtual loop assignment and block-based direction biased motion estimation , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[10]  Yo-Sung Ho,et al.  Traffic parameter extraction using video-based vehicle tracking , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[11]  Kuntal Sengupta,et al.  Framework for real-time behavior interpretation from traffic video , 2005, IEEE Transactions on Intelligent Transportation Systems.

[12]  Mohan M. Trivedi,et al.  Distributed video networks for incident detection and management , 2000, ITSC2000. 2000 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.00TH8493).

[13]  Edward Y. Chang,et al.  Anatomy of a multicamera video surveillance system , 2004, Multim. Syst..

[14]  Michalis E. Zervakis,et al.  A survey of video processing techniques for traffic applications , 2003, Image Vis. Comput..

[15]  Alexandre Bernardino,et al.  Viewpoint Independent Detection of Vehicle Trajectories and Lane Geometry from Uncalibrated Traffic Surveillance Cameras , 2004, ICIAR.

[16]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Witold Pedrycz,et al.  Knowledge-based clustering - from data to information granules , 2007 .

[18]  Takeo Kanade,et al.  Type classification, color estimation, and specific target detection of moving targets on public streets , 2005, Machine Vision and Applications.

[19]  Andrew Hunter,et al.  Application of the self-organising map to trajectory classification , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[20]  Mohan M. Trivedi,et al.  Robust classification and tracking of vehicles in traffic video streams , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[21]  Stefano Messelodi,et al.  A computer vision system for the detection and classification of vehicles at urban road intersections , 2005, Pattern Analysis and Applications.

[22]  N. H. C. Yung,et al.  Vehicle-type identification through automated virtual loop assignment and block-based direction-biased motion estimation , 2000, IEEE Trans. Intell. Transp. Syst..

[23]  David C. Hogg,et al.  Learning the Distribution of Object Trajectories for Event Recognition , 1995, BMVC.

[24]  Osama Masoud,et al.  Detection and classification of vehicles , 2002, IEEE Trans. Intell. Transp. Syst..

[25]  Bo Yang,et al.  VISATRAM: a real-time vision system for automatic traffic monitoring , 2000, Image Vis. Comput..

[26]  Hironobu Fujiyoshi,et al.  Moving target classification and tracking from real-time video , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[27]  Tim J. Ellis,et al.  Learning semantic scene models from observing activity in visual surveillance , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[29]  Mohan M. Trivedi,et al.  Real-Time Video Based Highway Traffic Measurement and Performance Monitoring , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[30]  Xiaolu Liu,et al.  Development and evaluation of real-time video surveillance system on highway based on semantic hierarchy and decision surface , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[31]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[32]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Tieniu Tan,et al.  Learning activity patterns using fuzzy self-organizing neural network , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[35]  G. T. Kogut,et al.  Maintaining the identity of multiple vehicles as they travel through a video network , 2001, Proceedings 2001 IEEE Workshop on Multi-Object Tracking.