A framework for automated road-users classification using movement trajectories

New urban planning concepts are being redefined to emphasize active modes of transportation such as walking and cycling. In this environment, a disparate mix of road users shares the same road. In order to address road-safety and level of service requirements for the different types of road-users, traffic information needs to be collected with high degree accuracy. The reliability and accuracy of the data collected can significantly affect the quality of analysis. In recent years, automated video analysis was established as a robust tool for data collection. Road-user trajectories obtained through automated computer vision are rich in information. They hold features that reveal the structure of the traffic scene and provide clues to the movement characteristics of the road-users. The objective of this paper is to present and evaluate a road-user classification procedure. The classification relies on the motion pattern attributes associated with the trajectories of each road-user type, namely, vehicles, pedestrians and cyclists. A novel approach for features selection is proposed where singular spectrum analysis (SSA) identifies the basic harmonics (speed variation patterns) characterizing the movement behaviors. Constrained based classification and spectral clustering are then applied on the selected features to categorize the road-users. Several case studies are used for the evaluation of the proposed classification. The case studies use real world data sets collected at a roundabout and a conventional four-legged intersection in Greater Vancouver, British Columbia. Very promising results were demonstrated and evaluated through several performance measures. The main benefit of this research is to apply classification as a first step in the activity and behavior recognition of road-users in traffic scenes. The proposed approach is useful as a complement to vision based classification, where road-users classes can be difficult due to partial occlusion or when the extraction of physical characteristics (descriptive features) of road-users does not provide enough details to reveal the correct type of a road-user.

[1]  W. Eric L. Grimson,et al.  Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Tarek Sayed,et al.  A feature-based tracking algorithm for vehicles in intersections , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[3]  Dariu Gavrila,et al.  An Experimental Study on Pedestrian Classification , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Dariu Gavrila,et al.  Pedestrian Detection and Tracking Using a Mixture of View-Based Shape–Texture Models , 2008, IEEE Transactions on Intelligent Transportation Systems.

[5]  David Beymer,et al.  A real-time computer vision system for vehicle tracking and traffic surveillance , 1998 .

[6]  Linda B. Dixon Bicycle and Pedestrian Level-of-Service Performance Measures and Standards for Congestion Management Systems , 1996 .

[7]  Nina Golyandina,et al.  Automatic extraction and forecast of time series cyclic components within the framework of SSA , 2005 .

[8]  J. Pucher,et al.  Bicycling renaissance in North America? An update and re-appraisal of cycling trends and policies , 2011 .

[9]  Ze-Nian Li,et al.  A large margin framework for single camera offline tracking with hybrid cues , 2012, Comput. Vis. Image Underst..

[10]  Nicolas Saunier Pedestrian Stride Frequency and Length Estimation in Outdoor Urban Environments using Video Sensors , 2011 .

[11]  Sergio A. Velastin,et al.  Urban road user detection and classification using 3D wire frame models , 2010 .

[12]  Pietro Perona,et al.  Self-Tuning Spectral Clustering , 2004, NIPS.

[13]  Rama Chellappa,et al.  Finding Gait in Space and Time , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[14]  Julia Hirschberg,et al.  V-Measure: A Conditional Entropy-Based External Cluster Evaluation Measure , 2007, EMNLP.

[15]  Paul E. Rybski,et al.  Vision-based bicycle detection and tracking using a deformable part model and an EKF algorithm , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[16]  D. Hamad,et al.  Introduction to spectral clustering , 2008, 2008 3rd International Conference on Information and Communication Technologies: From Theory to Applications.

[17]  Paul E. Rybski,et al.  Vision-based bicyclist detection and tracking for intelligent vehicles , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[18]  Alan V. Oppenheim,et al.  Discrete-Time Signal Pro-cessing , 1989 .

[19]  Nikolaos Papanikolopoulos,et al.  Counting pedestrians and bicycles in traffic scenes , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[20]  G. Bebis,et al.  On-road vehicle detection using optical sensors: a review , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[21]  Shie Mannor,et al.  Activity and Gait Recognition with Time-Delay Embeddings , 2010, AAAI.

[22]  Arend L. Schwab,et al.  Rider motion identification during normal bicycling by means of principal component analysis , 2011 .

[23]  Mohan M. Trivedi,et al.  A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Osama Masoud,et al.  Detection and classification of vehicles , 2002, IEEE Trans. Intell. Transp. Syst..

[25]  Stefano Messelodi,et al.  Vision-based bicycle/motorcycle classification , 2007, Pattern Recognit. Lett..

[26]  Jun-Wei Hsieh,et al.  Automatic traffic surveillance system for vehicle tracking and classification , 2006, IEEE Transactions on Intelligent Transportation Systems.

[27]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[28]  Jianping Wu,et al.  A study on cyclist behavior at signalized intersections , 2004, IEEE Transactions on Intelligent Transportation Systems.

[29]  Tarak Gandhi,et al.  Pedestrian Protection Systems: Issues, Survey, and Challenges , 2007, IEEE Transactions on Intelligent Transportation Systems.

[30]  Robert Weibel,et al.  Revealing the physics of movement: Comparing the similarity of movement characteristics of different types of moving objects , 2009, Comput. Environ. Urban Syst..

[31]  Yang Wang,et al.  Human Action Recognition by Semilatent Topic Models , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Tarek Sayed,et al.  Automated Analysis of Pedestrian–Vehicle Conflicts , 2010 .

[33]  Sophie Midenet,et al.  Pedestrian crossing detection based on evidential fusion of video-sensors , 2009 .

[34]  SaunierNicolas,et al.  A methodology for precise camera calibration for data collection applications in urban traffic scenes , 2013 .

[35]  Mohan M. Trivedi,et al.  Learning trajectory patterns by clustering: Experimental studies and comparative evaluation , 2009, CVPR.

[36]  Tieniu Tan,et al.  Comparison of Similarity Measures for Trajectory Clustering in Outdoor Surveillance Scenes , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[37]  Alan C. Bovik,et al.  Indexes for Three-Class Classification Performance Assessment—An Empirical Comparison , 2009, IEEE Transactions on Information Technology in Biomedicine.

[38]  Catherine Morency,et al.  Estimation of Frequency and Length of Pedestrian Stride in Urban Environments with Video Sensors , 2011 .

[39]  Massimo Bertozzi,et al.  Artificial vision in road vehicles , 2002, Proc. IEEE.

[40]  W. von Seelen,et al.  Walking pedestrian recognition , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[41]  Dariu Gavrila,et al.  Monocular Pedestrian Detection: Survey and Experiments , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Tarek Sayed,et al.  Automated Detection of Spatial Traffic Violations through use of Video Sensors , 2011 .

[43]  Tarek Sayed,et al.  Pedestrian gait analysis using automated computer vision techniques , 2014 .

[44]  Dmitry B. Goldgof,et al.  Understanding Transit Scenes: A Survey on Human Behavior-Recognition Algorithms , 2010, IEEE Transactions on Intelligent Transportation Systems.

[45]  Hideo Mori,et al.  A method for discriminating of pedestrian based on rhythm , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[46]  James Bailey,et al.  Information Theoretic Measures for Clusterings Comparison: Variants, Properties, Normalization and Correction for Chance , 2010, J. Mach. Learn. Res..

[47]  M. Meilă Comparing clusterings---an information based distance , 2007 .

[48]  Nikolaos Papanikolopoulos,et al.  Clustering of Vehicle Trajectories , 2010, IEEE Transactions on Intelligent Transportation Systems.