Classifying Road Users in Urban Scenes Using Movement Patterns

This paper describes an automated classification approach to road users. The main motivation behind road-user classification in the context of safety stems from the necessity to learn traffic scenarios and understand patterns within each road-user class. The end goal in the analysis is to identify and learn scenarios that may contribute to hazards in traffic conditions. The classification relies on video data (movement trajectories) collected in urban intersections. The approach is based on the discrimination of the shapes of the speed profiles of each road-user type, more precisely, the discrimination between the speed movement patterns of vehicles and the ambulatory characteristics of pedestrians. The collected movement-trajectory data are represented as time series. The classification is performed using singular value decomposition and reconstruction of the time series. Two complementary methods are proposed based on the quality evaluation (correlation score) of the reconstructed trajectories. In the first method, a threshold-based decision procedure is applied. This approach is complemented in the second method by a semisupervised classification procedure guided by movement prototypes. The approach is validated on real-world data collected in Oakland, California. A correct classification of around 90% was achieved using both methods.

[1]  Ze-Nian Li,et al.  A large margin framework for single camera offline tracking with hybrid cues , 2012, Comput. Vis. Image Underst..

[2]  Catherine Morency,et al.  Estimation of Frequency and Length of Pedestrian Stride in Urban Environments with Video Sensors , 2011 .

[3]  Nicolas Saunier Pedestrian Stride Frequency and Length Estimation in Outdoor Urban Environments using Video Sensors , 2011 .

[4]  Hideo Mori,et al.  A method for discriminating of pedestrian based on rhythm , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[5]  Karim Aldin Ismail,et al.  Application of computer vision techniques for automated road safety analysis and traffic data collection , 2010 .

[6]  Tarek Sayed,et al.  A feature-based tracking algorithm for vehicles in intersections , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[7]  Thomas Kalinke,et al.  Walking pedestrian recognition , 2000, IEEE Trans. Intell. Transp. Syst..

[8]  Mohan M. Trivedi,et al.  A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Yang Wang,et al.  Human Action Recognition by Semilatent Topic Models , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Tarak Gandhi,et al.  Pedestrian collision avoidance systems: a survey of computer vision based recent studies , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[11]  Tarek Sayed,et al.  Automated Detection of Spatial Traffic Violations through use of Video Sensors , 2011 .

[12]  Dariu Gavrila,et al.  Monocular Pedestrian Detection: Survey and Experiments , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Dariu Gavrila,et al.  An Experimental Study on Pedestrian Classification , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Dariu Gavrila,et al.  Pedestrian Detection and Tracking Using a Mixture of View-Based Shape–Texture Models , 2008, IEEE Transactions on Intelligent Transportation Systems.

[15]  Robert Weibel,et al.  Revealing the physics of movement: Comparing the similarity of movement characteristics of different types of moving objects , 2009, Comput. Environ. Urban Syst..

[16]  Gene H. Golub,et al.  Matrix computations , 1983 .

[17]  Christoph Schlieder,et al.  Interpretation of Intentional Behavior in Spatial Partonomies , 2003, Spatial Cognition.

[18]  Mohan M. Trivedi,et al.  Learning trajectory patterns by clustering: Experimental studies and comparative evaluation , 2009, CVPR.

[19]  Tieniu Tan,et al.  Comparison of Similarity Measures for Trajectory Clustering in Outdoor Surveillance Scenes , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[20]  Tarek Sayed,et al.  Automated Analysis of Pedestrian–Vehicle Conflicts , 2010 .

[21]  SaunierNicolas,et al.  A methodology for precise camera calibration for data collection applications in urban traffic scenes , 2013 .