Automated classification based on video data at intersections with heavy pedestrian and bicycle traffic: Methodology and application

Pedestrians and cyclists are amongst the most vulnerable road users. Pedestrian and cyclist collisions involving motor-vehicles result in high injury and fatality rates for these two modes. Data for pedestrian and cyclist activity at intersections such as volumes, speeds, and space–time trajectories are essential in the field of transportation in general, and road safety in particular. However, automated data collection for these two road user types remains a challenge. Due to the constant change of orientation and appearance of pedestrians and cyclists, detecting and tracking them using video sensors is a difficult task. This is perhaps one of the main reasons why automated data collection methods are more advanced for motorized traffic. This paper presents a method based on Histogram of Oriented Gradients to extract features of an image box containing the tracked object and Support Vector Machine to classify moving objects in crowded traffic scenes. Moving objects are classified into three categories: pedestrians, cyclists, and motor vehicles. The proposed methodology is composed of three steps: (i) detecting and tracking each moving object in video data, (ii) classifying each object according to its appearance in each frame, and (iii) computing the probability of belonging to each class based on both object appearance and speed. For the last step, Bayes’ rule is used to fuse appearance and speed in order to predict the object class. Using video datasets collected in different intersections, the methodology was built and tested. The developed methodology achieved an overall classification accuracy of greater than 88%. However, the classification accuracy varies across modes and is highest for vehicles and lower for pedestrians and cyclists. The applicability of the proposed methodology is illustrated using a simple case study to analyze cyclist–vehicle conflicts at intersections with and without bicycle facilities.

[1]  Mohan M. Trivedi,et al.  Learning, Modeling, and Classification of Vehicle Track Patterns from Live Video , 2008, IEEE Transactions on Intelligent Transportation Systems.

[2]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[3]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[4]  Jun-Wei Hsieh,et al.  Automatic traffic surveillance system for vehicle tracking and classification , 2006, IEEE Transactions on Intelligent Transportation Systems.

[5]  Tarek Sayed,et al.  A feature-based tracking algorithm for vehicles in intersections , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[6]  Biswajit Bose,et al.  Classifying Tracked Moving Objects in Outdoor Urban Scenes , 2005 .

[7]  David W. Aha,et al.  Instance-Based Learning Algorithms , 1991, Machine Learning.

[8]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Hironobu Fujiyoshi,et al.  Moving target classification and tracking from real-time video , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[10]  Tarek Sayed,et al.  Large-Scale Automated Analysis of Vehicle Interactions and Collisions , 2010 .

[11]  Nicolas Saunier,et al.  An Automated Surrogate Safety Analysis at Protected Highway Ramps Using Cross-Sectional and Before- , 2013 .

[12]  Dariu Gavrila,et al.  Multi-cue Pedestrian Detection and Tracking from a Moving Vehicle , 2007, International Journal of Computer Vision.

[13]  Nicolas Saunier,et al.  Motion Prediction Methods for Surrogate Safety Analysis , 2013 .

[14]  Halbert White,et al.  Learning in Artificial Neural Networks: A Statistical Perspective , 1989, Neural Computation.

[15]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Vassilios Morellas,et al.  Classification and Counting of Composite Objects in Traffic Scenes Using Global and Local Image Analysis , 2013, IEEE Transactions on Intelligent Transportation Systems.

[17]  Michel Bierlaire,et al.  Behavioral Priors for Detection and Tracking of Pedestrians in Video Sequences , 2006, International Journal of Computer Vision.

[18]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[19]  Tarek Sayed,et al.  A framework for automated road-users classification using movement trajectories , 2013 .

[20]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[21]  Tieniu Tan,et al.  Real-Time Moving Object Classification with Automatic Scene Division , 2007, 2007 IEEE International Conference on Image Processing.

[22]  Robert Tibshirani,et al.  Discriminant Adaptive Nearest Neighbor Classification , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Takeo Kanade,et al.  Type classification, color estimation, and specific target detection of moving targets on public streets , 2005, Machine Vision and Applications.

[24]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Stanley T. Birchfield,et al.  Real-Time Incremental Segmentation and Tracking of Vehicles at Low Camera Angles Using Stable Features , 2008, IEEE Transactions on Intelligent Transportation Systems.

[26]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[27]  Z. M. Hefed.  Object tracking , 1999 .

[28]  Stefano Messelodi,et al.  A computer vision system for the detection and classification of vehicles at urban road intersections , 2005, Pattern Analysis and Applications.

[29]  Tarek Sayed,et al.  Automated Analysis of Pedestrian–Vehicle Conflicts Using Video Data , 2009 .

[30]  P S Parsonson,et al.  TRAFFIC DETECTOR HANDBOOK , 1985 .

[31]  Larry Head,et al.  Surrogate Safety Measures from Traffic Simulation Models , 2003 .

[32]  Tarek Sayed,et al.  Automated Analysis of Pedestrian–Vehicle Conflicts , 2010 .

[33]  David A. Forsyth,et al.  Computational Studies of Human Motion: Part 1, Tracking and Motion Synthesis , 2005, Found. Trends Comput. Graph. Vis..

[34]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Larry S. Davis,et al.  Vehicle Detection Using Partial Least Squares , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  L. Miranda-Moreno,et al.  Cyclist activity and injury risk analysis at signalized intersections: a Bayesian modelling approach. , 2013, Accident; analysis and prevention.

[37]  Pedro M. Domingos,et al.  On the Optimality of the Simple Bayesian Classifier under Zero-One Loss , 1997, Machine Learning.

[38]  Catherine Morency,et al.  Estimation of Frequency and Length of Pedestrian Stride in Urban Environments with Video Sensors , 2011 .

[39]  Luis F. Miranda-Moreno,et al.  Disaggregate Exposure Measures and Injury Frequency Models of Cyclist Safety at Signalized Intersections , 2011 .

[40]  Nir Friedman,et al.  Bayesian Network Classifiers , 1997, Machine Learning.

[41]  Vincent Lepetit,et al.  DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.