Vehicle detection and tracking at intersections by fusing multiple camera views

Intersections are challenging locations for drivers. Complex situations are common due to the variety of road users and intersection layouts. This contribution describes a real time method for detecting and tracking vehicles at intersections using images captured by a static camera network. After background subtraction, the foreground segments are projected on a common fusion map. Using this fusion map, the pose, width, and height of the vehicles can be determined. After that, the detected objects are tracked by a Gaussian-Mixture approximation of the Probability Hypothesis Density filter. Results of the intersection perception can further be communicated to equipped vehicles by wireless communication.

[1]  Osama Masoud,et al.  Computer vision algorithms for intersection monitoring , 2003, IEEE Trans. Intell. Transp. Syst..

[2]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[3]  Tarek Sayed,et al.  A feature-based tracking algorithm for vehicles in intersections , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[4]  Hans-Hellmut Nagel,et al.  Comparison of Edge-Driven Algorithms for Model-Based Motion Estimation , 2004, SCVMA.

[5]  Nikolaos Papanikolopoulos,et al.  Adaptive geometric templates for feature matching , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[6]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[7]  Nikolaos Papanikolopoulos,et al.  Multi-view 3D vehicle tracking with a constrained filter , 2008, 2008 IEEE International Conference on Robotics and Automation.

[8]  Stefano Messelodi,et al.  A computer vision system for the detection and classification of vehicles at urban road intersections , 2005, Pattern Analysis and Applications.

[9]  Sergio A. Velastin,et al.  Urban road user detection and classification using 3D wire frame models , 2010 .

[10]  Chandrika Kamath,et al.  Robust techniques for background subtraction in urban traffic video , 2004, IS&T/SPIE Electronic Imaging.

[11]  Ram Nevatia,et al.  Detection and Tracking of Moving Vehicles in Crowded Scenes , 2007, 2007 IEEE Workshop on Motion and Video Computing (WMVC'07).

[12]  George Yannis,et al.  Traffic Safety Basic Facts 2012 : Junctions , 2013 .

[13]  Björn Johansson,et al.  Combining shadow detection and simulation for estimation of vehicle size and position , 2009, Pattern Recognit. Lett..

[14]  Shrinivas J. Pundlik,et al.  Vehicle segmentation and tracking from a low-angle off-axis camera , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Joseph L. Mundy,et al.  Vehicle Surveillance with a Generic, Adaptive, 3D Vehicle Model , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Mubarak Shah,et al.  A Multiview Approach to Tracking People in Crowded Scenes Using a Planar Homography Constraint , 2006, ECCV.

[17]  Ronald P. S. Mahler,et al.  Statistical Multisource-Multitarget Information Fusion , 2007 .

[18]  Keiichi Uchimura,et al.  Vehicle Detection Using Probability Fusion Maps Generated by Multi-camera Systems , 2009, J. Inf. Process..

[19]  Ba-Ngu Vo,et al.  The Gaussian Mixture Probability Hypothesis Density Filter , 2006, IEEE Transactions on Signal Processing.

[20]  Jeremy S. Smith,et al.  Real-time detection via homography mapping of foreground polygons from multiple cameras , 2011, 2011 18th IEEE International Conference on Image Processing.

[21]  Klaus C. J. Dietmayer,et al.  Cooperative multi sensor network for traffic safety applications at intersections , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[22]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[23]  Sergio A. Velastin,et al.  A Review of Computer Vision Techniques for the Analysis of Urban Traffic , 2011, IEEE Transactions on Intelligent Transportation Systems.

[24]  Jitendra Malik,et al.  A real-time computer vision system for measuring traffic parameters , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.