A survey of vision-based vehicle detection and tracking techniques in ITS

There has been an ever-increasing interest in research on traffic detection and traffic scene understanding based on computer vision, driven by the increasing processor speed and the increasing deployment of cameras. This field is of increasing relevance for the intelligent transport system (ITS). Therefore, there seems to be a real need for an analytical review of recent developments in this domain. We present here is a comprehensive review of video processing techniques state of the art for vehicle detection and tracking and an outlook to future research directions.

[1]  Xue Chen,et al.  A vehicle detection approach based on multi-features fusion in the fisheye images , 2011, 2011 3rd International Conference on Computer Research and Development.

[2]  Jake Porway,et al.  A stochastic graph grammar for compositional object representation and recognition , 2009, Pattern Recognit..

[3]  Joseph L. Mundy,et al.  Predicting high resolution image edges with a generic, adaptive, 3-D vehicle model , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Ming Xie,et al.  Color modeling by spherical influence field in sensing driving environment , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[7]  Jun Zhao,et al.  Moving Object Detecting Using Gradient Information, Three-Frame-Differencing and Connectivity Testing , 2006, Australian Conference on Artificial Intelligence.

[8]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Narayan Srinivasa.  Vision-based vehicle detection and tracking method for forward collision warning in automobiles , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[10]  Mohan M. Trivedi,et al.  Robust classification and tracking of vehicles in traffic video streams , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[11]  Andreas Kuehnle,et al.  Symmetry-based recognition of vehicle rears , 1991, Pattern Recognit. Lett..

[12]  Larry S. Davis,et al.  A Robust Background Subtraction and Shadow Detection , 1999 .

[13]  C. Laurgeau,et al.  Vehicle detection combining gradient analysis and AdaBoost classification , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[14]  Sergio A. Velastin,et al.  A Review of Computer Vision Techniques for the Analysis of Urban Traffic , 2011, IEEE Transactions on Intelligent Transportation Systems.

[15]  Rita Cucchiara,et al.  Vehicle Detection under Day and Night Illumination , 1999, IIA/SOCO.

[16]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[17]  Osama Masoud,et al.  Detection and classification of vehicles , 2002, IEEE Trans. Intell. Transp. Syst..

[18]  Chris J. Harris,et al.  VEHICLE DETECTION AND RECOGNITION IN GREYSCALE IMAGERY , 1995 .

[19]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[20]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[21]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Thomas Mauthner,et al.  Robust tracking of spatial related components , 2008, 2008 19th International Conference on Pattern Recognition.

[23]  Fei-Yue Wang,et al.  Data-Driven Intelligent Transportation Systems: A Survey , 2011, IEEE Transactions on Intelligent Transportation Systems.

[24]  Don R. Hush,et al.  Change detection for target detection and classification in video sequences , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[25]  Steven S. Beauchemin,et al.  The computation of optical flow , 1995, CSUR.

[26]  Christian Goerick,et al.  Artificial neural networks in real-time car detection and tracking applications , 1996, Pattern Recognit. Lett..

[27]  Giovanni Marola,et al.  Using symmetry for detecting and locating objects in a picture , 1989, Comput. Vis. Graph. Image Process..

[28]  Massimo Bertozzi,et al.  A real-time oriented system for vehicle detection , 1997, J. Syst. Archit..

[29]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[30]  Kiseo Park,et al.  Video-based detection of street-parking violation , 2007, IPCV.

[31]  Hideo Mori,et al.  Shadow and rhythm as sign patterns of obstacle detection , 1993, ISIE '93 - Budapest: IEEE International Symposium on Industrial Electronics Conference Proceedings.

[32]  Mark E Hallenbeck,et al.  Extracting Roadway Background Image , 2006 .

[33]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[34]  Cordelia Schmid,et al.  Viewpoint-independent object class detection using 3D Feature Maps , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Visvanathan Ramesh,et al.  A system for traffic sign detection, tracking, and recognition using color, shape, and motion information , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[36]  Thomas Kalinke,et al.  A Texture-based Object Detection and an adaptive Model-based Classification , 1998 .

[37]  Paul W. Fieguth,et al.  Color-based tracking of heads and other mobile objects at video frame rates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  E.E. Hilbert,et al.  A sensor for control of arterials and networks , 1980, IEEE Transactions on Vehicular Technology.

[39]  Robert Mandelbaum,et al.  Real-time stereo processing, obstacle detection, and terrain estimation from vehicle-mounted stereo cameras , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[40]  Kuo-Chin Fan,et al.  Vehicle Detection Using Normalized Color and Edge Map , 2007, IEEE Transactions on Image Processing.

[41]  Derek Hoiem,et al.  3D LayoutCRF for Multi-View Object Class Recognition and Segmentation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Shahriar Negahdaripour,et al.  Revised Definition of Optical Flow: Integration of Radiometric and Geometric Cues for Dynamic Scene Analysis , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  A. Bozzoli,et al.  A tunable algorithm to update a reference image , 2000, Signal Process. Image Commun..

[44]  Mansour Jamzad,et al.  Real time classification and tracking of multiple vehicles in highways , 2005, Pattern Recognit. Lett..

[45]  Thierry Chateau,et al.  MCMC Particle Filter for Real-Time Visual Tracking of Vehicles , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[46]  S. Yuta,et al.  Obstacle Detection By Vision System For An Autonomous Vehicle , 1993, Proceedings of the Intelligent Vehicles '93 Symposium.

[47]  Kazuhiko Sumi,et al.  A robust background subtraction method for changing background , 2000, Proceedings Fifth IEEE Workshop on Applications of Computer Vision.

[48]  Jamie Shotton,et al.  The Layout Consistent Random Field for Recognizing and Segmenting Partially Occluded Objects , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[49]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[50]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[51]  W. Eric L. Grimson,et al.  Learning coupled conditional random field for image decomposition with application on object categorization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[52]  P. Kumar,et al.  Bayesian network based computer vision algorithm for traffic monitoring using video , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[53]  Stefano Messelodi,et al.  A computer vision system for the detection and classification of vehicles at urban road intersections , 2005, Pattern Analysis and Applications.

[54]  Arcot Sowmya,et al.  Vehicle detection and tracking with low-angle cameras , 2010, 2010 IEEE International Conference on Image Processing.

[55]  Jun Zhang,et al.  A Robust Technique for Background Subtraction in Traffic Video , 2009, ICONIP.

[56]  Thomas Kalinke,et al.  Scene analysis and organization of behavior in driver assistance systems , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).