Video Based Surround Vehicle Detection, Classification and Logging from Moving Platforms: Issues and Approaches

This paper discusses the issues and approaches involved in developing a mobile vehicle-mounted system to detect, classify, and log the surrounding vehicles in a database for efficient query-based retrieval. This system consists of three components: (1) vehicle sensing, detection, and tracking (2) feature extraction and classification (3) database storage and retrieval. Relevant research in each of these components is described in order to guide the development of such a system. Such a system has applications including traffic analysis from mobile probes, analyzing driver behavior based on surrounding vehicles, as well as surveillance from mobile platform.

[1]  Özgür Ulusoy,et al.  A histogram-based approach for object-based query-by-shape-and-color in image and video databases , 2005, Image Vis. Comput..

[2]  Mark W. Koch,et al.  A Sequential Vehicle Classifier for Infrared Video using Multinomial Pattern Matching , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[3]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[5]  Osama Masoud,et al.  Detection and classification of vehicles , 2002, IEEE Trans. Intell. Transp. Syst..

[6]  Vittorio Castelli,et al.  Image Databases: Search and Retrieval of Digital Imagery , 2002 .

[7]  Tarak Gandhi,et al.  Panoramic Appearance Map (PAM) for Multi-camera Based Person Re-identification , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[8]  Chung-Lin Huang,et al.  A vision-based vehicle identification system , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[9]  Mohan M. Trivedi,et al.  Improved Vehicle Classification in Long Traffic Video by Cooperating Tracker and Classifier Modules , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[10]  W. Eric L. Grimson,et al.  Edge-based rich representation for vehicle classification , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[11]  Tarak Gandhi,et al.  Parametric ego-motion estimation for vehicle surround analysis using an omnidirectional camera , 2005, Machine Vision and Applications.

[12]  Tarak Gandhi,et al.  Vehicle Surround Capture: Survey of Techniques and a Novel Omni-Video-Based Approach for Dynamic Panoramic Surround Maps , 2006, IEEE Transactions on Intelligent Transportation Systems.

[13]  Maurice Milgram,et al.  An Oriented-Contour Point Based Voting Algorithm for Vehicle Type Classification , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[14]  T. Rabie,et al.  Active-Vision-based Traffic Surveillance and Control , 2001 .