Multipart Vehicle Detection Using Symmetry-Derived Analysis and Active Learning

On-road vehicle detection is a critical operation in automotive active safety systems such as collision avoidance, merge assist, lane change assistance, etc. In this paper, we present VeDAS-Vehicle Detection using Active learning and Symmetry. VeDAS is a multipart-based vehicle detection algorithm that employs Haar-like features and Adaboost classifiers for the detection of fully and partially visible rear views of vehicles. In order to train the classifiers, a modified active learning framework is proposed that selects positive and negative samples of multiple parts in an automated manner. Furthermore, the detected parts from the classifiers are associated by using a novel iterative window search algorithm and a symmetry-based regression model to extract fully visible vehicles. The proposed method is evaluated on seven different datasets that capture varying road, traffic, and weather conditions. Detailed evaluations show that the proposed method gives high true positive rates of over 95% and performs better than existing state-of-the-art rear-view-based vehicle detection methods. Additionally, VeDAS also detects partially visible rear views of vehicles using the residues left behind after detecting the fully visible vehicles. VeDAS is able to detect partial rear views with a detection rate of 87% on a new partially visible rear-view vehicle dataset that we release as part of this paper.

[1]  Akihiro Takeuchi,et al.  On-Road Multivehicle Tracking Using Deformable Object Model and Particle Filter With Improved Likelihood Estimation , 2012, IEEE Transactions on Intelligent Transportation Systems.

[2]  Li-Chen Fu,et al.  Vehicle detection and tracking under various lighting conditions using a particle filter , 2012 .

[3]  Jun-Wei Hsieh,et al.  Real-time dynamic vehicle detection on resource-limited mobile platform , 2012, 2012 International Conference on Machine Learning and Cybernetics.

[4]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Klaus C. J. Dietmayer,et al.  High-performance on-road vehicle detection in monocular images , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[6]  Peter V. Gehler,et al.  Occlusion Patterns for Object Class Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Jenn-Jier James Lien,et al.  Automatic Vehicle Detection Using Local Features—A Statistical Approach , 2008, IEEE Transactions on Intelligent Transportation Systems.

[8]  Dariu Gavrila,et al.  Monocular Pedestrian Detection: Survey and Experiments , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Sven J. Dickinson,et al.  3D Object Detection and Viewpoint Estimation with a Deformable 3D Cuboid Model , 2012, NIPS.

[10]  Luc Van Gool,et al.  Branch&Rank: Non-Linear Object Detection , 2011, BMVC.

[11]  Mohan M. Trivedi,et al.  Learning to Detect Vehicles by Clustering Appearance Patterns , 2015, IEEE Transactions on Intelligent Transportation Systems.

[12]  Jiri Matas,et al.  A system for real-time detection and tracking of vehicles from a single car-mounted camera , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[13]  Mahdi Rezaei,et al.  Vehicle Detection Based on Multi-feature Clues and Dempster-Shafer Fusion Theory , 2013, PSIVT.

[14]  Mignon Park,et al.  Vision-Based Vehicle Detection System With Consideration of the Detecting Location , 2012, IEEE Transactions on Intelligent Transportation Systems.

[15]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Zehang Sun,et al.  Monocular precrash vehicle detection: features and classifiers , 2006, IEEE Transactions on Image Processing.

[18]  Pietro Perona,et al.  Integral Channel Features , 2009, BMVC.

[19]  Mohan M. Trivedi,et al.  Vehicle Detection by Independent Parts for Urban Driver Assistance , 2013, IEEE Transactions on Intelligent Transportation Systems.

[20]  Mohan M. Trivedi,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS 1 Integrated Lane and Vehicle Detection, Localization, , 2022 .

[21]  Alberto Broggi Parallel and local feature extraction: a real-time approach to road boundary detection , 1995, IEEE Trans. Image Process..

[22]  Mohan M. Trivedi,et al.  Vision-Based Lane Analysis: Exploration of Issues and Approaches for Embedded Realization , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[23]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[24]  Dariu Gavrila,et al.  A mixed generative-discriminative framework for pedestrian classification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Mohan M. Trivedi,et al.  Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis , 2013, IEEE Transactions on Intelligent Transportation Systems.

[26]  Sanjoy Dasgupta,et al.  Analysis of a greedy active learning strategy , 2004, NIPS.

[27]  Mohan M. Trivedi,et al.  Efficient Lane and Vehicle Detection with Integrated Synergies (ELVIS) , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[28]  Dot Hs,et al.  Analyses of Rear-End Crashes and Near-Crashes in the 100-Car Naturalistic Driving Study to Support Rear-Signaling Countermeasure Development , 2007 .

[29]  Thomas Bräunl,et al.  Symmetry-based monocular vehicle detection system , 2011, Machine Vision and Applications.

[30]  A. Jazayeri,et al.  Vehicle Detection and Tracking in Car Video Based on Motion Model , 2011, IEEE Transactions on Intelligent Transportation Systems.

[31]  Mohan M. Trivedi,et al.  A General Active-Learning Framework for On-Road Vehicle Recognition and Tracking , 2010, IEEE Transactions on Intelligent Transportation Systems.

[32]  Wen-Chung Chang,et al.  Online Boosting for Vehicle Detection , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[33]  Li-Chen Fu,et al.  Integrating Appearance and Edge Features for Sedan Vehicle Detection in the Blind-Spot Area , 2012, IEEE Transactions on Intelligent Transportation Systems.

[34]  David A. Cohn,et al.  Improving generalization with active learning , 1994, Machine Learning.

[35]  Jun-Wei Hsieh,et al.  Symmetrical SURF and Its Applications to Vehicle Detection and Vehicle Make and Model Recognition , 2014, IEEE Transactions on Intelligent Transportation Systems.

[36]  Mohan M. Trivedi,et al.  Partially occluded vehicle recognition and tracking in 3D , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[37]  Ishwar K. Sethi,et al.  Confidence-based active learning , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Christoph H. Lampert,et al.  Beyond sliding windows: Object localization by efficient subwindow search , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.