Vehicle detection grammars with partial occlusion handling for traffic surveillance

Traffic surveillance is an important topic in intelligent transportation systems (ITS). Robust vehicle detection is one challenging problem for complex traffic surveillance. In this paper, we propose an efficient vehicle detection method by designing vehicle detection grammars and handling partial occlusion. The grammar model is implemented by novel detection grammars, including structure, deformation and pairwise SVM grammars. First, the vehicle is divided into its constitute parts, called semantic parts, which can represent the vehicle effectively. To increase the robustness of part detection, the semantic parts are represented by their detection score maps. The semantic parts are further divided into sub-parts automatically. The two-layer division of the vehicle is modeled into a grammar model. Then, the grammar model is trained by a designed training procedure to get ideal grammar parameters, including appearance models and grammar productions. After that, vehicle detection is executed by a designed detection procedure with respect to the grammar model. Finally, the issue of vehicle occlusion is handled by designing and training specific grammars. The strategy adopted by our method is first to divide the vehicle into the semantic parts and sub-parts, then to train the grammar productions for semantic parts and sub-parts by introducing novel pairwise SVM grammars and finally to detect the vehicle by applying the trained grammars. Experiments in practical urban scenarios are carried out for complex traffic surveillance. It can be shown that our method adapts to partial occlusion and various challenging cases. (C) 2015 Elsevier Ltd. All rights reserved.

[1]  David A. McAllester,et al.  Object Detection with Grammar Models , 2011, NIPS.

[2]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Jake Porway,et al.  A stochastic graph grammar for compositional object representation and recognition , 2009, Pattern Recognit..

[4]  Mignon Park,et al.  Vision-Based Vehicle Detection System With Consideration of the Detecting Location , 2012, IEEE Transactions on Intelligent Transportation Systems.

[5]  Derek Hoiem,et al.  3D LayoutCRF for Multi-View Object Class Recognition and Segmentation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  N. H. C. Yung,et al.  Vehicle-Component Identification Based on Multiscale Textural Couriers , 2007, IEEE Transactions on Intelligent Transportation Systems.

[7]  Bernt Schiele,et al.  Detection and Tracking of Occluded People , 2014, International Journal of Computer Vision.

[8]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[9]  Afshin Dehghan,et al.  Part-based multiple-person tracking with partial occlusion handling , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Shrinivas J. Pundlik,et al.  Vehicle segmentation and tracking from a low-angle off-axis camera , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Chung-Lin Huang,et al.  A vision-based vehicle identification system , 2004, ICPR 2004.

[12]  N. H. C. Yung,et al.  A novel method for resolving vehicle occlusion in a monocular traffic-image sequence , 2004, IEEE Transactions on Intelligent Transportation Systems.

[13]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[14]  Akihiro Takeuchi,et al.  On-Road Multivehicle Tracking Using Deformable Object Model and Particle Filter With Improved Likelihood Estimation , 2012, IEEE Transactions on Intelligent Transportation Systems.

[15]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[16]  Li-Chen Fu,et al.  Integrating Appearance and Edge Features for Sedan Vehicle Detection in the Blind-Spot Area , 2012, IEEE Transactions on Intelligent Transportation Systems.

[17]  Jamie Shotton,et al.  The Layout Consistent Random Field for Recognizing and Segmenting Partially Occluded Objects , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[18]  Hsu-Yung Cheng,et al.  Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks , 2012, IEEE Transactions on Image Processing.

[19]  Stanley T. Birchfield,et al.  Real-Time Incremental Segmentation and Tracking of Vehicles at Low Camera Angles Using Stable Features , 2008, IEEE Transactions on Intelligent Transportation Systems.

[20]  Zehang Sun,et al.  On-road vehicle detection using Gabor filters and support vector machines , 2002, 2002 14th International Conference on Digital Signal Processing Proceedings. DSP 2002 (Cat. No.02TH8628).

[21]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[22]  N. H. C. Yung,et al.  A Method for Vehicle Count in the Presence of Multiple-Vehicle Occlusions in Traffic Images , 2007, IEEE Transactions on Intelligent Transportation Systems.

[23]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  Ram Nevatia,et al.  Detection and Tracking of Moving Vehicles in Crowded Scenes , 2007, 2007 IEEE Workshop on Motion and Video Computing (WMVC'07).

[25]  Wei Zhang,et al.  Multilevel Framework to Detect and Handle Vehicle Occlusion , 2008, IEEE Transactions on Intelligent Transportation Systems.