Coupled Multivehicle Detection and Classification With Prior Objectness Measure

Vehicle recognition plays an important role in traffic surveillance systems, advanced driver-assistance systems, and autonomous vehicles. This paper presents a novel approach for multivehicle recognition that considers vehicle space location and classification as a coupled optimization problem. It can speed up the detection process with more accurate vehicle region proposals and can recognize multiple vehicles using a single model. The proposed detector is implemented in three stages: 1) obtaining candidate vehicle locations with prior objectness measure; 2) classifying vehicle region proposals to distinguish the three common types of vehicles (i.e., car, taxi, and bus) by a single convolutional neural network (CNN); and 3) coupling classification results with the detection process, which leads to fewer false positives. In experiments on high-resolution traffic images, our method achieves unique characteristics: 1) It matches the state-of-the-art detection accuracy; 2) it is more efficient in generating a smaller set of high-quality vehicle windows; 3) its searching time is decreased by about 30 times compared with the other two popular detection schemes; and 4) it recognizes different vehicles in each image using a single CNN model with eight layers.

[1]  白能勝 Vision-based vehicle detection for a driver assistance system , 2011 .

[2]  Derek Hoiem,et al.  Category Independent Object Proposals , 2010, ECCV.

[3]  Bo Li,et al.  Taxi detection based on vehicle painting features for urban traffic scenes , 2013, Proceedings of 2013 IEEE International Conference on Vehicular Electronics and Safety.

[4]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[5]  Sun-Young Hwang,et al.  High-performance on-road vehicle detection with non-biased cascade classifier by weight-balanced training , 2015, EURASIP J. Image Video Process..

[6]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Sharath Pankanti,et al.  Large-Scale Vehicle Detection, Indexing, and Search in Urban Surveillance Videos , 2012, IEEE Transactions on Multimedia.

[8]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Pradeep Kumar Mishra,et al.  Vehicle Classification using Density based Multi-feature Approach in Support Vector Machine Classifier , 2013 .

[10]  Haibin Ling,et al.  Robust Visual Tracking and Vehicle Classification via Sparse Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Thomas Deselaers,et al.  Measuring the Objectness of Image Windows , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Sergio L. Toral Marín,et al.  An Enhanced Background Estimation Algorithm for Vehicle Detection in Urban Traffic Scenes , 2010, IEEE Transactions on Vehicular Technology.

[13]  Xiaogang Wang,et al.  Deep Learning Face Representation by Joint Identification-Verification , 2014, NIPS.

[14]  Fei-Yue Wang,et al.  Parallel Control and Management for Intelligent Transportation Systems: Concepts, Architectures, and Applications , 2010, IEEE Transactions on Intelligent Transportation Systems.

[15]  Bir Bhanu,et al.  Dynamic Bayesian Networks for Vehicle Classification in Video , 2012, IEEE Transactions on Industrial Informatics.

[16]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[17]  David Zhang,et al.  Moving Vehicle Detection for Automatic Traffic Monitoring , 2007, IEEE Transactions on Vehicular Technology.

[18]  Zezhi Chen,et al.  Vehicle type categorization: A comparison of classification schemes , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[19]  Bin Dai,et al.  Vision-based long-distance lane perception and front vehicle location for full autonomous vehicles on highway roads , 2012 .

[20]  Bo Li,et al.  Vehicle detection with a part-based model for complex traffic conditions , 2013, Proceedings of 2013 IEEE International Conference on Vehicular Electronics and Safety.

[21]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Andrew Y. Ng,et al.  Convolutional-Recursive Deep Learning for 3D Object Classification , 2012, NIPS.

[23]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[24]  Jonathan Warrell,et al.  Proposal generation for object detection using cascaded ranking SVMs , 2011, CVPR 2011.

[25]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[27]  Chih-Yang Lin,et al.  Real-time vehicle color identification for surveillance videos , 2014, 2014 International Conference on Electronics, Communications and Computers (CONIELECOMP).

[28]  许华荣,et al.  Towards Real-Time Traffic Sign Detection and Classification , 2016 .

[29]  Roberto Hirata,et al.  Vehicle Detection Using Mixture of Deformable Parts Models: Static and Dynamic Camera , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[30]  Cristian Sminchisescu,et al.  CPMC: Automatic Object Segmentation Using Constrained Parametric Min-Cuts , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Ming Tang,et al.  Hierarchical and Networked Vehicle Surveillance in ITS: A Survey , 2015, IEEE transactions on intelligent transportation systems (Print).

[32]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Johannes Stallkamp,et al.  The German Traffic Sign Recognition Benchmark: A multi-class classification competition , 2011, The 2011 International Joint Conference on Neural Networks.

[34]  Lin Li,et al.  Moving Vehicle Recognition and Feature Extraction From Tunnel Monitoring Videos , 2013 .

[35]  Yann LeCun,et al.  Traffic sign recognition with multi-scale Convolutional Networks , 2011, The 2011 International Joint Conference on Neural Networks.

[36]  Wei Zhan,et al.  Research of Vehicle Type Recognition System Based on Audio Video Interleaved Flow for Toll Station , 2012, J. Softw..