Vehicle make and model recognition using sparse representation and symmetrical SURFs

This paper proposes a new symmetrical SURF descriptor to detect vehicles on roads and applies the sparse representation for the application of vehicle make-and-model recognition (MMR). To detect vehicles from roads, this paper proposes a symmetry transformation on SURF points to detect all possible matching pairs of symmetrical SURF points. Then, each desired ROI of vehicle can be located very accurately through a projection technique. This scheme provides two advantages; there is no need of background subtraction and it is extremely efficient for real-time applications. Two MMR challenges, i.e., multiplicity and ambiguity problems, are then addressed. The multiplicity problem stems from one vehicle model often having different model shapes on the road. The ambiguity problem results from vehicles from different companies often sharing similar shapes. To treat the two problems, a dynamic sparse representation scheme is proposed to represent a vehicle model in an over-complete dictionary whose base elements are the training samples themselves. With the dictionary, a novel Hamming distance classification scheme is proposed to classify vehicle makes and models to detailed classes. Because of the sparsity of sparse representation and the nature of Hamming code highly tolerant to noise, different vehicle makes and models can be recognized extreme accurately.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Rama Chellappa,et al.  Secure and Robust Iris Recognition Using Random Projections and Sparse Representations , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Mignon Park,et al.  Vision-Based Vehicle Detection System With Consideration of the Detecting Location , 2012, IEEE Transactions on Intelligent Transportation Systems.

[4]  Y. Asokawa,et al.  Road surface estimation robust against vehicles' existence for stereo-based vehicle detection , 2002, Proceedings. The IEEE 5th International Conference on Intelligent Transportation Systems.

[5]  Wen-Chung Chang,et al.  Online Boosting for Vehicle Detection , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Lisa M. Brown,et al.  "Pattern Recognition" special issue: Sparse representation for event recognition in video surveillance , 2013, Pattern Recognit..

[7]  Thomas S. Huang,et al.  Pose-robust face recognition via sparse representation , 2013, Pattern Recognit..

[8]  Zezhi Chen,et al.  Vehicle type categorization: A comparison of classification schemes , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[9]  Thomas Bräunl,et al.  Symmetry-based monocular vehicle detection system , 2011, Machine Vision and Applications.

[10]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  T Senthil Kumar,et al.  A modified approach for detecting car in video using feature extraction techniques , 2012 .

[12]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[13]  Alberto Broggi,et al.  Stereo vision-based feature extraction for vehicle detection , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[14]  Thomas S. Huang,et al.  Joint dynamic sparse representation for multi-view face recognition , 2012, Pattern Recognit..

[15]  J. D. Crisman,et al.  Vehicle detection in color images , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[16]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[17]  Changshui Zhang,et al.  Front-view vehicle detection by Markov chain Monte Carlo method , 2009, Pattern Recognition.

[18]  Qi Jia,et al.  A sparse representation approach for local feature based expression recognition , 2011, 2011 International Conference on Multimedia Technology.

[19]  Rama Chellappa,et al.  Sparsity inspired selection and recognition of iris images , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[20]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[21]  Xiaobo Li,et al.  Detection of vehicles from traffic scenes using fuzzy integrals , 2002, Pattern Recognit..

[22]  David J. Kriegman,et al.  Introduction of New Editor-in-Chief , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  W. Eric L. Grimson,et al.  Object Detection and Localization by Dynamic Template Warping , 1998, International Journal of Computer Vision.

[24]  Fang-Xiang Wu,et al.  Sparse Representation for Classification of Tumors Using Gene Expression Data , 2009, Journal of biomedicine & biotechnology.

[25]  Concetto Spampinato,et al.  Adaptive Background Modeling Integrated With Luminosity Sensors and Occlusion Processing for Reliable Vehicle Detection , 2011, IEEE Transactions on Intelligent Transportation Systems.

[26]  Michael G. Madden,et al.  Multi-Class and Single-Class Classification Approaches to Vehicle Model Recognition from Images , 2005 .

[27]  Nick Pears,et al.  Automatic make and model recognition from frontal images of cars , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[28]  Ming Xie,et al.  Color modeling by spherical influence field in sensing driving environment , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[29]  Hamid Reza Pourreza,et al.  Vehicle Recognition Based on Fourier, Wavelet and Curvelet Transforms - a Comparative Study , 2007, Fourth International Conference on Information Technology (ITNG'07).

[30]  Jun-Wei Hsieh,et al.  Jointing Edge Labeling and Geometrical Constraint for Lane Detection and its Application to Suspicious Driving Behavior Analysis , 2011, J. Inf. Sci. Eng..

[31]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  I. Zafar,et al.  Localized contourlet features in vehicle make and model recognition , 2009, Electronic Imaging.

[34]  Thomas S. Huang,et al.  Multi-observation visual recognition via joint dynamic sparse representation , 2011, 2011 International Conference on Computer Vision.

[35]  Rama Chellappa,et al.  Sparse dictionary-based representation and recognition of action attributes , 2011, 2011 International Conference on Computer Vision.

[36]  Lei Zhang,et al.  Centralized sparse representation for image restoration , 2011, 2011 International Conference on Computer Vision.

[37]  H. Saji,et al.  Vehicle Motion Tracking Using Symmetry of Vehicle and Background Subtraction , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[38]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[39]  Fei-Fei Li,et al.  Online detection of unusual events in videos via dynamic sparse coding , 2011, CVPR 2011.

[40]  Bin Dai,et al.  A Vehicle Detection Method via Symmetry in Multi-Scale Windows , 2007, 2007 2nd IEEE Conference on Industrial Electronics and Applications.

[41]  Shuicheng Yan,et al.  Visual classification with multi-task joint sparse representation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[42]  A. Jazayeri,et al.  Vehicle Detection and Tracking in Car Video Based on Motion Model , 2011, IEEE Transactions on Intelligent Transportation Systems.

[43]  Mohan M. Trivedi,et al.  A General Active-Learning Framework for On-Road Vehicle Recognition and Tracking , 2010, IEEE Transactions on Intelligent Transportation Systems.

[44]  W. Eric L. Grimson,et al.  Edge-based rich representation for vehicle classification , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[45]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[46]  Aleksandra M. Urbanska,et al.  Erratum of “Investigation of Microencapsulated BSH Active Lactobacillus in the Simulated Human GI Tract” , 2009, Journal of Biomedicine and Biotechnology.

[47]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).