A Hierarchical Scheme for Vehicle Make and Model Recognition From Frontal Images of Vehicles

This paper presents a novel recognition scheme for vehicle make and model recognition (VMMR) from frontal images of vehicles. In general, we introduce some domain knowledge to cope with this task. The structural components contained in the frontal appearance of vehicles present different visual characteristics and their discriminating ability varies when vehicle models belonging to the same brand or different brands are compared. In light of the particularities, we take advantage of the varying discriminating ability of these structural components to perform the recognition task sequentially in two stages. At the first stage, the logo sub-region (which is one of the component-related sub-regions in the region of interest) is applied to classify the vehicle models at the brand level. Different from the traditional brand-level classification that the models of the same brand are considered as a single class, in this paper, multiple sub-classes in one brand class are allowed, since the intra-brand models also exhibit a certain degree of diversity. In this way, the problem of inter-class similarity is remitted. At the second stage, several customized classifiers are trained for each sub-class in the light of the discriminant ability of the remaining sub-regions. The proposed approach has been tested on a large-scale vehicle image database collected in this paper and has achieved the state-of-the-art results.

[1]  Bir Bhanu,et al.  Dynamic Bayesian Networks for Vehicle Classification in Video , 2012, IEEE Transactions on Industrial Informatics.

[2]  Hyo Jong Lee,et al.  Local Tiled Deep Networks for Recognition of Vehicle Make and Model , 2016, Sensors.

[3]  Timothy F. Cootes,et al.  Analysis of Features for Rigid Structure Vehicle Type Recognition , 2004, BMVC.

[4]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.

[5]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[6]  Eleftherios Kayafas,et al.  Vehicle model recognition from frontal view image measurements , 2011, Comput. Stand. Interfaces.

[7]  Phoenix X. Huang,et al.  Hierarchical Classification for Live Fish Recognition , 2012 .

[8]  Paulo Lobato Correia,et al.  Car recognition based on back lights and rear view features , 2009, 2009 10th Workshop on Image Analysis for Multimedia Interactive Services.

[9]  David Fernández Llorca,et al.  Vehicle logo recognition in traffic images using HOG features and SVM , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[10]  Gérard G. Medioni,et al.  3-D model based vehicle recognition , 2009, 2009 Workshop on Applications of Computer Vision (WACV).

[11]  W. Eric L. Grimson,et al.  Edge-based rich representation for vehicle classification , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[12]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[13]  Jun-Wei Hsieh,et al.  Vehicle make and model recognition using sparse representation and symmetrical SURFs , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[14]  Fei-Fei Li,et al.  What Does Classifying More Than 10, 000 Image Categories Tell Us? , 2010, ECCV.

[15]  Nick Pears,et al.  Automatic make and model recognition from frontal images of cars , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[16]  Xiaogang Wang,et al.  Multi-View Perceptron: a Deep Model for Learning Face Identity and View Representations , 2014, NIPS.

[17]  Xiaoou Tang,et al.  A large-scale car dataset for fine-grained categorization and verification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Takeo Kato,et al.  Preceding vehicle recognition based on learning from sample images , 2002, IEEE Trans. Intell. Transp. Syst..

[19]  Azzedine Boukerche,et al.  Towards Efficient Vehicle Classification in Intelligent Transportation Systems , 2015, DIVANet@MSWiM.

[20]  Hiroki Maemoto,et al.  Parametric vehicle recognition using knowledge acquisition system , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[21]  Serge J. Belongie,et al.  Recognizing Cars , 2005 .

[22]  Daphne Koller,et al.  Discriminative learning of relaxed hierarchy for large-scale visual recognition , 2011, 2011 International Conference on Computer Vision.

[23]  Jindong Tan,et al.  Recognition of Car Makes and Models From a Single Traffic-Camera Image , 2015, IEEE Transactions on Intelligent Transportation Systems.

[24]  Yun Wu,et al.  A model for fine-grained vehicle classification based on deep learning , 2017, Neurocomputing.

[25]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Jun-Wei Hsieh,et al.  Symmetrical SURF and Its Applications to Vehicle Detection and Vehicle Make and Model Recognition , 2014, IEEE Transactions on Intelligent Transportation Systems.

[27]  Dongjin Han,et al.  Vehicle Class Recognition from Video-Based on 3D Curve Probes , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[28]  Hyo Jong Lee,et al.  Neural Network Approach to Identify Model of Vehicles , 2006, ISNN.

[29]  Zezhi Chen,et al.  Vehicle type categorization: A comparison of classification schemes , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[30]  Zhenbing Liu,et al.  An Efficient Method for Vehicle Model Identification via Logo Recognition , 2013, 2013 International Conference on Computational and Information Sciences.

[31]  Meena Abdelmaseeh,et al.  Car Make and Model recognition combining global and local cues , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[32]  Eran A. Edirisinghe,et al.  Vehicle Make and Model Recognition in CCTV footage , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[33]  Ignacio Parra,et al.  Vehicle model recognition using geometry and appearance of car emblems from rear view images , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[34]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[35]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  T Senthil Kumar,et al.  A modified approach for detecting car in video using feature extraction techniques , 2012 .

[37]  Ye Sun,et al.  Vehicle Logo Recognition System Based on Convolutional Neural Networks With a Pretraining Strategy , 2015, IEEE Transactions on Intelligent Transportation Systems.

[38]  Tatsuya Yoshida,et al.  Vehicle Classification System with Local-Feature Based Algorithn Using CG Model Images , 2002 .

[39]  Michael G. Madden,et al.  Multi-Class and Single-Class Classification Approaches to Vehicle Model Recognition from Images , 2005 .

[40]  I. Zafar,et al.  Localized contourlet features in vehicle make and model recognition , 2009, Electronic Imaging.

[41]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[42]  Muhammad Fraz,et al.  Mid-level-Representation Based Lexicon for Vehicle Make and Model Recognition , 2014, 2014 22nd International Conference on Pattern Recognition.

[43]  Thomas M. Breuel,et al.  Classification using a hierarchical Bayesian approach , 2002, Object recognition supported by user interaction for service robots.

[44]  Attila Tanács,et al.  Car recognition from frontal images in mobile environment , 2013, 2013 8th International Symposium on Image and Signal Processing and Analysis (ISPA).

[45]  Yu Zhou,et al.  Fine-Grained Vehicle Model Recognition Using A Coarse-to-Fine Convolutional Neural Network Architecture , 2017, IEEE Transactions on Intelligent Transportation Systems.

[46]  Maurice Milgram,et al.  Multi-class Vehicle Type Recognition System , 2008, ANNPR.

[47]  Osama Masoud,et al.  Detection and classification of vehicles , 2002, IEEE Trans. Intell. Transp. Syst..

[48]  Ioannis Anagnostopoulos,et al.  A License Plate-Recognition Algorithm for Intelligent Transportation System Applications , 2006, IEEE Transactions on Intelligent Transportation Systems.

[49]  Azzedine Boukerche,et al.  Real-Time Vehicle Make and Model Recognition Based on a Bag of SURF Features , 2016, IEEE Transactions on Intelligent Transportation Systems.

[50]  Yunde Jia,et al.  Vehicle Type Classification Using a Semisupervised Convolutional Neural Network , 2015, IEEE Transactions on Intelligent Transportation Systems.

[51]  Matthew Turk,et al.  Car-Rec: A real time car recognition system , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[52]  Wei Wu,et al.  A method of vehicle classification using models and neural networks , 2001, IEEE VTS 53rd Vehicular Technology Conference, Spring 2001. Proceedings (Cat. No.01CH37202).

[53]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[54]  Jianping Fan,et al.  Hierarchical classification for automatic image annotation , 2007, SIGIR.

[55]  David J. Kriegman,et al.  Video-based Car Surveillance: License Plate, Make, and Model Recognition , 2005 .

[56]  Xiaoou Tang,et al.  Facial Landmark Detection by Deep Multi-task Learning , 2014, ECCV.