Cold Start Problem of Vehicle Model Recognition under Cross-Scenario Based on Transfer Learning

As a major function of smart transportation in smart cities, vehicle model recognition plays an important role in intelligent transportation. Due to the difference among different vehicle models recognition datasets, the accuracy of network model training in one scene will be greatly reduced in another one. However, if you don’t have a lot of vehicle model datasets for the current scene, you cannot properly train a model. To address this problem, we study the problem of cold start of vehicle model recognition under cross-scenario. Under the condition of small amount of datasets, combined with the method of transfer learning, load the DAN (Deep Adaptation Networks) and JAN (Joint Adaptation Networks) domain adaptation modules into the convolutional neural network AlexNet and ResNet, and get four models: AlexNet-JAN, AlexNet-DAN, ResNet-JAN, and ResNet-DAN which can achieve a higher accuracy at the beginning. Through experiments, transfer the vehicle model recognition from the network image dataset (source domain) to the surveillance-nature dataset (target domain), both Top-1 and Top-5 accuracy have been improved by at least 20%.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Koby Crammer,et al.  Analysis of Representations for Domain Adaptation , 2006, NIPS.

[3]  Jian Shen,et al.  Wasserstein Distance Guided Representation Learning for Domain Adaptation , 2017, AAAI.

[4]  Sergio A. Velastin,et al.  Detection and classification of vehicles for urban traffic scenes , 2008 .

[5]  Bailing Zhang,et al.  Vehicle Logo Recognition and attributes prediction by multi-task learning with CNN , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[6]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[7]  Dong Wang,et al.  Learning to Navigate for Fine-grained Classification , 2018, ECCV.

[8]  Hichem Frigui,et al.  A Large and Diverse Dataset for Improved Vehicle Make and Model Recognition , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[9]  Larry S. Davis,et al.  Jointly Optimizing 3D Model Fitting and Fine-Grained Classification , 2014, ECCV.

[10]  Joseph L. Mundy,et al.  Vehicle Surveillance with a Generic, Adaptive, 3D Vehicle Model , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Shengcai Liao,et al.  Deep Metric Learning for Person Re-identification , 2014, 2014 22nd International Conference on Pattern Recognition.

[12]  Armin B. Cremers,et al.  Laser-based segment classification using a mixture of bag-of-words , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Michael I. Jordan,et al.  Learning Transferable Features with Deep Adaptation Networks , 2015, ICML.

[15]  Xiaoou Tang,et al.  A large-scale car dataset for fine-grained categorization and verification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Sun-Mi Park,et al.  Vehicle Color Classification Based on the Support Vector Machine Method , 2007, ICIC.

[17]  Tao Mei,et al.  Look Closer to See Better: Recurrent Attention Convolutional Neural Network for Fine-Grained Image Recognition , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  Tao Mei,et al.  A Deep Learning-Based Approach to Progressive Vehicle Re-identification for Urban Surveillance , 2016, ECCV.

[20]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Xinge You,et al.  Hierarchical Bilinear Pooling for Fine-Grained Visual Recognition , 2018, ECCV.

[22]  Wei Hu,et al.  A new approach for vehicle color recognition based on specular-free image , 2013, Other Conferences.

[23]  Muhittin Gökmen,et al.  A convenient feature vector construction for vehicle color recognition , 2010 .

[24]  Bailing Zhang,et al.  Reliable Classification of Vehicle Types Based on Cascade Classifier Ensembles , 2013, IEEE Transactions on Intelligent Transportation Systems.

[25]  Jonathan Krause,et al.  3D Object Representations for Fine-Grained Categorization , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[26]  Michael I. Jordan,et al.  Deep Transfer Learning with Joint Adaptation Networks , 2016, ICML.

[27]  Trevor Darrell,et al.  Deep Domain Confusion: Maximizing for Domain Invariance , 2014, CVPR 2014.

[28]  Xiaogang Wang,et al.  Orientation Invariant Feature Embedding and Spatial Temporal Regularization for Vehicle Re-identification , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[29]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[30]  Meena Abdelmaseeh,et al.  Car Make and Model recognition combining global and local cues , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[31]  Jeonghwan Gwak,et al.  Vehicle Model Recognition in Video , 2013 .

[32]  Errui Ding,et al.  Multi-Attention Multi-Class Constraint for Fine-grained Image Recognition , 2018, ECCV.

[33]  Larry S. Davis,et al.  Learning a Discriminative Filter Bank Within a CNN for Fine-Grained Recognition , 2016, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[34]  Yoo-Joo Choi,et al.  Deciding the Number of Color Histogram Bins for Vehicle Color Recognition , 2008, 2008 IEEE Asia-Pacific Services Computing Conference.