Fine-grained vehicle recognition using hierarchical fine-tuning strategy for Urban Surveillance Videos

The Fine-grained Vehicle recognition is easily affected by small visual changes. The existing recognition methods have less robustness to these conditions (such as illumination, weather changes, etc.) and the accuracy of vehicle recognition in complex environments cannot achieve a satisfying result. In this paper, a high-accuracy fine-grained vehicle recognition method using Convolutional Neural Network for urban surveillance videos is proposed. Differing from the conventional CNN based methods, which usually obtain a single classification model, the proposed method combines Pre-training and hierarchical fine-tuning to obtain different classification model that can adapt to the change of illumination conditions. In the recognition phase, the input image is evaluated firstly using the proposed image quality assessment method. Then, the classification model is selected adaptively according to the results of quality evaluation and used for recognition. To test our method, we use a publicly vehicle recognition dataset for Urban Surveillance Videos provide by Yang. Experimental results show that the accuracy of the proposed method is up to 98.89%, which is 0.5% higher than Yang's method.

[1]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[2]  Ke Chen,et al.  Car type recognition with Deep Neural Networks , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[3]  Bob Zhang,et al.  Multiple representations and sparse representation for image classification , 2015, Pattern Recognit. Lett..

[4]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[5]  Xiaoou Tang,et al.  A large-scale car dataset for fine-grained categorization and verification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Jun-Wei Hsieh,et al.  Vehicle make and model recognition using sparse representation and symmetrical SURFs , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[7]  Tianbao Yang,et al.  Hyper-class augmented and regularized deep learning for fine-grained image classification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Larry S. Davis,et al.  Jointly Optimizing 3D Model Fitting and Fine-Grained Classification , 2014, ECCV.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Jonghyun Choi,et al.  Mining Discriminative Triplets of Patches for Fine-Grained Classification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Song-Chun Zhu,et al.  Integrating Context and Occlusion for Car Detection by Hierarchical And-Or Model , 2014, ECCV.

[13]  Zhenghao Chen,et al.  On Random Weights and Unsupervised Feature Learning , 2011, ICML.