Fine-grained Vehicle Recognition Using Lightweight Convolutional Neural Network with Combined Learning Strategy

Fine-grained vehicle recognition plays an important part in applications, such as urban traffic management, public security, and criminal investigation. It has great chanllengs due to the subtle differences among numerous subcategories. In this paper, a fine-grained vehicle recognition method using lightweight convolutional neural network with combined learning strategy is proposed. Firstly, a lightweight Convolutional Neural Network (LWCNN) is designed specially for the fine-grained vehicle recognition task. Then, a combined training strategy, including pre-training, fine-tuning training and transfer training, is proposed to optimize the LWCNN parameters. In the pre-training phase, ILSVRC-2012 dataset is adopted to train the VGG16-Net, generating an initial model. Then, in the fine-tuning phase, the vehicle dataset is used for fine-tuning the pre-trained model to avoid learning parameters from scratch. Finally, in the transfer training phase, appropriate initialization parameters of LWCNN are obtained through the analysis of the fine-tuned network parameters. LWCNN is then trained using the vehicle dataset to obtain the highly accurate and robust classification model. Compared with the state-of-the-art methods, the proposed method can effectively decrease the computational complexity while maintaining the recognition performance.

[1]  Xiaoou Tang,et al.  A large-scale car dataset for fine-grained categorization and verification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Razvan Pascanu,et al.  Progressive Neural Networks , 2016, ArXiv.

[3]  Yu Zhou,et al.  Fine-Grained Vehicle Model Recognition Using A Coarse-to-Fine Convolutional Neural Network Architecture , 2017, IEEE Transactions on Intelligent Transportation Systems.

[4]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Bailing Zhang,et al.  Reliable Classification of Vehicle Types Based on Cascade Classifier Ensembles , 2013, IEEE Transactions on Intelligent Transportation Systems.

[6]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[7]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[8]  Tao Mei,et al.  Look Closer to See Better: Recurrent Attention Convolutional Neural Network for Fine-Grained Image Recognition , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Zhenghao Chen,et al.  On Random Weights and Unsupervised Feature Learning , 2011, ICML.

[10]  Jun-Wei Hsieh,et al.  Symmetrical SURF and Its Applications to Vehicle Detection and Vehicle Make and Model Recognition , 2014, IEEE Transactions on Intelligent Transportation Systems.

[11]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Zhen Li,et al.  Towards Better Analysis of Deep Convolutional Neural Networks , 2016, IEEE Transactions on Visualization and Computer Graphics.