Zero-shot image classification based on attribute

In the image classification task, traditional model can only recognize annotated image samples, but class labels can't involve all the object categories. In order to reduce the dependence on the labels and recognize unannotated object samples, this paper proposes zero-shot image classification based on attribute. The binary attribute is used as the intermediate knowledge to migrate learned knowledge from training samples domain to test samples domain. Using the classification model of the multi-loss function based on ResNet-50 to predict the object attributes. Then, using an attribute matrix to represent the correspondence between the object class and the attribute. Finally, the result of attribute prediction is combined with the prior knowledge of the attribute matrix to get the category. Compared with the traditional image classification method, the attribute learning model is applied to the zero-shot image classification. The experimental data show that the method improves the recognition accuracy of the image and improves the flexibility of the image classification task, which lays the foundation for the multi-source domain adaptation induction problem.

[1]  Geoffrey E. Hinton,et al.  Zero-shot Learning with Semantic Output Codes , 2009, NIPS.

[2]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[3]  Bernhard Schölkopf,et al.  A tutorial on v-support vector machines , 2005 .

[4]  Christoph H. Lampert,et al.  Attribute-Based Classification for Zero-Shot Visual Object Categorization , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Christoph H. Lampert,et al.  Learning to detect unseen object classes by between-class attribute transfer , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Yoshua Bengio,et al.  Zero-data Learning of New Tasks , 2008, AAAI.

[9]  Kristen Grauman,et al.  Relative attributes , 2011, 2011 International Conference on Computer Vision.

[10]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[11]  Tianbao Yang,et al.  Learning Attributes Equals Multi-Source Domain Generalization , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).