Learning to Transfer PrivilegedRanking Attribute for Object Classification

Learning Using Privileged Information (LUPI) provides an efiective framework to solve the learning problem under situation of the asymmetric distribution of information between training and test time. It has been successfully applied in the category recognition, e.g., protein classiflcation, hand-writing recognition, animal categorization, etc. However, in the existing methods, various semantic attributes, with the help of experts, were only simply translated into the feature vectors and considered as the privileged data, which restricts the LUPI to the simple applications since it is di‐cult to guarantee that the privileged data is similarly informative about the problem at hand as the original data. Therefore, this paper presents a novel approach based on an attribute-ranking learning algorithm to construct the example-oriented privileged data. The main idea is to provide an efiective means to transfer the midlevel semantic attributes to the original training data. Namely, we flrst obtain a real-valued rank per attribute for each example indicating the relative strength of the attribute presence in all examples, and then the resulting attribute ranking results are used to generate the privileged data. The experimental results show that the proposed approach provides a promising means to apply the privileged ranking attributes, and further demonstrate signiflcant improvements in classiflcation accuracy on three typical databases: PubFig, OSR and AwA.

[1]  Kristen Grauman,et al.  Interactively building a discriminative vocabulary of nameable attributes , 2011, CVPR 2011.

[2]  Alexander C. Berg,et al.  Automatic Attribute Discovery and Characterization from Noisy Web Data , 2010, ECCV.

[3]  Ralf Herbrich,et al.  Large margin rank boundaries for ordinal regression , 2000 .

[4]  Christoph H. Lampert,et al.  Learning to Rank Using Privileged Information , 2013, 2013 IEEE International Conference on Computer Vision.

[5]  Pietro Perona,et al.  Visual Recognition with Humans in the Loop , 2010, ECCV.

[6]  Yang Wang,et al.  A Discriminative Latent Model of Object Classes and Attributes , 2010, ECCV.

[7]  Tie-Yan Liu,et al.  Learning to rank: from pairwise approach to listwise approach , 2007, ICML '07.

[8]  Christoph H. Lampert,et al.  Learning to detect unseen object classes by between-class attribute transfer , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Adriana Kovashka,et al.  Actively selecting annotations among objects and attributes , 2011, 2011 International Conference on Computer Vision.

[10]  Tie-Yan Liu,et al.  Learning to rank for information retrieval , 2009, SIGIR.

[11]  David A. Forsyth,et al.  Describing objects by their attributes , 2009, CVPR.

[12]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[13]  Shree K. Nayar,et al.  Attribute and simile classifiers for face verification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[14]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[15]  Gang Wang,et al.  Joint learning of visual attributes, object classes and visual saliency , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[16]  Olivier Chapelle,et al.  Training a Support Vector Machine in the Primal , 2007, Neural Computation.

[17]  Abhinav Gupta,et al.  Constrained Semi-Supervised Learning Using Attributes and Comparative Attributes , 2012, ECCV.

[18]  Vladimir Vapnik,et al.  A new learning paradigm: Learning using privileged information , 2009, Neural Networks.

[19]  Jianmin Wu,et al.  Nonlinear L-1 Support Vector Machines for Learning Using Privileged Information , 2012, 2012 IEEE 12th International Conference on Data Mining Workshops.

[20]  V. Vapnik,et al.  On the theory of learning with Privileged Information , 2010, NIPS 2010.

[21]  Devi Parikh,et al.  Attributes for Classifier Feedback , 2012, ECCV.

[22]  Christoph H. Lampert,et al.  Attribute-Based Classification for Zero-Shot Visual Object Categorization , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Vinod Nair,et al.  A joint learning framework for attribute models and object descriptions , 2011, 2011 International Conference on Computer Vision.

[24]  Nenghai Yu,et al.  Multiple-instance ranking: Learning to rank images for image retrieval , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Arijit Biswas,et al.  Simultaneous Active Learning of Classifiers & Attributes via Relative Feedback , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Rauf Izmailov,et al.  SMO-Style Algorithms for Learning Using Privileged Information , 2010, DMIN.

[27]  Kristen Grauman,et al.  Relative attributes , 2011, 2011 International Conference on Computer Vision.

[28]  Peter Tiño,et al.  Ordinal-based metric learning for learning using privileged information , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[29]  Gang Wang,et al.  Comparative object similarity for improved recognition with few or no examples , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Peter Tiño,et al.  Learning Using Privileged Information in Prototype Based Models , 2012, ICANN.

[31]  Antonio Torralba,et al.  Semantic Label Sharing for Learning with Many Categories , 2010, ECCV.

[32]  Peter Tiño,et al.  Incorporating Privileged Information Through Metric Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[33]  Andrew Zisserman,et al.  Learning Visual Attributes , 2007, NIPS.