Zero-Shot Domain Adaptation via Kernel Regression on the Grassmannian

Most visual recognition methods implicitly assume the data distribution remains unchanged from training to testing. However, in practice domain shift often exists, where real-world factors such as lighting and sensor type change between train and test, and classifiers do not generalise from source to target domains. It is impractical to train separate models for all possible situations because collecting and labelling the data is expensive. Domain adaptation algorithms aim to ameliorate domain shift, allowing a model trained on a source to perform well on a different target domain. However, even for the setting of unsupervised domain adaptation, where the target domain is unlabelled, collecting data for every possible target domain is still costly. In this paper, we propose a new domain adaptation method that has no need to access either data or labels of the target domain when it can be described by a parametrised vector and there exits several related source domains within the same parametric space. It greatly reduces the burden of data collection and annotation, and our experiments show some promising results.

[1]  Martin Styner,et al.  Intrinsic Regression Models for Manifold-Valued Data. , 2009, Journal of the American Statistical Association.

[2]  P. Thomas Fletcher,et al.  Geodesic Regression and the Theory of Least Squares on Riemannian Manifolds , 2012, International Journal of Computer Vision.

[3]  Philip S. Yu,et al.  Transfer Sparse Coding for Robust Image Representation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Martin Styner,et al.  Intrinsic Regression Models for Manifold-Valued Data , 2009, MICCAI.

[5]  Steven Thomas Smith,et al.  Optimization Techniques on Riemannian Manifolds , 2014, ArXiv.

[6]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[7]  Yongxin Yang,et al.  A Unified Perspective on Multi-Domain and Multi-Task Learning , 2014, ICLR.

[8]  Andrew Y. Ng,et al.  Zero-Shot Learning Through Cross-Modal Transfer , 2013, NIPS.

[9]  Tinne Tuytelaars,et al.  Unsupervised Visual Domain Adaptation Using Subspace Alignment , 2013, 2013 IEEE International Conference on Computer Vision.

[10]  Svetlana Lazebnik,et al.  Analysis of human attractiveness using manifold kernel regression , 2008, 2008 15th IEEE International Conference on Image Processing.

[11]  P. Thomas Fletcher,et al.  Polynomial Regression on Riemannian Manifolds , 2012, ECCV.

[12]  Silvio Savarese,et al.  Recognizing human actions by attributes , 2011, CVPR 2011.

[13]  Moo K. Chung,et al.  Multivariate General Linear Models (MGLM) on Riemannian Manifolds with Applications to Statistical Analysis of Diffusion Weighted Images , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Geoffrey E. Hinton,et al.  Zero-shot Learning with Semantic Output Codes , 2009, NIPS.

[15]  Quentin Rentmeesters,et al.  A gradient method for geodesic data fitting on some symmetric Riemannian manifolds , 2011, IEEE Conference on Decision and Control and European Control Conference.

[16]  Yuan Shi,et al.  Geodesic flow kernel for unsupervised domain adaptation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  V. M. Tkachuk Supersymmetric Method for Constructing Quasi-Exactly Solvable Potentials , 1998 .

[18]  Christoph H. Lampert,et al.  Learning to detect unseen object classes by between-class attribute transfer , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Trevor Darrell,et al.  Continuous Manifold Based Adaptation for Evolving Visual Domains , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Shaogang Gong,et al.  Transductive Multi-view Embedding for Zero-Shot Recognition and Annotation , 2014, ECCV.

[21]  Daniel D. Lee,et al.  Grassmann discriminant analysis: a unifying view on subspace-based learning , 2008, ICML '08.

[22]  Rama Chellappa,et al.  Domain adaptation for object recognition: An unsupervised approach , 2011, 2011 International Conference on Computer Vision.

[23]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[24]  Yoshua Bengio,et al.  Zero-data Learning of New Tasks , 2008, AAAI.

[25]  Lek-Heng Lim,et al.  Distance between subspaces of different dimensions , 2014 .

[26]  Wotao Yin,et al.  A feasible method for optimization with orthogonality constraints , 2013, Math. Program..

[27]  Trevor Darrell,et al.  Adapting Visual Category Models to New Domains , 2010, ECCV.

[28]  P. Thomas Fletcher,et al.  Population Shape Regression from Random Design Data , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[29]  K.A. Gallivan,et al.  Efficient algorithms for inferences on Grassmann manifolds , 2004, IEEE Workshop on Statistical Signal Processing, 2003.

[30]  Nuno Vasconcelos,et al.  Geodesic Regression on the Grassmannian , 2014, ECCV.

[31]  Rama Chellappa,et al.  Domain Adaptive Dictionary Learning , 2012, ECCV.

[32]  Mark D. Plumbley Lie Group Methods for Optimization with Orthogonality Constraints , 2004, ICA.

[33]  Luís Machado,et al.  THE GEOMETRIC MEAN AND THE GEODESIC FITTING PROBLEM ON THE GRASSMANN MANIFOLD , 2013 .

[34]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.