Semi-coupled basis and distance metric learning for cross-domain matching: Application to low-resolution face recognition

In this paper, we propose a method for matching biometric data from disparate domains. Specifically, we focus on the problem of comparing a low-resolution (LR) image with a high-resolution (HR) one. Existing coupled mapping methods do not fully exploit the HR information or they do not simultaneously use samples from both domains during training. To this end, we propose a method that learns coupled distance metrics in two steps. In addition, we propose to jointly learn two semi-coupled bases that yield optimal representations. In particular, the HR images are used to learn a basis and a distance metric that result in increased class-separation. The LR images are then used to learn a basis and a distance metric that map the LR data to their class-discriminated HR pairs. Finally, the two distance metrics are refined to simultaneously enhance the class-separation of both HR class-discriminated and LR projected images. We illustrate that different distance metric learning approaches can be employed in conjunction with our framework. Experimental results on Multi-PIE and SCface, along with the relevant hypothesis tests, provide evidence of the effectiveness of the proposed approach.

[1]  Pong C. Yuen,et al.  Very low resolution face recognition problem , 2010, BTAS.

[2]  B. V. K. Vijaya Kumar,et al.  Maximum-Margin Coupled Mappings for cross-domain matching , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[3]  D. Wolfe,et al.  Nonparametric Statistical Methods. , 1974 .

[4]  Larry S. Davis,et al.  Learning a discriminative dictionary for sparse coding via label consistent K-SVD , 2011, CVPR 2011.

[5]  Q. M. Jonathan Wu,et al.  Low-resolution face recognition: a review , 2013, The Visual Computer.

[6]  Quan Pan,et al.  Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Shiguang Shan,et al.  Low-Resolution Face Recognition via Coupled Locality Preserving Mappings , 2010, IEEE Signal Processing Letters.

[8]  D. Dai,et al.  Piecewise Regularized Canonical Correlation Discrimination for Low-Resolution Face Recognition , 2010, 2010 Chinese Conference on Pattern Recognition (CCPR).

[9]  Shiguang Shan,et al.  Coupled Metric Learning for Face Recognition with Degraded Images , 2009, ACML.

[10]  B. V. K. Vijaya Kumar,et al.  Coupled Marginal Fisher Analysis for Low-Resolution Face Recognition , 2012, ECCV Workshops.

[11]  Takeo Kanade,et al.  Multi-PIE , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[12]  Bruce A. Draper,et al.  A meta-analysis of face recognition covariates , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[13]  Stan Z. Li,et al.  Low-resolution face recognition via Simultaneous Discriminant Analysis , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[14]  Pong C. Yuen,et al.  Very low resolution face recognition problem , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[15]  Hans Knutsson,et al.  A canonical correlation approach to exploratory data analysis in fMRI , 2002 .

[16]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Douglas A. Wolfe,et al.  Nonparametric Statistical Methods , 1973 .

[18]  Yuanyuan Zhang,et al.  A Novel Coupled Metric Learning Method and Its Application in Degraded Face Recognition , 2013, CCBR.

[19]  Masashi Sugiyama,et al.  Local Fisher discriminant analysis for supervised dimensionality reduction , 2006, ICML.

[20]  Patrick J. Flynn,et al.  Multidimensional Scaling for Matching Low-Resolution Face Images , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[22]  Shinichi Nakajima,et al.  Semi-Supervised Local Fisher Discriminant Analysis for Dimensionality Reduction , 2008, PAKDD.

[23]  Mislav Grgic,et al.  SCface – surveillance cameras face database , 2011, Multimedia Tools and Applications.