Integrated Global-Local Metric Learning for Person Re-identification

The task of person re-identification (re-id) is to match images of people observed in different camera views. Recent researches mainly focus on feature representation and metric learning. Many global metric learning approaches have achieved good performance. Since comparing all of the samples with a single global metric is inappropriate to handle heterogeneous data, some local metric learning approaches are proposed. But most of them cannot be used on re-id directly due to some research challenges. Also, they usually need complicated computation to solve the optimization problems with numerous parameters. In order to improve the performance of global metric learning and avoid complex computation, we propose to simultaneously learn local metrics on clusters of samples softly partitioned by Gaussian Mixture Model (GMM) and a global metric on the entire training set. Then the local metrics are combined with the global metric by their posterior probabilities of GMM to obtain an integrated metric for similarity evaluation. Experiments on three challenging datasets (VIPeR, PRID450S and QMUL GRID) verify the effectiveness of the proposed method.

[1]  Yunhong Wang,et al.  Relevance Metric Learning for Person Re-Identification by Exploiting Listwise Similarities , 2015, IEEE Transactions on Image Processing.

[2]  Shaogang Gong,et al.  Multi-camera activity correlation analysis , 2009, CVPR.

[3]  Alberto Del Bimbo,et al.  Matching People across Camera Views using Kernel Canonical Correlation Analysis , 2014, ICDSC.

[4]  Nicolai Petkov,et al.  Cluster-based adaptive metric classification , 2012, Neurocomputing.

[5]  Xiaogang Wang,et al.  Person Re-identification by Salience Matching , 2013, 2013 IEEE International Conference on Computer Vision.

[6]  Zhi-Hua Zhou,et al.  Learning instance specific distances using metric propagation , 2009, ICML '09.

[7]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[8]  Alberto Del Bimbo,et al.  Person Re-Identification by Iterative Re-Weighted Sparse Ranking , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Xiaogang Wang,et al.  Locally Aligned Feature Transforms across Views , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Hai Tao,et al.  Evaluating Appearance Models for Recognition, Reacquisition, and Tracking , 2007 .

[11]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[12]  Takahiro Okabe,et al.  Hierarchical Gaussian Descriptor for Person Re-identification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[14]  Jiwen Lu,et al.  Nonlinear Local Metric Learning for Person Re-identification , 2015, ArXiv.

[15]  Shaogang Gong,et al.  Person re-identification by probabilistic relative distance comparison , 2011, CVPR 2011.

[16]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Shengcai Liao,et al.  Person re-identification by Local Maximal Occurrence representation and metric learning , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Ajay Divakaran,et al.  Multi-camera calibration, object tracking and query generation , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[19]  Jian-Huang Lai,et al.  Mirror Representation for Modeling View-Specific Transform in Person Re-Identification , 2015, IJCAI.

[20]  Horst Bischof,et al.  Mahalanobis Distance Learning for Person Re-identification , 2014, Person Re-Identification.

[21]  Paul Geladi,et al.  Principal Component Analysis , 1987, Comprehensive Chemometrics.

[22]  Gian Luca Foresti,et al.  Kernelized Saliency-Based Person Re-Identification Through Multiple Metric Learning , 2015, IEEE Transactions on Image Processing.

[23]  Sergio A. Velastin,et al.  Local Fisher Discriminant Analysis for Pedestrian Re-identification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Massimiliano Pontil,et al.  Large Margin Local Metric Learning , 2014, ECCV.

[25]  Shengcai Liao,et al.  Salient Color Names for Person Re-identification , 2014, ECCV.

[26]  Xiang Li,et al.  An enhanced deep feature representation for person re-identification , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[27]  Shengcai Liao,et al.  Efficient PSD Constrained Asymmetric Metric Learning for Person Re-Identification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[28]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Hai Tao,et al.  Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features , 2008, ECCV.

[30]  Thomas Mensink,et al.  Image Classification with the Fisher Vector: Theory and Practice , 2013, International Journal of Computer Vision.

[31]  Alex Pentland,et al.  Bayesian face recognition , 2000, Pattern Recognit..

[32]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Jakob Verbeek,et al.  Coordinated Local Metric Learning , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).