Semi-supervised distance metric learning for person re-identification

As a fundamental task in automated video surveillance, person re-identification, which has received increasing attention in recent years, aims to match people across non-overlapping camera views in a multi-camera surveillance system. It has been reported that KISS metric learning has been followed by most of the previous supervised work because of its state of the art performance for person re-identification on VIPeR dataset. However, given only a small number of labeled image pairs available for training, the matching model certainly suffers from unstable learning process and poor matching result. To address this serious practical issue, we proposed a novel semi-supervised KISS metric learning (SS-KISS) approach which makes use of unlabeled data to improve the re-identification performance by 1) combining both global and local information to select the most confident image pairs from the unlabeled data; 2) using an ensemble approach, which explores advantages of supervised and unsupervised learning by reconciling two matching models on which labeled and un-labeled data to an optimal one via smart weighting schema. Extensive experiments have been conducted on three datasets: VIPeR, ETHZ, and i-LiDS, experimental results demonstrate that our approach achieves a sound performance in the case of small amount of labeled data.

[1]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[2]  Yun Yang,et al.  An adaptive semi-supervised clustering approach via multiple density-based information , 2017, Neurocomputing.

[3]  Shaogang Gong,et al.  Person Re-Identification by Support Vector Ranking , 2010, BMVC.

[4]  Sridha Sridharan,et al.  A Database for Person Re-Identification in Multi-Camera Surveillance Networks , 2012, 2012 International Conference on Digital Image Computing Techniques and Applications (DICTA).

[5]  Rainer Stiefelhagen,et al.  Semi-supervised Learning with Constraints for Person Identification in Multimedia Data , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Slawomir Bak,et al.  Person Re-identification Using Haar-based and DCD-based Signature , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[7]  Xiaogang Wang,et al.  Unsupervised Salience Learning for Person Re-identification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Yun Yang,et al.  A robust semi-supervised learning approach via mixture of label information , 2015, Pattern Recognit. Lett..

[9]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Vittorio Murino,et al.  Semi-supervised multi-feature learning for person re-identification , 2013, 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[11]  Horst Bischof,et al.  Relaxed Pairwise Learned Metric for Person Re-identification , 2012, ECCV.

[12]  Inderjit S. Dhillon,et al.  Information-theoretic metric learning , 2006, ICML '07.

[13]  Cordelia Schmid,et al.  Is that you? Metric learning approaches for face identification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[14]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[15]  Hai Tao,et al.  Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features , 2008, ECCV.

[16]  Ping Li,et al.  Semi-Supervised Ranking for Re-identification with Few Labeled Image Pairs , 2014, ACCV.

[17]  Shaogang Gong,et al.  Reidentification by Relative Distance Comparison , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Hai Tao,et al.  Evaluating Appearance Models for Recognition, Reacquisition, and Tracking , 2007 .

[19]  Ying Zhang,et al.  Gabor-LBP Based Region Covariance Descriptor for Person Re-identification , 2011, 2011 Sixth International Conference on Image and Graphics.

[20]  Vittorio Murino,et al.  Custom Pictorial Structures for Re-identification , 2011, BMVC.

[21]  Frédéric Jurie,et al.  PCCA: A new approach for distance learning from sparse pairwise constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Moncef Gabbouj,et al.  Who is the hero? semi-supervised person re-identification in videos , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[23]  Vittorio Murino,et al.  Symmetry-driven accumulation of local features for human characterization and re-identification , 2013, Comput. Vis. Image Underst..

[24]  Shaogang Gong,et al.  Person re-identification by probabilistic relative distance comparison , 2011, CVPR 2011.

[25]  Xiaogang Wang,et al.  Shape and Appearance Context Modeling , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[26]  T. Kailath The Divergence and Bhattacharyya Distance Measures in Signal Selection , 1967 .

[27]  Shaogang Gong,et al.  Associating Groups of People , 2009, BMVC.

[28]  Xuelong Li,et al.  Person Re-Identification by Regularized Smoothing KISS Metric Learning , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Bingpeng Ma,et al.  BiCov: a novel image representation for person re-identification and face verification , 2012, BMVC.

[30]  Xiao Liu,et al.  Semi-supervised Coupled Dictionary Learning for Person Re-identification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Yun Yang,et al.  Hybrid Sampling-Based Clustering Ensemble With Global and Local Constitutions , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Larry S. Davis,et al.  Learning Discriminative Appearance-Based Models Using Partial Least Squares , 2009, 2009 XXII Brazilian Symposium on Computer Graphics and Image Processing.