A Weighted Center Graph Fusion Method for Person Re-Identification

Feature fusion is widely used in person re-identification (re-ID) and has been proven effective. However, it is difficult to know which features are effective to identify a specific person and how to fuse features to explore complementary information and apply the advantages of each feature. Motivated by these problems, this paper proposes a new method of person re-ID to fuse the recognition results of multiple features at the rank level. Three innovations are included in this method: first, multiple metric spaces are constructed based on the correlation of different features to generate multiple rank results; second, the most similar candidates in each corresponding rank list is converted into a graph structure by our proposed weighted center graph (WCG), and we use an adaptive value $K$ to automatically seek the most similar images of each query, thus improving the accuracy of candidate targets. Finally, to evaluate the effect of each WCG, a discriminative power coefficient is designed and used to assign a proper coefficient for each WCG according to the discriminative power of corresponding features. The result can be obtained by re-ranking the fused WCG. The extensive experiments on five datasets demonstrate the matching rate of our proposed method by comparing with several state-of-the-art methods. Our code is available at https://github.com/gengshuze/WCG.git.

[1]  Qi Tian,et al.  Enhancing Person Re-identification in a Self-Trained Subspace , 2017, ACM Trans. Multim. Comput. Commun. Appl..

[2]  Tao Xiang,et al.  Pose-Normalized Image Generation for Person Re-identification , 2017, ECCV.

[3]  Shiliang Zhang,et al.  Pose-Driven Deep Convolutional Model for Person Re-identification , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  Hua Yang,et al.  Resolution adaptive feature extracting and fusing framework for person re-identification , 2016, Neurocomputing.

[5]  Qiuqi Ruan,et al.  Multiple metric learning with query adaptive weights and multi-task re-weighting for person re-identification , 2017, Comput. Vis. Image Underst..

[6]  Tao Xiang,et al.  Multi-scale Deep Learning Architectures for Person Re-identification , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[7]  Yonghua Li,et al.  Density-Adaptive Kernel based Re-Ranking for Person Re-Identification , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[8]  Gang Wang,et al.  Person Re-identification with Cascaded Pairwise Convolutions , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Alberto Del Bimbo,et al.  Person Re-Identification by Iterative Re-Weighted Sparse Ranking , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Shengcai Liao,et al.  Person re-identification by Local Maximal Occurrence representation and metric learning , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Anton van den Hengel,et al.  Learning to rank in person re-identification with metric ensembles , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Renjie Huang,et al.  Person Re-Identification by Optimally Organizing Multiple Similarity Measures , 2017, IEEE Access.

[13]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Sergio Escalera,et al.  Action Recognition from RGB-D Data: Comparison and Fusion of Spatio-Temporal Handcrafted Features and Deep Strategies , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[15]  Fei Xiong,et al.  Person Re-Identification Using Kernel-Based Metric Learning Methods , 2014, ECCV.

[16]  Qi Tian,et al.  An Adaptive Multi-Projection Metric Learning for Person Re-Identification Across Non-Overlapping Cameras , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Xiaogang Wang,et al.  Joint Detection and Identification Feature Learning for Person Search , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Yi Yang,et al.  Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in Vitro , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[19]  Dacheng Tao,et al.  Person Re-Identification With Metric Learning Using Privileged Information. , 2018, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[20]  Lin Wu,et al.  Structured learning of metric ensembles with application to person re-identification , 2015, Comput. Vis. Image Underst..

[21]  Rui Yu,et al.  Hard-Aware Point-to-Set Deep Metric for Person Re-identification , 2018, ECCV.

[22]  William Robson Schwartz,et al.  CBRA: Color-based ranking aggregation for person re-identification , 2015, ICIP.

[23]  Kaiqi Huang,et al.  Learning Deep Context-Aware Features over Body and Latent Parts for Person Re-identification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Jin Wang,et al.  Equidistance constrained metric learning for person re-identification , 2018, Pattern Recognit..

[25]  Shuang Wu,et al.  Graph Correspondence Transfer for Person Re-identification , 2018, AAAI.

[26]  Ying Chen,et al.  Multi-directional saliency metric learning for person re-identification , 2016, IET Comput. Vis..

[27]  Shaogang Gong,et al.  Person Re-identification by Deep Learning Multi-scale Representations , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[28]  Rui Yu,et al.  Divide and Fuse: A Re-ranking Approach for Person Re-identification , 2017, BMVC.

[29]  Bin Luo,et al.  A Subspace Learning Approach to Multishot Person Reidentification , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[30]  Huchuan Lu,et al.  Pose-Invariant Embedding for Deep Person Re-Identification , 2017, IEEE Transactions on Image Processing.

[31]  Liang Zheng,et al.  Re-ranking Person Re-identification with k-Reciprocal Encoding , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Longhui Wei,et al.  GLAD: Global–Local-Alignment Descriptor for Scalable Person Re-Identification , 2019, IEEE Transactions on Multimedia.

[33]  Peng Wang,et al.  Person re-identification post-rank optimization via hypergraph-based learning , 2018, Neurocomputing.

[34]  Shaogang Gong,et al.  Reidentification by Relative Distance Comparison , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Frédéric Jurie,et al.  PCCA: A new approach for distance learning from sparse pairwise constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Wen Gao,et al.  Multi-Task Learning with Low Rank Attribute Embedding for Multi-Camera Person Re-Identification , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Jian-Huang Lai,et al.  Person Re-Identification by Camera Correlation Aware Feature Augmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Qi Tian,et al.  Query-adaptive late fusion for image search and person re-identification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Hai Tao,et al.  Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features , 2008, ECCV.

[40]  Haiqing Li,et al.  Deep Spatial Feature Reconstruction for Partial Person Re-identification: Alignment-free Approach , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[41]  Ping Lu,et al.  Learning Multiple Kernel Metrics for Iterative Person Re-Identification , 2018, ACM Trans. Multim. Comput. Commun. Appl..

[42]  Zhihua Wei,et al.  Fusion of multiple channel features for person re-identification , 2016, Neurocomputing.

[43]  Shuicheng Yan,et al.  End-to-End Comparative Attention Networks for Person Re-Identification , 2016, IEEE Transactions on Image Processing.

[44]  Xiaogang Wang,et al.  Person Re-Identification by Saliency Learning , 2014 .

[45]  Yang Hua,et al.  Cross-View Discriminative Feature Learning for Person Re-Identification , 2018, IEEE Transactions on Image Processing.

[46]  Zhihui Li,et al.  Fusion of Multiple Person Re-id Methods With Model and Data-Aware Abilities , 2020, IEEE Transactions on Cybernetics.

[47]  Jiahuan Zhou,et al.  Efficient Online Local Metric Adaptation via Negative Samples for Person Re-identification , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[48]  Xiaogang Wang,et al.  Spindle Net: Person Re-identification with Human Body Region Guided Feature Decomposition and Fusion , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  Barbara Caputo,et al.  Looking beyond appearances: Synthetic training data for deep CNNs in re-identification , 2017, Comput. Vis. Image Underst..

[50]  Larry S. Davis,et al.  Multi-Task Learning with Low Rank Attribute Embedding for Person Re-Identification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[51]  Octavia I. Camps,et al.  DukeMTMC4ReID: A Large-Scale Multi-camera Person Re-identification Dataset , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[52]  Xiaojing Chen,et al.  Person Re-identification by Multi-hypergraph Fusion , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[53]  Qi Tian,et al.  Robust ImageGraph: Rank-Level Feature Fusion for Image Search , 2017, IEEE Transactions on Image Processing.

[54]  Honggang Zhang,et al.  Spatial Pyramid-Based Statistical Features for Person Re-Identification: A Comprehensive Evaluation , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[55]  Bingbing Ni,et al.  Pose Transferrable Person Re-identification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[56]  Alberto Del Bimbo,et al.  Multichannel-Kernel Canonical Correlation Analysis for Cross-View Person Reidentification , 2016, ACM Trans. Multim. Comput. Commun. Appl..

[57]  David Zhang,et al.  Maximal granularity structure and generalized multi-view discriminant analysis for person re-identification , 2018, Pattern Recognit..

[58]  Ziyan Wu,et al.  A Systematic Evaluation and Benchmark for Person Re-Identification: Features, Metrics, and Datasets , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  Wen Fang,et al.  A person re-identification algorithm based on pyramid color topology feature , 2017, Multimedia Tools and Applications.

[60]  Qi Tian,et al.  Scalable Person Re-identification: A Benchmark , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[61]  Takahiro Okabe,et al.  Hierarchical Gaussian Descriptor for Person Re-identification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).