Re-ranking person re-identification using distance aggregation of k-nearest neighbors hierarchical tree

Person re-identification is a challenging task due to the critical factors like illumination, occlusion, pose variation, view-points, low resolution, inter/intra-class variations, etc. Re-identification mainly treated as the target retrieval process, which can be improved by multi-query and re-ranking. Due to the high computational cost and consideration of fixed length gallery size, existing re-ranking approaches are not feasible for real-time re-identification applications, specifically with the variable-length gallery. We have proposed a fast yet effective re-ranking approach that utilize the pre-computed pair-wise distance used for initial ranking. We have integrated the advantages of nearest neighbors, hierarchical tree, and multi-query for re-ranking. We hypothesize that the hierarchy of k-nearest neighbors of an image leads to more positive matches in the child layer. Hence the aggregated distance decreases for true match and increases for false match images of the initial rank. We have structured k-nearest neighbor’s hierarchical tree and calculated the aggregated distance. Hierarchical nearest neighbors are treated as multi-query under distance aggregation. Final re-ranked distance is computed as the weighted sum of aggregated and actual distance. Our proposed re-ranking approach is computationally efficient, feasible for real-time applications, unsupervised, and completely automatic. The effectiveness of our proposed method (Source code isavailable upon request) has been verified by various experiments on MARS, Market-1501, DukeMTMC, and CUHK03 datasets.

[1]  Qi Tian,et al.  Ensemble Diffusion for Retrieval , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[2]  Qi Tian,et al.  Scalable Person Re-identification on Supervised Smoothed Manifold , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Ying Chen,et al.  Person re-identification based on re-ranking with expanded k-reciprocal nearest neighbors , 2019, J. Vis. Commun. Image Represent..

[4]  Jie Liu,et al.  A spatial and temporal features mixture model with body parts for video-based person re-identification , 2019, Applied Intelligence.

[5]  Qi Tian,et al.  Scalable Person Re-identification: A Benchmark , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Andrew Zisserman,et al.  Multiple queries for large scale specific object retrieval , 2012, BMVC.

[7]  Shaogang Gong,et al.  Person Re-Identification by Deep Joint Learning of Multi-Loss Classification , 2017, IJCAI.

[8]  Jin Young Choi,et al.  Re-ranking with ranking-reflected similarity for person re-identification , 2019, Pattern Recognit. Lett..

[9]  Cordelia Schmid,et al.  A contextual dissimilarity measure for accurate and efficient image search , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Kaiqi Huang,et al.  Learning Deep Context-Aware Features over Body and Latent Parts for Person Re-identification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Ray A. Jarvis,et al.  Clustering Using a Similarity Measure Based on Shared Near Neighbors , 1973, IEEE Transactions on Computers.

[12]  Ihsan Ullah,et al.  Survey on Deep Learning Techniques for Person Re-Identification Task , 2018, ArXiv.

[13]  Yi Yang,et al.  Person Re-identification: Past, Present and Future , 2016, ArXiv.

[14]  Liang Zheng,et al.  Re-ranking Person Re-identification with k-Reciprocal Encoding , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Shishir K. Shah,et al.  A survey of approaches and trends in person re-identification , 2014, Image Vis. Comput..

[16]  Shengcai Liao,et al.  Person re-identification by Local Maximal Occurrence representation and metric learning , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Qi Tian,et al.  Person Re-identification in the Wild , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Alfredo Gardel Vicente,et al.  Person Re-Identification Ranking Optimisation by Discriminant Context Information Analysis , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Shengcai Liao,et al.  Efficient PSD Constrained Asymmetric Metric Learning for Person Re-Identification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[20]  Andrew Zisserman,et al.  Three things everyone should know to improve object retrieval , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Nanning Zheng,et al.  Similarity Learning with Spatial Constraints for Person Re-identification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Zheng Wang,et al.  Person Reidentification via Ranking Aggregation of Similarity Pulling and Dissimilarity Pushing , 2016, IEEE Transactions on Multimedia.

[23]  Kenji Mase,et al.  People Re-Identification with Local Distance Comparison Using Learned Metric , 2014, IEICE Trans. Inf. Syst..

[24]  M. Saquib Sarfraz,et al.  A Pose-Sensitive Embedding for Person Re-identification with Expanded Cross Neighborhood Re-ranking , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[25]  Lucas Beyer,et al.  In Defense of the Triplet Loss for Person Re-Identification , 2017, ArXiv.

[26]  Jianbin Jiao,et al.  Impostor Resilient Multimodal Metric Learning for Person Reidentification , 2018, Adv. Multim..

[27]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Dong Xu,et al.  Distance Metric Learning Using Privileged Information for Face Verification and Person Re-Identification , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Ping Feng,et al.  Deep multi-instance learning for end-to-end person re-identification , 2017, Multimedia Tools and Applications.

[30]  Francesco Solera,et al.  Performance Measures and a Data Set for Multi-target, Multi-camera Tracking , 2016, ECCV Workshops.

[31]  Chokri Ben Amar,et al.  Deep salient-Gaussian Fisher vector encoding of the spatio-temporal trajectory structures for person re-identification , 2018, Multimedia Tools and Applications.

[32]  Mohammad Rahmati,et al.  Neither Global Nor Local: A Hierarchical Robust Subspace Clustering For Image Data , 2019, Inf. Sci..

[33]  Michael Isard,et al.  Total Recall: Automatic Query Expansion with a Generative Feature Model for Object Retrieval , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[34]  Frédéric Jurie,et al.  PCCA: A new approach for distance learning from sparse pairwise constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Ping Li,et al.  Improving person re-identification by multi-task learning , 2019, Multimedia Tools and Applications.

[36]  Ying Wu,et al.  Object retrieval and localization with spatially-constrained similarity measure and k-NN re-ranking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[38]  Xiaojing Chen,et al.  Integrating appearance features and soft biometrics for person re-identification , 2016, Multimedia Tools and Applications.

[39]  Masayuki Mukunoki,et al.  Common-near-neighbor analysis for person re-identification , 2012, 2012 19th IEEE International Conference on Image Processing.

[40]  Shaogang Gong,et al.  Harmonious Attention Network for Person Re-identification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[41]  Xiaogang Wang,et al.  DeepReID: Deep Filter Pairing Neural Network for Person Re-identification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Zheng Wang,et al.  Coupled-View Based Ranking Optimization for Person Re-identification , 2015, MMM.

[43]  Maozhen Li,et al.  RRGCCAN: Re-Ranking via Graph Convolution Channel Attention Network for Person Re-Identification , 2020, IEEE Access.

[44]  Yimin Wang,et al.  Person re-identification with content and context re-ranking , 2015, Multimedia Tools and Applications.

[45]  Muhammad Haroon Yousaf,et al.  Shadow Detection for Vehicle Classification in Urban Environments , 2017, ICIAR.

[46]  Chunxiao Liu,et al.  POP: Person Re-identification Post-rank Optimisation , 2013, 2013 IEEE International Conference on Computer Vision.

[47]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Murtaza Taj,et al.  Point Cloud Segmentation Using Hierarchical Tree for Architectural Models , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[49]  Qi Tian,et al.  MARS: A Video Benchmark for Large-Scale Person Re-Identification , 2016, ECCV.

[50]  Song Bai,et al.  Sparse Contextual Activation for Efficient Visual Re-Ranking , 2016, IEEE Transactions on Image Processing.

[51]  Shaogang Gong,et al.  Human-in-the-Loop Person Re-identification , 2016, ECCV.

[52]  Horst Bischof,et al.  Relaxed Pairwise Learned Metric for Person Re-identification , 2012, ECCV.

[53]  Luc Van Gool,et al.  Hello neighbor: Accurate object retrieval with k-reciprocal nearest neighbors , 2011, CVPR 2011.