Spatial segment-aware clustering based dynamic reliability threshold determination (SSC-DRTD) for unsupervised person re-identification

Abstract Person Re-Identification (re-ID) in a crowded multi-camera surveillance environment is a highly challenging task. The traditional benchmark datasets contain less number of occluded images due to the pre-planned setup and limited duration of the videos recorded. Unlike the traditional benchmark person re-ID datasets, real-world surveillance environment possess high static and dynamic occlusions. The analysis of different image segments captured in diverse environments by using a static reliability threshold leads to a poor matching accuracy. To resolve this issue of poor reliability threshold determination and to handle the occluded person re-ID images efficiently, we propose an unsupervised spatial segmented clustering model (SSC-DRTD) which determines a dynamic segment-wise reliability threshold. The unlabeled person re-ID images are segmented into k-parts to determine the segment-wise reliability threshold and the optimal number of segments for a given dataset. A cluster refinement strategy is proposed by incorporating the determined dynamic reliability threshold values to match the occluded noisy images with its appropriate ground truth identities for robust cluster formation. An improved rank evaluation has been performed on the benchmark person re-ID datasets such as DukeMTMC re-ID, Market1501, CUHK03, and MSMT17. The experimental results show the improved performance of our proposed SSC-DRTD model in handling occluded person re-ID images over the state-of-the-art unsupervised person re-ID methods. To further prove the efficiency of our proposed model, an exploratory analysis is performed by increasing the number of occluded query images to simulate the real-world surveillance scenario.

[1]  Haifeng Hu,et al.  Enhanced multi-dataset transfer learning method for unsupervised person re-identification using co-training strategy , 2018, IET Comput. Vis..

[2]  Yu Liu,et al.  Region-based Quality Estimation Network for Large-scale Person Re-identification , 2017, AAAI.

[3]  Longhui Wei,et al.  Person Transfer GAN to Bridge Domain Gap for Person Re-identification , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Yi Yang,et al.  Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in Vitro , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[5]  End-to-End Comparative Attention Networks for Person Re-Identification. , 2017 .

[6]  Tariq S. Durrani,et al.  Fuzzy Multilayer Clustering and Fuzzy Label Regularization for Unsupervised Person Reidentification , 2020, IEEE Transactions on Fuzzy Systems.

[7]  Mang Ye,et al.  A Survey of Open-World Person Re-Identification , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Bingbing Ni,et al.  Person Re-identification via Recurrent Feature Aggregation , 2016, ECCV.

[9]  Shishir K. Shah,et al.  Part-based spatio-temporal model for multi-person re-identification , 2012, Pattern Recognit. Lett..

[10]  Xiaokang Zhang,et al.  Semantic-Aware Occlusion-Robust Network for Occluded Person Re-Identification , 2021, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Xianglei Xing,et al.  A Survey of Person Re-identification Based on Deep Learning , 2018, CAAI Trans. Intell. Technol..

[12]  Nanning Zheng,et al.  Similarity Learning with Spatial Constraints for Person Re-identification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Hantao Yao,et al.  Deep Representation Learning With Part Loss for Person Re-Identification , 2017, IEEE Transactions on Image Processing.

[14]  Junwei Han,et al.  DHSNet: Deep Hierarchical Saliency Network for Salient Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Jian Lu,et al.  Centralized and Clustered Features for Person Re-Identification , 2019, IEEE Signal Processing Letters.

[16]  Shaogang Gong,et al.  The Re-identification Challenge , 2014, Person Re-Identification.

[17]  Shaogang Gong,et al.  Unsupervised Cross-Dataset Transfer Learning for Person Re-identification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Wei-Shi Zheng,et al.  Cross-View Asymmetric Metric Learning for Unsupervised Person Re-Identification , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[19]  Jing Xu,et al.  Attention-Aware Compositional Network for Person Re-identification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[20]  Xiong Chen,et al.  Learning Discriminative Features with Multiple Granularities for Person Re-Identification , 2018, ACM Multimedia.

[21]  Shaogang Gong,et al.  Deep Association Learning for Unsupervised Video Person Re-identification , 2018, BMVC.

[22]  Liang Wang,et al.  Mask-Guided Contrastive Attention Model for Person Re-identification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Huchuan Lu,et al.  Pose-Invariant Embedding for Deep Person Re-Identification , 2017, IEEE Transactions on Image Processing.

[24]  Jian-Huang Lai,et al.  Occluded Person Re-Identification , 2018, 2018 IEEE International Conference on Multimedia and Expo (ICME).

[25]  Guang Yang,et al.  SaliencyGAN: Deep Learning Semisupervised Salient Object Detection in the Fog of IoT , 2020, IEEE Transactions on Industrial Informatics.

[26]  Huchuan Lu,et al.  Robust object tracking via sparsity-based collaborative model , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Shaogang Gong,et al.  Harmonious Attention Network for Person Re-identification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[28]  Jian-Huang Lai,et al.  Robust Depth-Based Person Re-Identification , 2017, IEEE Transactions on Image Processing.

[29]  Liaoying Zhao,et al.  Dual attention-based method for occluded person re-identification , 2020, Knowl. Based Syst..

[30]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Qi Tian,et al.  Scalable Person Re-identification: A Benchmark , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[32]  Shaogang Gong,et al.  Person Re-Identification by Deep Joint Learning of Multi-Loss Classification , 2017, IJCAI.

[33]  Zoran Kalafatic,et al.  Protecting the privacy of humans in video sequences using a computer vision-based de-identification pipeline , 2017, Expert Syst. Appl..

[34]  Kaiqi Huang,et al.  Learning Deep Context-Aware Features over Body and Latent Parts for Person Re-identification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Andrea Cavallaro,et al.  Person re-identification in crowd , 2012, Pattern Recognit. Lett..

[36]  Xiaogang Wang,et al.  DeepReID: Deep Filter Pairing Neural Network for Person Re-identification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Slawomir Bak,et al.  Domain Adaptation through Synthesis for Unsupervised Person Re-identification , 2018, ECCV.

[38]  François Brémond,et al.  Multi-shot Person Re-Identification Using Part Appearance Mixture , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[39]  Haiqing Li,et al.  Deep Spatial Feature Reconstruction for Partial Person Re-identification: Alignment-free Approach , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[40]  Shishir K. Shah,et al.  A survey of approaches and trends in person re-identification , 2014, Image Vis. Comput..

[41]  Eric Granger,et al.  Progressive Boosting for Class Imbalance , 2017, Expert Syst. Appl..