Adaptive spatial scale person reidentification

Abstract. Person reidentification (ReID) requires the discriminative features of an entire pedestrian image to handle the problems of inaccurate person bounding box detection, background confusion, and occlusion. Many recent person ReID methods have attempted to learn the feature information of an entire pedestrian image through parts feature representations, but it is often too time consuming. Person ReID relies on discriminative pedestrian features, and different spatial scales can distinguish features by differing degrees. We propose an innovative and effective adaptive spatial scale person ReID network model based on the residual neural network (ResNet) of an instance batch normalization. Through experimental visualizations, pedestrian features extracted by ResNet from four layers are analyzed, and two layers with discriminative features are selected. Using an adaptive dimension adjustment module, different spatial scale features are aggregated and merged by the aggregation layer. To effectively learn spatial channel correlations and prevent overfitting, a multilayer distribution normalization processing module is designed to implement end-to-end training and evaluate the person ReID networks. Compared with other methods, this network model showed excellent performance on four public person ReID datasets and is superior to most current methods.

[1]  Q. Tian,et al.  GLAD: Global-Local-Alignment Descriptor for Pedestrian Retrieval , 2017, ACM Multimedia.

[2]  Yichen Wei,et al.  Circle Loss: A Unified Perspective of Pair Similarity Optimization , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Ngai-Man Cheung,et al.  Efficient and Deep Person Re-identification Using Multi-level Similarity , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Gang Wang,et al.  Dual Attention Matching Network for Context-Aware Feature Sequence Based Person Re-identification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  Xiaogang Wang,et al.  DeepReID: Deep Filter Pairing Neural Network for Person Re-identification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Wei Jiang,et al.  A Strong Baseline and Batch Normalization Neck for Deep Person Re-Identification , 2019, IEEE Transactions on Multimedia.

[7]  Jiaru Lin,et al.  Deep Group-Shuffling Dual Random Walks With Label Smoothing for Person Reidentification , 2020, IEEE Access.

[8]  Rongrong Ji,et al.  Pyramidal Person Re-IDentification via Multi-Loss Dynamic Training , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Shaogang Gong,et al.  Harmonious Attention Network for Person Re-identification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Baopeng Zhang,et al.  Deep attention network for person re-identification with multi-loss , 2019, Comput. Electr. Eng..

[11]  Wei Jiang,et al.  SphereReID: Deep Hypersphere Manifold Embedding for Person Re-Identification , 2018, J. Vis. Commun. Image Represent..

[12]  Qi Tian,et al.  Beyond Part Models: Person Retrieval with Refined Part Pooling , 2017, ECCV.

[13]  Yi Yang,et al.  A Discriminatively Learned CNN Embedding for Person Reidentification , 2016, ACM Trans. Multim. Comput. Commun. Appl..

[14]  Yun Fu,et al.  Toward Resolution-Invariant Person Reidentification via Projective Dictionary Learning , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Cheng Wang,et al.  Mancs: A Multi-task Attentional Network with Curriculum Sampling for Person Re-Identification , 2018, ECCV.

[16]  Francesco Solera,et al.  Performance Measures and a Data Set for Multi-target, Multi-camera Tracking , 2016, ECCV Workshops.

[17]  Yinghuan Shi,et al.  A Mask Based Deep Ranking Neural Network for Person Retrieval , 2019, 2019 IEEE International Conference on Multimedia and Expo (ICME).

[18]  Kaiqi Huang,et al.  Adversarially Occluded Samples for Person Re-identification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[19]  Jian Sun,et al.  AlignedReID: Surpassing Human-Level Performance in Person Re-Identification , 2017, ArXiv.

[20]  Changxin Gao,et al.  Hard sample mining makes person re-identification more efficient and accurate , 2020, Neurocomputing.

[21]  Longhui Wei,et al.  Person Transfer GAN to Bridge Domain Gap for Person Re-identification , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[22]  Carlo Tomasi,et al.  Features for Multi-target Multi-camera Tracking and Re-identification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Muhittin Gokmen,et al.  Human Semantic Parsing for Person Re-identification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[24]  Zhedong Zheng,et al.  CamStyle: A Novel Data Augmentation Method for Person Re-Identification , 2019, IEEE Transactions on Image Processing.

[25]  Yu Song,et al.  Camera viewpoint learning for person reidentification , 2019, J. Electronic Imaging.

[26]  Guodong Wu,et al.  Dual Network Fusion for Person Re-Identification , 2020, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[27]  Yi Yang,et al.  Random Erasing Data Augmentation , 2017, AAAI.

[28]  Xuan Zhang,et al.  SCPNet: Spatial-Channel Parallelism Network for Joint Holistic and Partial Person Re-Identification , 2018, ACCV.

[29]  Yuanyuan Zhang,et al.  Multishot person reidentification using joint group sparse representation , 2018, J. Electronic Imaging.

[30]  Wei Li,et al.  Transferable Joint Attribute-Identity Deep Learning for Unsupervised Person Re-identification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[31]  Pengfei Xu,et al.  Random linear interpolation data augmentation for person re-identification , 2018, Multimedia Tools and Applications.

[32]  Huchuan Lu,et al.  Pose-Invariant Embedding for Deep Person Re-Identification , 2017, IEEE Transactions on Image Processing.

[33]  Yan Huang,et al.  Generated Data With Sparse Regularized Multi-Pseudo Label for Person Re-Identification , 2020, IEEE Signal Processing Letters.

[34]  M. Saquib Sarfraz,et al.  A Pose-Sensitive Embedding for Person Re-identification with Expanded Cross Neighborhood Re-ranking , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[35]  Andrea Cavallaro,et al.  Omni-Scale Feature Learning for Person Re-Identification , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[36]  Lucas Beyer,et al.  In Defense of the Triplet Loss for Person Re-Identification , 2017, ArXiv.

[37]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Ligang Hou,et al.  The Improved Joint Bayesian Method for Person Re-identification Across Different Camera , 2019, J. Inf. Process. Syst..

[39]  Ping Li,et al.  Improving person re-identification by multi-task learning , 2019, Multimedia Tools and Applications.

[40]  Jenq-Neng Hwang,et al.  Effective person re-identification by self-attention model guided feature learning , 2020, Knowl. Based Syst..

[41]  Qiang Wu,et al.  Multi-Pseudo Regularized Label for Generated Data in Person Re-Identification , 2018, IEEE Transactions on Image Processing.

[42]  Xinchen Liu,et al.  FastReID: A Pytorch Toolbox for Real-world Person Re-identification , 2020 .

[43]  Yi Yang,et al.  Image-Image Domain Adaptation with Preserved Self-Similarity and Domain-Dissimilarity for Person Re-identification , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[44]  Zuozhuo Dai,et al.  Batch DropBlock Network for Person Re-Identification and Beyond , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[45]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Qi Tian,et al.  Scalable Person Re-identification: A Benchmark , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[47]  Yi Yang,et al.  Generalizing a Person Retrieval Model Hetero- and Homogeneously , 2018, ECCV.

[48]  Da-Xiang Li,et al.  Learning Large Margin Multiple Granularity Features with an Improved Siamese Network for Person Re-Identification , 2020, Symmetry.

[49]  Yifan Sun,et al.  SVDNet for Pedestrian Retrieval , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[50]  Ling Shao,et al.  Deep Learning for Person Re-Identification: A Survey and Outlook , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Shengyong Chen,et al.  Parts Semantic Segmentation Aware Representation Learning for Person Re-Identification , 2019, Applied Sciences.

[52]  Tariq S. Durrani,et al.  Adversarial Erasing Attention for Person Re-Identification in Camera Networks Under Complex Environments , 2020, IEEE Access.

[53]  Yu Zhao,et al.  Multilevel deep representation fusion for person re-identification , 2020, J. Electronic Imaging.

[54]  Wei Jiang,et al.  AlignedReID++: Dynamically matching local information for person re-identification , 2019, Pattern Recognit..

[55]  Yan Ha,et al.  Part-Based Enhanced Super Resolution Network for Low-Resolution Person Re-Identification , 2020, IEEE Access.

[56]  Tao Xiang,et al.  Pose-Normalized Image Generation for Person Re-identification , 2017, ECCV.

[57]  Wei Jiang,et al.  Bag of Tricks and a Strong Baseline for Deep Person Re-Identification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[58]  Fang Ming,et al.  An Improved Deep Mutual-Attention Learning Model for Person Re-Identification , 2020, Symmetry.