Dual-Stream Reciprocal Disentanglement Learning for Domain Adaption Person Re-Identification

Since human-labeled samples are free for the target set, unsupervised person re-identification (Re-ID) has attracted much attention in recent years, by additionally exploiting the source set. However, due to the differences on camera styles, illumination and backgrounds, there exists a large gap between source domain and target domain, introducing a great challenge on cross-domain matching. To tackle this problem, in this paper we propose a novel method named Dual-stream Reciprocal Disentanglement Learning (DRDL), which is quite efficient in learning domain-invariant features. In DRDL, two encoders are first constructed for id-related and id-unrelated feature extractions, which are respectively measured by their associated classifiers. Furthermore, followed by an adversarial learning strategy, both streams reciprocally and positively effect each other, so that the id-related features and id-unrelated features are completely disentangled from a given image, allowing the encoder to be powerful enough to obtain the discriminative but domain-invariant features. In contrast to existing approaches, our proposed method is free from image generation, which not only reduces the computational complexity remarkably, but also removes redundant information from id-related features. Extensive experiments substantiate the superiority of our proposed method compared with the state-of-the-arts. The source code has been released in this https URL.

[1]  David Zhang,et al.  A Probabilistic Hierarchical Model for Multi-View and Multi-Feature Classification , 2018, AAAI.

[2]  Lei Zhang,et al.  Unsupervised Domain Adaptation Using Robust Class-Wise Matching , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Zhiming Luo,et al.  Leveraging Virtual and Real Person for Unsupervised Person Re-Identification , 2018, IEEE Transactions on Multimedia.

[4]  Yu Liu,et al.  Exploring Disentangled Feature Representation Beyond Face Identification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  Wei-Shi Zheng,et al.  Cross-View Asymmetric Metric Learning for Unsupervised Person Re-Identification , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[6]  Zhiming Luo,et al.  Invariance Matters: Exemplar Memory for Domain Adaptive Person Re-Identification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[8]  Shengcai Liao,et al.  Deep Hybrid Similarity Learning for Person Re-Identification , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Rajiv Kapoor,et al.  An Efficient Approach for the Recognition of Hand Gestures from Very Low Resolution Images , 2015, 2015 Fifth International Conference on Communication Systems and Network Technologies.

[10]  Rongrong Ji,et al.  Asymmetric Co-Teaching for Unsupervised Cross Domain Person Re-Identification , 2019, AAAI.

[11]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[12]  Dinesh Kumar Vishwakarma,et al.  State-of-the-Arts Person Re-Identification Using Deep Learning , 2019, 2019 6th International Conference on Signal Processing and Integrated Networks (SPIN).

[13]  Ling-Yu Duan,et al.  IDM: An Intermediate Domain Module for Domain Adaptive Person Re-ID , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[14]  Biao Hou,et al.  Distance constraint between features for unsupervised domain adaptive person re-identification , 2021, Neurocomputing.

[15]  Dinesh Kumar Vishwakarma,et al.  View-Invariant Deep Architecture for Human Action Recognition Using Two-Stream Motion and Shape Temporal Dynamics , 2020, IEEE Transactions on Image Processing.

[16]  Qiang Wu,et al.  Beyond Scalar Neuron: Adopting Vector-Neuron Capsules for Long-Term Person Re-Identification , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Alexander Wong,et al.  Unsupervised Domain Adaptation in Person re-ID via k-Reciprocal Clustering and Large-Scale Heterogeneous Environment Synthesis , 2020, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[18]  Shaogang Gong,et al.  Reidentification by Relative Distance Comparison , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Wei Jiang,et al.  Bag of Tricks and a Strong Baseline for Deep Person Re-Identification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[20]  Gang Hua,et al.  Calibrated Domain-Invariant Learning for Highly Generalizable Large Scale Re-Identification , 2019, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[21]  Liang Zheng,et al.  Unsupervised Person Re-identification: Clustering and Fine-tuning , 2017 .

[22]  Shengcai Liao,et al.  Salient Color Names for Person Re-identification , 2014, ECCV.

[23]  Yaohua Wang,et al.  Hierarchical Clustering With Hard-Batch Triplet Loss for Person Re-Identification , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Yuxin Peng,et al.  Unsupervised Cross-Media Retrieval Using Domain Adaptation With Scene Graph , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Hai He,et al.  Unsupervised Domain Adaptation via Importance Sampling , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Wei Li,et al.  Transferable Joint Attribute-Identity Deep Learning for Unsupervised Person Re-identification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[27]  Yunchao Wei,et al.  Self-Similarity Grouping: A Simple Unsupervised Cross Domain Adaptation Approach for Person Re-Identification , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[28]  Longhui Wei,et al.  Person Transfer GAN to Bridge Domain Gap for Person Re-identification , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[29]  Xiaogang Wang,et al.  Shape and Appearance Context Modeling , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[30]  Quoc V. Le,et al.  AutoHAS: Efficient Hyperparameter and Architecture Search. , 2020 .

[31]  Yi Yang,et al.  Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in Vitro , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[32]  Yi Yang,et al.  Random Erasing Data Augmentation , 2017, AAAI.

[33]  Dapeng Tao,et al.  Cross adversarial consistency self-prediction learning for unsupervised domain adaptation person re-identification , 2021, Information Sciences.

[34]  Yi Zhong,et al.  SBSGAN: Suppression of Inter-Domain Background Shift for Person Re-Identification , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[35]  Tariq S. Durrani,et al.  Fuzzy Multilayer Clustering and Fuzzy Label Regularization for Unsupervised Person Reidentification , 2020, IEEE Transactions on Fuzzy Systems.

[36]  Hongsheng Li,et al.  Self-paced Contrastive Learning with Hybrid Memory for Domain Adaptive Object Re-ID , 2020, NeurIPS.

[37]  Shaogang Gong,et al.  International Journal of Computer Vision (The original publication is available at www.springerlink.com) Time-Delayed Correlation Analysis for Multi-Camera Activity Understanding , 2009 .

[38]  Ling Shao,et al.  Unsupervised Domain Adaptation with Noise Resistible Mutual-Training for Person Re-identification , 2020, ECCV.

[39]  Shengcai Liao,et al.  Person re-identification by Local Maximal Occurrence representation and metric learning , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[41]  Dapeng Chen,et al.  Mutual Mean-Teaching: Pseudo Label Refinery for Unsupervised Domain Adaptation on Person Re-identification , 2020, ICLR.

[42]  Shaogang Gong,et al.  Instance-Guided Context Rendering for Cross-Domain Person Re-Identification , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[43]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Jian-Huang Lai,et al.  Unsupervised Person Re-Identification by Camera-Aware Similarity Consistency Learning , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[45]  Feng Wu,et al.  DRPL: Deep Regression Pair Learning for Multi-Focus Image Fusion , 2020, IEEE Transactions on Image Processing.

[46]  Zheng-Jun Zha,et al.  Adaptive Transfer Network for Cross-Domain Person Re-Identification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Jan Kautz,et al.  Multimodal Unsupervised Image-to-Image Translation , 2018, ECCV.

[48]  Rajiv Kapoor,et al.  Integrated approach for human action recognition using edge spatial distribution, direction pixel and -transform , 2015, Adv. Robotics.

[49]  Qi Tian,et al.  Scalable Person Re-identification: A Benchmark , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[50]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[51]  Mang Ye,et al.  A Survey of Open-World Person Re-Identification , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[52]  Dinesh Kumar Vishwakarma,et al.  A Deep Structure of Person Re-Identification Using Multi-Level Gaussian Models , 2018, IEEE Transactions on Multi-Scale Computing Systems.

[53]  Francesco Solera,et al.  Performance Measures and a Data Set for Multi-target, Multi-camera Tracking , 2016, ECCV Workshops.

[54]  Hongtao Lu,et al.  Attribute-Driven Feature Disentangling and Temporal Aggregation for Video Person Re-Identification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[55]  Shiliang Zhang,et al.  Unsupervised Person Re-Identification via Multi-Label Classification , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[56]  Yang Zou,et al.  Joint Disentangling and Adaptation for Cross-Domain Person Re-Identification , 2020, ECCV.

[57]  Cuiling Lan,et al.  Style Normalization and Restitution for Generalizable Person Re-Identification , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[58]  Dinesh Kumar Vishwakarma,et al.  Person Re-Identification using Deep Learning Networks: A Systematic Review , 2020, ArXiv.

[59]  Cheng Wang,et al.  Unsupervised Domain Adaptive Re-Identification: Theory and Practice , 2018, Pattern Recognit..

[60]  Yu-Chiang Frank Wang,et al.  Cross-Dataset Person Re-Identification via Unsupervised Pose Disentanglement and Adaptation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[61]  Tao Xiang,et al.  Disjoint Label Space Transfer Learning with Common Factorised Space , 2018, AAAI.

[62]  David Zhang,et al.  Shared Autoencoder Gaussian Process Latent Variable Model for Visual Classification , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[63]  Horst Bischof,et al.  Person Re-identification by Descriptive and Discriminative Classification , 2011, SCIA.

[64]  Changick Kim,et al.  Hi-CMD: Hierarchical Cross-Modality Disentanglement for Visible-Infrared Person Re-Identification , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[65]  Rongrong Ji,et al.  Multiple Expert Brainstorming for Domain Adaptive Person Re-identification , 2020, ECCV.

[66]  Wei-Shi Zheng,et al.  Patch-Based Discriminative Feature Learning for Unsupervised Person Re-Identification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[67]  Yi Yang,et al.  Image-Image Domain Adaptation with Preserved Self-Similarity and Domain-Dissimilarity for Person Re-identification , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[68]  Jiebo Luo,et al.  Structure alignment of attributes and visual features for cross-dataset person re-identification , 2020, Pattern Recognit..

[69]  Tej Singh,et al.  A visual cognizance based multi-resolution descriptor for human action recognition using key pose , 2019, AEU - International Journal of Electronics and Communications.

[70]  Jane You,et al.  Relaxed Asymmetric Deep Hashing Learning: Point-to-Angle Matching , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[71]  Daniel Rueckert,et al.  Mutual Information-Based Disentangled Neural Networks for Classifying Unseen Categories in Different Domains: Application to Fetal Ultrasound Imaging , 2021, IEEE Transactions on Medical Imaging.

[72]  Zhen Lei,et al.  Domain Adaptive Person Re-Identification via Camera Style Generation and Label Propagation , 2019, IEEE Transactions on Information Forensics and Security.

[73]  Wei-Shi Zheng,et al.  Unsupervised Person Re-Identification by Deep Asymmetric Metric Embedding , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[74]  Zhedong Zheng,et al.  Joint Discriminative and Generative Learning for Person Re-Identification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).