Dual-Path Part-Level Method for Visible–Infrared Person Re-identification

Visible–infrared cross-modality person re-identification is a realistic problem of person re-identification. Under poor illumination scenario, general methods of visible–visible person re-identification can not solve the problem well. If we directly compare the visible images of pedestrians captured under dark lighting with the visible images of pedestrians captured under normal light, this extreme color deviation will greatly reduce the recognition ability of the learned representations. In this paper, we propose a dual-path framework for visible–infrared cross-modality person re-identification based human part level features. Feature learning module contains modality-specific dual-path layers and modality-shared human part-level layers, which achieve discriminative global and local representations. In order to better optimize the proposed network, we design a global loss function and a local loss function for the global features and local features, respectively. The two loss functions are integrated together to train the network. We verify the effectiveness of our method on the challenging benchmarks: SYSU-MM01 and RegDB. Experimental results show that, compared with other cross-modality methods, our method has better effect in improving visible–infrared cross-modality person re-identification tasks.

[1]  Kang Ryoung Park,et al.  Person Re-Identification Between Visible and Thermal Camera Images Based on Deep Residual CNN Using Single Input , 2019, IEEE Access.

[2]  Y. Rui,et al.  Learning to Rank Using User Clicks and Visual Features for Image Retrieval , 2015, IEEE Transactions on Cybernetics.

[3]  Shengcai Liao,et al.  Person re-identification by Local Maximal Occurrence representation and metric learning , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Xiong Chen,et al.  Learning Discriminative Features with Multiple Granularities for Person Re-Identification , 2018, ACM Multimedia.

[5]  Pong C. Yuen,et al.  Hierarchical Discriminative Learning for Visible Thermal Person Re-Identification , 2018, AAAI.

[6]  Jian-Huang Lai,et al.  RGB-Infrared Cross-Modality Person Re-identification , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[7]  Ping Tan,et al.  Batch Feature Erasing for Person Re-identification and Beyond , 2018, ArXiv.

[8]  Rongrong Ji,et al.  Cross-Modality Person Re-Identification with Generative Adversarial Training , 2018, IJCAI.

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Yi Li,et al.  Deformable Convolutional Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[11]  Graham W. Taylor,et al.  Adaptive deconvolutional networks for mid and high level feature learning , 2011, 2011 International Conference on Computer Vision.

[12]  Andrew L. Maas.  Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[13]  Xuan Qi,et al.  HPILN: a feature learning framework for cross-modality person re-identification , 2019 .

[14]  Jie Li,et al.  HSME: Hypersphere Manifold Embedding for Visible Thermal Person Re-Identification , 2019, AAAI.

[15]  Lucas Beyer,et al.  In Defense of the Triplet Loss for Person Re-Identification , 2017, ArXiv.

[16]  Yan Huang,et al.  Top-Push Constrained Modality-Adaptive Dictionary Learning for Cross-Modality Person Re-Identification , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Jianhuang Lai,et al.  Learning Modality-Specific Representations for Visible-Infrared Person Re-Identification , 2020, IEEE Transactions on Image Processing.

[18]  Department of Electrical,et al.  Computational and Performance Aspects of PCA-Based Face-Recognition Algorithms , 2001, Perception.

[19]  Tien Dat Nguyen,et al.  Person Recognition System Based on a Combination of Body Images from Visible Light and Thermal Cameras , 2017, Sensors.

[20]  Pong C. Yuen,et al.  Bi-Directional Center-Constrained Top-Ranking for Visible Thermal Person Re-Identification , 2020, IEEE Transactions on Information Forensics and Security.

[21]  Ngai-Man Cheung,et al.  Efficient and Deep Person Re-identification Using Multi-level Similarity , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[22]  Xiaogang Wang,et al.  Learning Deep Feature Representations with Domain Guided Dropout for Person Re-identification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Yung-Yu Chuang,et al.  Learning to Reduce Dual-Level Discrepancy for Infrared-Visible Person Re-Identification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Qingming Huang,et al.  Spatial Pyramid-Enhanced NetVLAD With Weighted Triplet Loss for Place Recognition , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Hao Li,et al.  HPILN: A feature learning framework for cross-modality person re-identification , 2019, IET Image Process..

[26]  Jun Yu,et al.  Hierarchical Deep Click Feature Prediction for Fine-Grained Image Recognition , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Stefanos Zafeiriou,et al.  ArcFace: Additive Angular Margin Loss for Deep Face Recognition , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Yang Yang,et al.  RGB-Infrared Cross-Modality Person Re-Identification via Joint Pixel and Feature Alignment , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[29]  Xiaohai He,et al.  Visible Infrared Cross-Modality Person Re-Identification Network Based on Adaptive Pedestrian Alignment , 2019, IEEE Access.

[30]  Zheng Wang,et al.  Visible Thermal Person Re-Identification via Dual-Constrained Top-Ranking , 2018, IJCAI.

[31]  Xiao Hu,et al.  Person Re-Identification by Deep Learning Muti-Part Information Complementary , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[32]  Qi Tian,et al.  Scalable Person Re-identification: A Benchmark , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[33]  Mang Ye,et al.  Modality-aware Collaborative Learning for Visible Thermal Person Re-Identification , 2019, ACM Multimedia.

[34]  Ning Lv,et al.  Cross-Modality Person Re-Identification Based on Dual-Path Multi-Branch Network , 2019, IEEE Sensors Journal.

[35]  Zhou Yu,et al.  Multimodal Transformer With Multi-View Visual Representation for Image Captioning , 2019, IEEE Transactions on Circuits and Systems for Video Technology.