Reranking optimization for person re-identification under temporal-spatial information and common network consistency constraints

Abstract Recent research of person Re-identification (ReID) most focuses on exploring person appearance feature and distance measure between specific camera pair, and seldom considers complex camera network consistence and physical information as supplemental factors for improving the re-identification performance. In this paper, a re-ranking optimization framework under temporal-spatial information and common network consistency constraints is proposed to compensate the accuracy deterioration caused by appearance only based ReID methods in all pairwise cameras. Firstly, a correction function is introduced for describing the influence factor of temporal-spatial information on similarity scores. Then the amended similarity score strategy is provided to tradeoff between the person appearance and temporal-spatial information. Finally the global optimization problem of the jointing temporal-spatial and common consistence constraints is solved by integer programming algorithm. Furthermore, we try to solve the generalized situation where cameras and persons are more random by introducing topology information according to geometry around the cameras, taking the place of network consistency. The experiment results validate that the proposed framework significantly improves performance compared to the other person re-identification methods on the multi-cameras RAiD dataset and TMin dataset both in simple and generalized camera network.

[1]  Yang Hu,et al.  Multi-camera Trajectory Mining: Database and Evaluation , 2014, 2014 22nd International Conference on Pattern Recognition.

[2]  Xiaogang Wang,et al.  Unsupervised Salience Learning for Person Re-identification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Xiaogang Wang,et al.  Learning Deep Feature Representations with Domain Guided Dropout for Person Re-identification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Vittorio Murino,et al.  Custom Pictorial Structures for Re-identification , 2011, BMVC.

[5]  Ehud Rivlin,et al.  Color Invariants for Person Reidentification , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Shengcai Liao,et al.  Person re-identification by Local Maximal Occurrence representation and metric learning , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Pong C. Yuen,et al.  Dynamic Label Graph Matching for Unsupervised Video Re-identification , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[8]  Bingpeng Ma,et al.  Video-Based Pedestrian Re-Identification by Adaptive Spatio-Temporal Appearance Model , 2017, IEEE Transactions on Image Processing.

[9]  Niki Martinel,et al.  Re-identify people in wide area camera network , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[10]  Alessandro Perina,et al.  Person re-identification by symmetry-driven accumulation of local features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Hai Tao,et al.  Evaluating Appearance Models for Recognition, Reacquisition, and Tracking , 2007 .

[12]  Michael Jones,et al.  An improved deep learning architecture for person re-identification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Yan Yang,et al.  Multi-shot person re-identification via relational Stein divergence , 2013, 2013 IEEE International Conference on Image Processing.

[14]  Alexander Schrijver,et al.  Theory of linear and integer programming , 1986, Wiley-Interscience series in discrete mathematics and optimization.

[15]  Wei-Shi Zheng,et al.  Cross-View Asymmetric Metric Learning for Unsupervised Person Re-Identification , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[16]  Michael Lindenbaum,et al.  Learning Implicit Transfer for Person Re-identification , 2012, ECCV Workshops.

[17]  Kaiqi Huang,et al.  Beyond Triplet Loss: A Deep Quadruplet Network for Person Re-identification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Xiaogang Wang,et al.  Human Reidentification with Transferred Metric Learning , 2012, ACCV.

[19]  Chunxiao Liu,et al.  Person Re-identification: What Features Are Important? , 2012, ECCV Workshops.

[20]  Jinhui Tang,et al.  Robust Structured Nonnegative Matrix Factorization for Image Representation , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Vittorio Murino,et al.  Symmetry-driven accumulation of local features for human characterization and re-identification , 2013, Comput. Vis. Image Underst..

[22]  M. Sankaran,et al.  On the non-central chi-square distribution , 1959 .

[23]  Zheng Wang,et al.  Person Reidentification via Ranking Aggregation of Similarity Pulling and Dissimilarity Pushing , 2016, IEEE Transactions on Multimedia.

[24]  Abir Das,et al.  Consistent Re-identification in a Camera Network , 2014, ECCV.

[25]  Bingpeng Ma,et al.  BiCov: a novel image representation for person re-identification and face verification , 2012, BMVC.

[26]  Xiaogang Wang,et al.  Person Re-identification by Salience Matching , 2013, 2013 IEEE International Conference on Computer Vision.

[27]  Zheng Wang,et al.  Camera Network Based Person Re-identification by Leveraging Spatial-Temporal Constraint and Multiple Cameras Relations , 2016, MMM.

[28]  Jun Wang,et al.  Consistency-Driven Alternating Optimization for Multigraph Matching: A Unified Approach , 2015, IEEE Transactions on Image Processing.

[29]  Lin Chen,et al.  Joint Temporal-Spatial Information and Common Network Consistency Constraint for Person Re-identification , 2017, CCCV.

[30]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[31]  Slawomir Bak,et al.  Boosted human re-identification using Riemannian manifolds , 2012, Image Vis. Comput..