Person re-identification with multi-level adaptive correspondence models

In this work, we present a multi-level adaptive correspondence model for person re-identification. Coarse segmentation and single level representation carry poorly discriminative information for generating a signature of a target, whilst fine segmentation with a fixed matching fashion is hindered severely by misalignment of corresponding body parts. We address such a dilemma through a multi-level adaptive correspondence scheme. Our approach encodes a pedestrian based on horizontal stripes in multi-level to capture rich visual cues as well as implicit spatial structure. Then dynamic correspondence of stripes within an image pair is conducted. Considering that manually selected weights in the final fusion stage is not advisable, we employ RankSVM to seek a data-driven fusion solution. We demonstrate the effectiveness of our method on two public datasets and another new dataset built for single shot re-identification. Comparisons with state-of-the-art re-identification methods show the superior performance of our approach.

[1]  Per-Erik Forssén,et al.  Maximally Stable Colour Regions for Recognition and Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Jian-Huang Lai,et al.  Raw Trajectory Rectification via Scene-Free Splitting and Stitching , 2015, Journal of Computer Science and Technology.

[3]  Brendan J. Frey,et al.  Stel component analysis: Modeling spatial correlations in image class structure , 2009, CVPR.

[4]  Larry S. Davis,et al.  Learning Discriminative Appearance-Based Models Using Partial Least Squares , 2009, 2009 XXII Brazilian Symposium on Computer Graphics and Image Processing.

[5]  Alessandro Perina,et al.  Person re-identification by symmetry-driven accumulation of local features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Department of Electrical,et al.  Computational and Performance Aspects of PCA-Based Face-Recognition Algorithms , 2001, Perception.

[7]  Hai Tao,et al.  Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features , 2008, ECCV.

[8]  Chun Qi,et al.  Future-data driven modeling of complex backgrounds using mixture of Gaussians , 2013, Neurocomputing.

[9]  Jian-Huang Lai,et al.  Spatial-temporal consistent labeling of tracked pedestrians across non-overlapping camera views , 2011, Pattern Recognit..

[10]  Chunxiao Liu,et al.  On-the-fly feature importance mining for person re-identification , 2014, Pattern Recognit..

[11]  Jian-Huang Lai,et al.  Multi-shot Person Re-identification with Automatic Ambiguity Inference and Removal , 2014, 2014 22nd International Conference on Pattern Recognition.

[12]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[13]  Hongxun Yao,et al.  Affective Image Retrieval via Multi-Graph Learning , 2014, ACM Multimedia.

[14]  Hai Tao,et al.  Evaluating Appearance Models for Recognition, Reacquisition, and Tracking , 2007 .

[15]  Bingpeng Ma,et al.  Covariance descriptor based on bio-inspired features for person re-identification and face verification , 2014, Image Vis. Comput..

[16]  Liang Lin,et al.  Human Re-identification by Matching Compositional Template with Cluster Sampling , 2013, 2013 IEEE International Conference on Computer Vision.

[17]  Yang Li,et al.  Viewpoint Invariant Human Re-Identification in Camera Networks Using Pose Priors and Subject-Discriminative Features , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Shaogang Gong,et al.  Reidentification by Relative Distance Comparison , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Ehud Rivlin,et al.  Color Invariants for Person Reidentification , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Vittorio Murino,et al.  Custom Pictorial Structures for Re-identification , 2011, BMVC.

[22]  Jian-Huang Lai,et al.  Matching of Tracked Pedestrians Across Disjoint Camera Views Using CI-DLBP , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Xiaogang Wang,et al.  Person Re-identification: System Design and Evaluation Overview , 2014, Person Re-Identification.

[24]  Shishir K. Shah,et al.  A survey of approaches and trends in person re-identification , 2014, Image Vis. Comput..

[25]  S. Sathiya Keerthi,et al.  Efficient algorithms for ranking with SVMs , 2010, Information Retrieval.

[26]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Fatih Murat Porikli,et al.  Integral histogram: a fast way to extract histograms in Cartesian spaces , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[28]  Frédéric Jurie,et al.  PCCA: A new approach for distance learning from sparse pairwise constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Shaogang Gong,et al.  Person re-identification by probabilistic relative distance comparison , 2011, CVPR 2011.

[30]  Xiaogang Wang,et al.  Person Re-identification by Salience Matching , 2013, 2013 IEEE International Conference on Computer Vision.

[31]  Hongxun Yao,et al.  Strategy for dynamic 3D depth data matching towards robust action retrieval , 2015, Neurocomputing.

[32]  Kang-Hyun Jo,et al.  Hybrid cascade boosting machine using variant scale blocks based HOG features for pedestrian detection , 2014, Neurocomputing.

[33]  Stéphane Lecoeuche,et al.  Application of an incremental SVM algorithm for on-line human recognition from video surveillance using texture and color features , 2014, Neurocomputing.

[34]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[35]  Slawomir Bak,et al.  Person Re-identification Using Spatial Covariance Regions of Human Body Parts , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[36]  Inderjit S. Dhillon,et al.  Information-theoretic metric learning , 2006, ICML '07.

[37]  Xiaogang Wang,et al.  Locally Aligned Feature Transforms across Views , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Shaogang Gong,et al.  Person Re-Identification by Support Vector Ranking , 2010, BMVC.

[39]  Chunxiao Liu,et al.  Person Re-identification: What Features Are Important? , 2012, ECCV Workshops.

[40]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Shaogang Gong,et al.  Associating Groups of People , 2009, BMVC.

[42]  Xiaogang Wang,et al.  Unsupervised Salience Learning for Person Re-identification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.