A codebook of brightness transfer functions for improved target re-identification across non-overlapping camera views

Target re-identification across non-overlapping camera views is a challenging task due to variations in target appearance, illumination, viewpoint and intrinsic parameters of cameras. Brightness transfer function (BTF) was introduced for intercamera color calibration, and to improve the performance of target re-identification methods. There have been several works based on BTFs, more specifically using weighted BTFs (WBTF), cumulative BTF (CBTF) and mean BTF (MBTF). In this paper, we present a novel method to model the appearance variation across different camera views. We propose building a codebook of BTFs composed of the most representative BTFs for a camera pair. We also propose an ordering and trimming criteria to avoid using all possible combinations of codewords for different color channels. In addition, to obtain a better appearance model, we present a different way to segment a target from the background. Evaluations on VIPeR, CUHK01 and CAVIAR4REID datasets show that the proposed method outperforms other approaches focusing on BTFs, including WBTF, CBTF and MBTF. As proven by the results, the proposed method provides an improved brightness transfer across different camera views, and any target ReID approach incorporating color/brightness histograms can benefit from it.

[1]  Massimo Piccardi,et al.  Matching of Objects Moving Across Disjoint Cameras , 2006, 2006 International Conference on Image Processing.

[2]  Kang-Hyun Jo,et al.  Appearance Feature Based Human Correspondence under Non-overlapping Views , 2009, ICIC.

[3]  Chunxiao Liu,et al.  POP: Person Re-identification Post-rank Optimisation , 2013, 2013 IEEE International Conference on Computer Vision.

[4]  Xiaogang Wang,et al.  Unsupervised Salience Learning for Person Re-identification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Ari Visa,et al.  Shape recognition of irregular objects , 1996, Other Conferences.

[6]  Fatih Murat Porikli,et al.  Inter-camera color calibration by correlation model function , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[7]  Sharath Pankanti,et al.  Appearance modeling for person re-identification using Weighted Brightness Transfer Functions , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[8]  Shaogang Gong,et al.  Towards Person Identification and Re-identification with Attributes , 2012, ECCV Workshops.

[9]  Zhen Li,et al.  Learning Locally-Adaptive Decision Functions for Person Verification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Shaogang Gong,et al.  Person re-identification by probabilistic relative distance comparison , 2011, CVPR 2011.

[11]  Xiaogang Wang,et al.  Learning Mid-level Filters for Person Re-identification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Yongdong Zhang,et al.  Multi-task deep visual-semantic embedding for video thumbnail selection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Xiaogang Wang,et al.  Locally Aligned Feature Transforms across Views , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Hai Tao,et al.  Evaluating Appearance Models for Recognition, Reacquisition, and Tracking , 2007 .

[15]  Shaogang Gong,et al.  Multi-camera Matching using Bi-Directional Cumulative Brightness Transfer Functions , 2008, BMVC.

[16]  Mubarak Shah,et al.  Appearance modeling for tracking in multiple non-overlapping cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Shaogang Gong,et al.  Reidentification by Relative Distance Comparison , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Massimo Piccardi,et al.  A framework for track matching across disjoint cameras using robust shape and appearance features , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[19]  Alessandro Perina,et al.  Person Re-identification Using Robust Brightness Transfer Functions Based on Multiple Detections , 2015, ICIAP.

[20]  Vittorio Murino,et al.  Custom Pictorial Structures for Re-identification , 2011, BMVC.

[21]  Shaogang Gong,et al.  Person Re-Identification by Support Vector Ranking , 2010, BMVC.

[22]  Alessandro Perina,et al.  Person re-identification by symmetry-driven accumulation of local features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Xiaogang Wang,et al.  DeepReID: Deep Filter Pairing Neural Network for Person Re-identification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Xiaogang Wang,et al.  Human Reidentification with Transferred Metric Learning , 2012, ACCV.

[25]  Frédéric Jurie,et al.  PCCA: A new approach for distance learning from sparse pairwise constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  S. R. Mahadeva Prasanna,et al.  Modified Chain Code Histogram Feature for Handwritten Character Recognition , 2012 .

[27]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.