Improving person re-identification systems: a novel score fusion framework for rank-n recognition

Person re-identification is an essential technique for video surveillance applications. Most existing algorithms for person re-identification deal with feature extraction, metric learning or a combination of both. Combining successful state-of-the-art methods using score fusion from the perspective of person re-identification has not yet been widely explored. In this paper, we endeavor to boost the performance of existing systems by combining them using a novel score fusion framework which requires no training or dataset-dependent tuning of parameters. We develop a robust and efficient method called Unsupervised Posterior Probability-based Score Fusion (UPPSF) for combination of raw scores obtained from multiple existing person re-identification algorithms in order to achieve superior recognition rates. We propose two novel generalized linear models for estimating the posterior probabilities of a given probe image matching each of the gallery images. Normalization and combination of these posterior probability values computed from each of the existing algorithms individually, yields a set of unified scores, which is then used for ranking the gallery images. Our score fusion framework is inherently capable of dealing with different ranges and distributions of matching scores emanating from existing algorithms, without requiring any prior knowledge about the algorithms themselves, effectively treating them as "black-box" methods. Experiments on widely-used challenging datasets like VIPeR, CUHK01, CUHK03, ETHZ1 and ETHZ2 demonstrate the efficiency of UPPSF in combining multiple algorithms at the score level.

[1]  Xiaogang Wang,et al.  DeepReID: Deep Filter Pairing Neural Network for Person Re-identification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Zhen Li,et al.  Learning Locally-Adaptive Decision Functions for Person Verification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Xiaogang Wang,et al.  Human Reidentification with Transferred Metric Learning , 2012, ACCV.

[4]  Qi Tian,et al.  Query-adaptive late fusion for image search and person re-identification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Petros Maragos,et al.  Computer vision -- ECCV 2010 : 11th European Conference on Computer Vision, Heraklion, Crete, Greece, September 5 - 11, 2010 : proceedings , 2010, ECCV 2010.

[6]  Julian Fiérrez,et al.  Target dependent score normalization techniques and their application to signature verification , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[7]  Ming Yang,et al.  Query Specific Rank Fusion for Image Retrieval , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[9]  Silviu Guiasu,et al.  The principle of maximum entropy , 1985 .

[10]  Xiaogang Wang,et al.  Person Re-identification by Salience Matching , 2013, 2013 IEEE International Conference on Computer Vision.

[11]  Yasushi Makihara,et al.  Person re-identification using view-dependent score-level fusion of gait and color features , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[12]  David J. Fleet,et al.  Computer vision -- ECCV 2014 : 13th European conference Zurich, Switzerland, September 6-12, 2014 : proceedings , 2014 .

[13]  Anil K. Jain,et al.  Large-scale evaluation of multimodal biometric authentication using state-of-the-art systems , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Kyoung Mu Lee Computer Vision ACCV 2012 : 11th Asian Conference on Computer Vision, Daejeon, Korea, November 5-9, 2012, Revised Selected Papers, Part II , 2013 .

[15]  Hagai Aronowitz,et al.  Efficient score normalization for speaker recognition , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Shengcai Liao,et al.  Person re-identification by Local Maximal Occurrence representation and metric learning , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Horst-Michael Groß,et al.  View Invariant Appearance-Based Person Reidentification Using Fast Online Feature Selection and Score Level Fusion , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[19]  Ioannis A. Kakadiaris,et al.  Semi-coupled basis and distance metric learning for cross-domain matching: Application to low-resolution face recognition , 2014, IEEE International Joint Conference on Biometrics.

[20]  Adam L. Berger,et al.  A Maximum Entropy Approach to Natural Language Processing , 1996, CL.

[21]  Anderson Rocha,et al.  Robust Fusion: Extreme Value Theory for Recognition Score Normalization , 2010, ECCV.

[22]  R. Manmatha,et al.  Modeling score distributions for combining the outputs of search engines , 2001, SIGIR '01.

[23]  John Law,et al.  Robust Statistics—The Approach Based on Influence Functions , 1986 .

[24]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Jean-Luc Gauvain,et al.  Feature and score normalization for speaker verification of cellular data , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[26]  Cordelia Schmid,et al.  Learning Color Names from Real-World Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Horst-Michael Groß,et al.  Evaluation of multi feature fusion at score-level for appearance-based person re-identification , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[28]  Gian Luca Foresti,et al.  Saliency Weighted Features for Person Re-identification , 2014, ECCV Workshops.

[29]  Venkatesh Saligrama,et al.  A Novel Visual Word Co-occurrence Model for Person Re-identification , 2014, ECCV Workshops.

[30]  Xiaogang Wang,et al.  Learning Mid-level Filters for Person Re-identification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Anil K. Jain,et al.  Audio- and Video-based Biometric Person Authentication , 1997, Lecture Notes in Computer Science.

[32]  Qi Tian,et al.  Person Re-identification Meets Image Search , 2015, ArXiv.

[33]  C. Borror Generalized Linear Models and Extensions, Second Edition , 2008 .

[34]  Nanning Zheng,et al.  Similarity learning on an explicit polynomial kernel feature map for person re-identification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[36]  Matteo Munaro,et al.  Ensemble of different approaches for a reliable person re-identification system , 2016 .

[37]  Sridha Sridharan,et al.  Score-Level Multibiometric Fusion Based on Dempster–Shafer Theory Incorporating Uncertainty Factors , 2015, IEEE Transactions on Human-Machine Systems.

[38]  Julian Fiérrez,et al.  Complete Signal Modeling and Score Normalization for Function-Based Dynamic Signature Verification , 2003, AVBPA.

[39]  Larry S. Davis,et al.  Joint Learning for Attribute-Consistent Person Re-Identification , 2014, ECCV Workshops.

[40]  Fei Xiong,et al.  Person Re-Identification Using Kernel-Based Metric Learning Methods , 2014, ECCV.

[41]  John S. Bridle,et al.  Training Stochastic Model Recognition Algorithms as Networks can Lead to Maximum Mutual Information Estimation of Parameters , 1989, NIPS.

[42]  Hugo Proenca,et al.  Ocular Biometrics by Score-Level Fusion of Disparate Experts , 2014, IEEE Transactions on Image Processing.

[43]  Lourdes Agapito,et al.  Computer Vision - ECCV 2014 Workshops: Zurich, Switzerland, September 6-7 and 12, 2014 Proceedings, Part IV , 2015 .

[44]  Shishir K. Shah,et al.  A survey of approaches and trends in person re-identification , 2014, Image Vis. Comput..

[45]  David Williams Effective CCTV and the challenge of constructing legitimate suspicion using remote visual images , 2007 .

[46]  Xiaogang Wang,et al.  Locally Aligned Feature Transforms across Views , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  Hai Tao,et al.  Evaluating Appearance Models for Recognition, Reacquisition, and Tracking , 2007 .

[48]  Zheng Liu,et al.  Enhancing person re-identification by integrating gait biometric , 2014, Neurocomputing.

[49]  Andrew Zisserman,et al.  In Search of Art , 2014, ECCV Workshops.

[50]  Gerhard Goos,et al.  Computer Vision - ECCV 2014 Workshops , 2014, Lecture Notes in Computer Science.

[51]  Alessandro Perina,et al.  Person re-identification by symmetry-driven accumulation of local features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[52]  Shengcai Liao,et al.  Salient Color Names for Person Re-identification , 2014, ECCV.

[53]  Xiang Li,et al.  An enhanced deep feature representation for person re-identification , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[54]  Luc Van Gool,et al.  A mobile vision system for robust multi-person tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[55]  Xiaogang Wang,et al.  Unsupervised Salience Learning for Person Re-identification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[56]  Shengli Wu,et al.  A Geometric probabilistic framework for data fusion in information retrieval , 2007, 2007 10th International Conference on Information Fusion.

[57]  Shaogang Gong,et al.  The Re-identification Challenge , 2014, Person Re-Identification.