Two-stage appearance-based re-identification of humans in low-resolution videos

The objective of human re-identification is to recognize a specific individual on different locations and to determine whether an individual has already appeared. This is especially in multi-camera networks with non-overlapping fields of view of interest. However, this is still an unsolved computer vision task due to several challenges, e.g. significant changes of appearance of humans as well as different illumination, camera parameters etc. In addition, for instance, in surveillance scenarios only low-resolution videos are usually available, so that biometric approaches may not be applied. This paper presents a whole-body appearance-based human re-identification approach for low-resolution videos. The method is divided in two stages: first, an appearance model is computed from several images of an individual and pairwise compared to each other. The model is based on means of covariance descriptors determined by spectral clustering techniques. In the second stage, the result is refined by learning the appearance manifolds of the best matches. The proposed approach is tested on a multi-camera data set of a typical surveillance scenario and compared to a color histogram based method.

[1]  L. Skovgaard.  A Riemannian geometry of the multivariate normal model , 1984 .

[2]  Fatih Murat Porikli,et al.  Fast Construction of Covariance Matrices for Arbitrary Size Image Windows , 2006, 2006 International Conference on Image Processing.

[3]  D. Manger,et al.  Feature-based Localization Refinement of Players in Soccer using Plausibility Maps , 2022 .

[4]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[5]  Francesco Camastra,et al.  Machine Learning for Audio, Image and Video Analysis - Theory and Applications , 2007, Advanced Information and Knowledge Processing.

[6]  Jürgen Metzler,et al.  Appearance-Based Re-identification of Humans in Low-Resolution Videos Using Means of Covariance Descriptors , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[7]  Xavier Pennec,et al.  Intrinsic Statistics on Riemannian Manifolds: Basic Tools for Geometric Measurements , 2006, Journal of Mathematical Imaging and Vision.

[8]  Horst Bischof,et al.  Person Re-identification by Descriptive and Discriminative Classification , 2011, SCIA.

[9]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[10]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[11]  Anil K. Jain,et al.  Biometrics of Next Generation: An Overview , 2010 .

[12]  W. Kendall.  Probability, Convexity, and Harmonic Maps with Small Image I: Uniqueness and Fine Existence , 1990 .

[13]  Fatih Murat Porikli,et al.  Human Detection via Classification on Riemannian Manifolds , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Slawomir Bak,et al.  Boosted human re-identification using Riemannian manifolds , 2012, Image Vis. Comput..

[15]  Rainer Stiefelhagen,et al.  Multi-pose Face Recognition for Person Retrieval in Camera Networks , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[16]  H. Karcher.  Riemannian center of mass and mollifier smoothing , 1977 .

[17]  Jean-Luc Dugelay,et al.  Bag of soft biometrics for person identification , 2010, Multimedia Tools and Applications.

[18]  Lawrence Cayton,et al.  Algorithms for manifold learning , 2005 .

[19]  P. Meer,et al.  Covariance Tracking using Model Update Based on Means on Riemannian Manifolds , 2005 .

[20]  Karim Faez,et al.  Human Identification Based on Gait , 2008 .

[21]  W. Förstner,et al.  A Metric for Covariance Matrices , 2003 .

[22]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[23]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[24]  Peter H. Tu,et al.  Appearance-based person reidentification in camera networks: problem overview and current approaches , 2011, J. Ambient Intell. Humaniz. Comput..

[25]  Xavier Pennec,et al.  A Riemannian Framework for Tensor Computing , 2005, International Journal of Computer Vision.