A Context-Aware Method for View-Point Invariant Long-Term Re-identification

In this work, we propose a novel context-aware framework towards long-term person re-identification. In contrast to the classical context-unaware architecture, in this method we exploit contextual features that can be identified reliably and guide the re-identification process in a much faster and accurate manner. The system is designed for the long-term Re-ID in walking scenarios, so persons are characterized by soft-biometric features (i.e., anthropometric and gait) acquired using a Kinect\(^\mathrm {TM}\) v.2 sensor. Context is associated to the posture of the person with respect to the camera, since the quality of the data acquired from the used sensor significantly depends on this variable. Within each context, only the most relevant features are selected with the help of feature selection techniques, and custom individual classifiers are trained. Afterwards, a context-aware ensemble fusion strategy which we term as ‘Context specific score-level fusion’, merges the results of individual classifiers. In typical ‘in-the-wild’ scenarios the samples of a person may not appear in all contexts of interest. To tackle this problem we propose a cross-context analysis where features are mapped between contexts and allow the transfer of the identification characteristics of a person between different contexts. We demonstrate in this work the experimental verification of the performance of the proposed context-aware system against the classical context-unaware system. We include in the results the analysis of switching context conditions within a video sequence through a pilot study of circular path movement. All the analysis accentuate the impact of contexts in simplifying the searching process by bestowing promising results.

[1]  Okko Johannes Räsänen,et al.  Feature selection methods and their combinations in high-dimensional classification of speaker likability, intelligibility and personality traits , 2015, Comput. Speech Lang..

[2]  Marco Grangetto,et al.  Human Classification Using Gait Features , 2014, BIOMET.

[3]  Luc Van Gool,et al.  One-Shot Person Re-identification with a Consumer Depth Camera , 2014, Person Re-Identification.

[4]  Ana L. N. Fred,et al.  Context-Aware Person Re-Identification in the Wild Via Fusion of Gait and Anthropometric Features , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[5]  Alfredo Gardel Vicente,et al.  Person Re-Identification Ranking Optimisation by Discriminant Context Information Analysis , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  Liyan Zhang,et al.  Context-based person identification framework for smart video surveillance , 2013, Machine Vision and Applications.

[7]  Michele Gorgoglione,et al.  Using context for online customer re-identification , 2016, Expert Syst. Appl..

[8]  Thomas B. Moeslund,et al.  Context-Aware Fusion of RGB and Thermal Imagery for Traffic Monitoring , 2016, Sensors.

[9]  Alessio Del Bue,et al.  Re-identification with RGB-D Sensors , 2012, ECCV Workshops.

[10]  Ricardo Matsumura de Araújo,et al.  Person Identification Using Anthropometric and Gait Data from Kinect Sensor , 2015, AAAI.

[11]  Alexander Tuzhilin,et al.  Using Context to Improve Predictive Modeling of Customers in Personalization Applications , 2008, IEEE Transactions on Knowledge and Data Engineering.

[12]  Yan Tang,et al.  User Identification for Instant Messages , 2011, ICONIP.

[13]  Ana L. N. Fred,et al.  Towards View-point Invariant Person Re-identification via Fusion of Anthropometric and Gait Features from Kinect Measurements , 2017, VISIGRAPP.

[14]  Shishir K. Shah,et al.  Human Activity Recognition using Deep Neural Network with Contextual Information , 2017, VISIGRAPP.

[15]  Ana L. N. Fred,et al.  Feature Subspace Ensembles: A Parallel Classifier Combination Scheme Using Feature Selection , 2007, MCS.

[16]  A. Wayne Whitney,et al.  A Direct Method of Nonparametric Measurement Selection , 1971, IEEE Transactions on Computers.

[17]  Yimin Wang,et al.  Person re-identification with content and context re-ranking , 2015, Multimedia Tools and Applications.

[18]  Arun Ross,et al.  Handbook of Multibiometrics , 2006, The Kluwer international series on biometrics.