Camera Network Based Person Re-identification by Leveraging Spatial-Temporal Constraint and Multiple Cameras Relations

With the rapid development of multimedia technology and vast demand on video investigation, long-term cross-camera object tracking is increasingly important in the practical surveillance scene. Because the conventional Paired Cameras based Person Re-identification PCPR cannot fully satisfy the above requirement, a new framework named Camera Network based Person Re-identification CNPR is introduced. Two phenomena have been investigated and explored in this paper. First, the same person cannot simultaneously appear in two non-overlapping cameras. Second, the closer two cameras, the more relevant they are, in the sense that persons can transit between them with a high probability. Based on these two phenomena, a probabilistic method is proposed with reference to both visual difference and spatial-temporal constraint, to address the novel CNPR problem. i Spatial-temporal constraint is utilized as a filter to narrow the search space for the specific query object, and then the Weibull Distribution is exploited to formulate the spatial-temporal probability indicating the possibility of pedestrians walking to a certain camera at a certain time. ii Spatial-temporal probability and visual feature probability are collaborated to generate the ranking list. iii The multiple camera relations related to the transitions are explored to further optimize the obtained ranking list. Quantitative experiments conducted on TMin and CamNeT datasets have shown that the proposed method achieves a better performance to the novel CNPR problem.

[1]  Zheng Wang,et al.  Region-Based Interactive Ranking Optimization for Person Re-identification , 2014, PCM.

[2]  Shengcai Liao,et al.  Person re-identification by Local Maximal Occurrence representation and metric learning , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Senem Velipasalar,et al.  Cooperative Object Tracking and Composite Event Detection With Wireless Embedded Smart Cameras , 2010, IEEE Transactions on Image Processing.

[4]  Shaogang Gong,et al.  Reidentification by Relative Distance Comparison , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Shaogang Gong,et al.  Person Re-Identification by Support Vector Ranking , 2010, BMVC.

[6]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Abir Das,et al.  Consistent Re-identification in a Camera Network , 2014, ECCV.

[8]  Amit K. Roy-Chowdhury,et al.  Collaborative Sensing in a Distributed PTZ Camera Network , 2012, IEEE Transactions on Image Processing.

[9]  Yimin Wang,et al.  Camera Compensation Using a Feature Projection Matrix for Person Reidentification , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Richard I. Hartley,et al.  Person Reidentification Using Spatiotemporal Appearance , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  Xiaogang Wang,et al.  Shape and Appearance Context Modeling , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[12]  Yimin Wang,et al.  Bidirectional ranking for person re-identification , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[13]  Mohamed A. Sharaf,et al.  Databases Theory and Applications , 2014, Lecture Notes in Computer Science.

[14]  Shaogang Gong,et al.  Person re-identification by probabilistic relative distance comparison , 2011, CVPR 2011.

[15]  Amit K. Roy-Chowdhury,et al.  A Camera Network Tracking (CamNeT) Dataset and Performance Baseline , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[16]  Alessandro Perina,et al.  Person re-identification by symmetry-driven accumulation of local features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Shaogang Gong,et al.  Multi-camera activity correlation analysis , 2009, CVPR.

[18]  Dacheng Tao,et al.  Person Re-Identification Over Camera Networks Using Multi-Task Distance Metric Learning , 2014, IEEE Transactions on Image Processing.

[19]  Mubarak Shah,et al.  Modeling inter-camera space-time and appearance relationships for tracking across non-overlapping views , 2008, Comput. Vis. Image Underst..

[20]  Yang Hu,et al.  Multi-camera Trajectory Mining: Database and Evaluation , 2014, 2014 22nd International Conference on Pattern Recognition.

[21]  Zheng Wang,et al.  Person Re-identification Using Data-Driven Metric Adaptation , 2015, MMM.

[22]  Frédéric Jurie,et al.  PCCA: A new approach for distance learning from sparse pairwise constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Qi Tian,et al.  Person Re-identification Meets Image Search , 2015, ArXiv.

[24]  Yang Hu,et al.  Exploring Structural Information and Fusing Multiple Features for Person Re-identification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[25]  Ryen W. White,et al.  Understanding web browsing behaviors through Weibull analysis of dwell time , 2010, SIGIR.

[26]  Xuelong Li,et al.  Person Re-Identification by Regularized Smoothing KISS Metric Learning , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Shaogang Gong,et al.  Person Re-Identification , 2014 .