Multi Camera-Based Person Tracking Using Region Covariance and Homography Constraint

In this paper, an algorithm for multiple camera based persontracking is presented. Region covariance matrixes areused to model the target appearance. The correspondencebetween multiple camera views is established via homography.It is utilized to improve the tracking of people under assumptionthat they are at the common ground plane. If thereis occlusion in one view, the homography to this view fromanother view is utilized to locate the object template. Theinformation about the true location of the template helpsthe tracker to resume, even in case of substantial temporalocclusions or large object movements. The object templateis represented by multiple non-overlapping patches. Owingto such an object representation the tracker is capable bothdetecting the occlusion and handling considerable partialocclusions. The object tracking is achieved using particleswarm optimization. The objective function is based on theLog-Euclidean Riemannian metric. Experimental resultsthat were obtained on surveillance videos show the feasibilityof the presented approach.

[1]  Björn Schuller,et al.  Multiple Camera Person Tracking in Multiple Layers Combining 2D and 3D Information , 2008 .

[2]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  Xavier Pennec,et al.  A Riemannian Framework for Tensor Computing , 2005, International Journal of Computer Vision.

[4]  Yael Moses,et al.  Homography based multiple camera detection and tracking of people in a dense crowd , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Bogdan Kwolek,et al.  Object Tracking via Multi-region Covariance and Particle Swarm Optimization , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[6]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[7]  Mubarak Shah,et al.  A Multiview Approach to Tracking People in Crowded Scenes Using a Planar Homography Constraint , 2006, ECCV.

[8]  N. Ayache,et al.  Log‐Euclidean metrics for fast and simple calculus on diffusion tensors , 2006, Magnetic resonance in medicine.

[9]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[10]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[11]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[12]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[13]  Mubarak Shah,et al.  A Homographic Framework for the Fusion of Multi-view Silhouettes , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[14]  Fatih Murat Porikli,et al.  Covariance Tracking using Model Update Based on Lie Algebra , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[15]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.