Tracking and occlusion handling in multi-sensor networks by particle filter

In this paper we propose a multi sensor tracking method. Tracking is done independently for each view. Fusing several cues including color, edge, texture and motion constrained by structure of environment is used in a novel way and in particle filter framework. The results of individual image planes are projected to ground plane using homography relation. The similarity of projected locations with the reference model and minimum variance estimate are two key points to evaluate the location of the target. Also, we introduce a method based on two views tracking to handle occlusion. Robust statistic is used to declare an occlusion in one view. Homography relation and inter-frame transformation are the tools to cancel the occlusion. Experimental results show the robustness and accuracy of the proposed method.

[1]  Justus H. Piater,et al.  Multi-camera People Tracking by Collaborative Particle Filters and Principal Axis-Based Integration , 2007, ACCV.

[2]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[3]  Yuan F. Zheng,et al.  Object Tracking in Structured Environments for Video Surveillance Applications , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Shuichi Nishio,et al.  Tracking of Vehicles at an Intersection by Integration of Multiple Image Sensors , 1992, MVA.

[5]  Rama Chellappa,et al.  Robust two-camera tracking using homography , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  James Black,et al.  Multi view image surveillance and tracking , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[7]  Cedric Nishan Canagarajah,et al.  Sequential Monte Carlo tracking by fusing multiple cues in video sequences , 2007, Image Vis. Comput..

[8]  Patrick Pérez,et al.  Data fusion for visual tracking with particles , 2004, Proceedings of the IEEE.

[9]  Mubarak Shah,et al.  A hierarchical approach to robust background subtraction using color and gradient information , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[10]  Tim J. Ellis,et al.  Multi camera image tracking , 2006, Image Vis. Comput..

[11]  Rama Chellappa,et al.  Object Detection, Tracking and Recognition for Multiple Smart Cameras , 2008, Proceedings of the IEEE.