Motion Based Correspondence for 3D Tracking of Multiple Dim Objects

Tracking multiple objects in a video is a demanding task that is frequently encountered in several systems such as surveillance and motion analysis. Ability to track objects in 3D requires the use of multiple cameras. While tracking multiple objects using multiples video cameras, establishing correspondence between objects in the various cameras is a nontrivial task. Specifically, when the targets are dim or are very far away from the camera, appearance cannot be used in order to establish this correspondence. Here, we propose a technique to establish correspondence across cameras using the motion features extracted from the targets, even when the relative position of the cameras is unknown. Experimental results are provided for the problem of tracking multiple bees in natural flight using two cameras. The reconstructed 3D flight paths of the bees show some interesting flight patterns

[1]  Mubarak Shah,et al.  Human Tracking in Multiple Cameras , 2001, ICCV.

[2]  Mubarak Shah,et al.  View-Invariant Representation and Recognition of Actions , 2002, International Journal of Computer Vision.

[3]  C. Jaynes Multi-view calibration from planar motion for video surveillance , 1999, Proceedings Second IEEE Workshop on Visual Surveillance (VS'99) (Cat. No.98-89223).

[4]  Rama Chellappa,et al.  Robust two-camera tracking using homography , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[5]  W. Richards,et al.  Boundaries of Visual Motion , 1985 .

[6]  Marcus A. Magnor,et al.  External Camera Calibration for Synchronized Multi-video Systems , 2004, WSCG.