Map-Enhanced Detection and Tracking from a Moving Platform with Local and Global Data Association

We present an approach to detect and track moving objects from a moving platform. Moreover, given a global map, such as a satellite image, our approach can locate and track the targets in geo-coordinates, namely longitude and latitude. The map information is used as a global constraint for compensating the camera motion, which is critical for motion detection on a moving platform. In addition, by projecting the targets¿ position to a global map, tracking is performed in coordinates with physical meaning and thus the motion model is more meaningful than tracking in image coordinate. In a real scenario, targets can leave the field of view or be occluded. Thus we address tracking as a data association problem at the local and global levels. At the local level, the moving image blobs, provided from the motion detection, are associated into tracklets by a MCMC (Markov Chain Monte Carlo) Data Association algorithm. Both motion and appearance likelihood are considered when local data association is performed. Then, at the global level, tracklets are linked by their appearance and spatio-temporal consistence on the global map. Experiments show that our method can deal with long term occlusion and segmented tracks even when targets leave the field of view.

[1]  Mubarak Shah,et al.  Autonomous video registration using sensor model parameter adjustments , 2000, Proceedings 29th Applied Imagery Pattern Recognition Workshop.

[2]  Supun Samarasekera,et al.  Annotation of video by alignment to reference imagery , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[3]  Gérard G. Medioni,et al.  Object reacquisition using invariant appearance model , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[4]  Songhwai Oh,et al.  Markov chain Monte Carlo data association for general multiple-target tracking problems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[5]  Jean-Marc Odobez,et al.  Using particles to track varying numbers of interacting people , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Gérard G. Medioni,et al.  Map-Enhanced UAV Image Sequence Registration , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[7]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[9]  A. G. Amitha Perera,et al.  A unified framework for tracking through occlusions and across sensor gaps , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Gérard G. Medioni,et al.  Continuous tracking within and across camera streams , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[11]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..