Hierarchical MRF model for model-based multi-object tracking

To track multiple objects, top-down (model-based methods) and bottom-up (multi-layer analysis) methods have been proposed separately. A hierarchical MRF model is proposed to integrate these two trends into a MAP framework for tracking non-rigid objects such as human hands or faces. Parametric models of color, shape and frame difference for both foreground and background are given. Dynamic constraints are used to update the observation models and present an initial segmentation for the new frame. A novel hierarchical MRF model is proposed to efficiently refine the segmentation based on local smoothness constraints. The algorithm does not need to initialize and can detect new moving objects and track them. It can also handle the stopped objects because of the utilization of spatial-temporal constraints. Promising results are reported.

[1]  Nuno Vasconcelos,et al.  Empirical Bayesian EM-based motion segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Hai Tao,et al.  Dynamic layer representation with applications to tracking , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[4]  C. Stiller,et al.  Estimating motion in image sequences , 1999, IEEE Signal Process. Mag..

[5]  Christoph Bregler,et al.  Learning and recognizing human dynamics in video sequences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  P. R. Giaccone,et al.  Segmenting image sequences by embedding motion and colour cues within a contextual relaxation scheme , 1999 .

[7]  Charles A. Bouman,et al.  A multiscale random field model for Bayesian image segmentation , 1994, IEEE Trans. Image Process..

[8]  Christophe Collet,et al.  Unsupervised Hierarchical Markovian Segmentation Of Sonar Images , 1997 .

[9]  C. Stiller,et al.  Estimating Motion in Image Sequences A tutorial on modeling and computation of 2 D motion , 2022 .

[10]  Ying Wu,et al.  Color tracking by transductive learning , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[11]  Richard Szeliski,et al.  An integrated Bayesian approach to layer extraction from image sequences , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  Nebojsa Jojic,et al.  Tracking self-occluding articulated objects in dense disparity maps , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[13]  Nebojsa Jojic,et al.  Tracking articulated objects in dense disparity maps , 1999 .

[14]  H. Vincent Poor,et al.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.