Segmentation-based object tracking using image warping and Kalman filtering

We propose a segmentation-based method of object tracking using image warping and Kalman filtering. The object region is defined to include a group of patches, which are obtained by a watershed algorithm. In a robust M-estimator framework, we estimate dominant motion of the object region. A linear Kalman filter is employed to predict the estimated affine motion parameters based on a second order kinematic model. Image (affine) warping is performed to predict the object region in the next frame. The warping error of each watershed segment (patch) and its rate of overlapping with the predicted region are utilized for classification of watershed segments near the object border. Applications of head and hand tracking using this method demonstrate its performance.

[1]  A. Murat Tekalp,et al.  Face detection and facial feature extraction using color, shape and symmetry-based cost functions , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[2]  John M. Gauch,et al.  Image segmentation and analysis via multiscale gradient watershed hierarchies , 1999, IEEE Trans. Image Process..

[3]  Keith Markham,et al.  Region Template Correlation for FLIR Target Tracking , 1996, BMVC.

[4]  P. Holland,et al.  Robust regression using iteratively reweighted least-squares , 1977 .

[5]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Michael Gleicher,et al.  Projective registration with difference decomposition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  D HagerGregory,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998 .

[8]  Michael J. Black,et al.  Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion , 1995, Proceedings of IEEE International Conference on Computer Vision.

[9]  Marcel Worring,et al.  Multifeature object tracking using a model-free approach , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[10]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Stan Sclaroff,et al.  Active blobs , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[12]  Gregory D. Hager,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Y. Bar-Shalom.  Tracking and data association , 1988 .