Parametric contour tracking using unscented Kalman filter

This paper presents an efficient method to integrate various spatial-temporal constraints to regularize the contour tracking. Specifically, the global shape prior, contour smoothness and object dynamics are addressed. First, the contour is represented as a parametric shape, based on which a causal smoothness constraint can be developed to exploit the local spatial constraint. The causality nature of the constraint allows us to do efficient probabilistic contour detection using the powerful hidden Markov model (HMM). Finally, a unscented Kalman filter (UKF) is applied to estimate object parameters based on the nonlinear observation model (i.e. the relationship between the detected contour points and the contour parameters) and the object dynamics. Better than other variants of the recursive least mean square estimators (e.g., extended Kalman filter), the UKF approximates nonlinear systems up to the second order (third for Gaussian prior) with similar computational cost. This novel tracking algorithm is running in real-time and robust to severe distractions due to the comprehensive spatial-temporal constraints. It is applied to track people in bad illumination and cluttered environments. Promising results are reported.

[1]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[2]  S. Julier,et al.  A General Method for Approximating Nonlinear Transformations of Probability Distributions , 1996 .

[3]  Richard Szeliski,et al.  Tracking with Kalman snakes , 1993 .

[4]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.

[5]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[6]  Thomas S. Huang,et al.  Optimal radial contour tracking by dynamic programming , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[7]  Stanley T. Birchfield,et al.  Elliptical head tracking using intensity gradients and color histograms , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[8]  Natan Peterfreund,et al.  Robust Tracking of Position and Velocity With Kalman Snakes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Andrew Blake,et al.  Nonlinear filtering for speaker tracking in noisy and reverberant environments , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[10]  Petros G. Voulgaris,et al.  On optimal ℓ∞ to ℓ∞ filtering , 1995, Autom..

[11]  Nando de Freitas,et al.  The Unscented Particle Filter , 2000, NIPS.

[12]  Christophe Chesnaud,et al.  Statistical Region Snake-Based Segmentation Adapted to Different Physical Noise Models , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Ramesh C. Jain,et al.  Using Dynamic Programming for Solving Variational Problems in Vision , 1990, IEEE Trans. Pattern Anal. Mach. Intell..