Tracking through singularities and discontinuities by random sampling

Some issues in markerless tracking of human body motion are addressed. Extended Kalman filters have commonly been applied to kinematic variables, to combine predictions consistent with plausible motion, with the incoming stream of visual measurements. Kalman filtering is applicable only when the underlying distribution is approximately Gaussian. Often this assumption proves remarkably robust. There are two pervasive circumstances under which the Gaussianity assumption can break down. The first is kinematic singularity and the second is at joint endstops. Failure of Kalman filtering under these circumstances is illustrated. The non-Gaussian nature of the distributions is demonstrated experimentally by means of Monte Carlo simulation. Random simulation (particle filtering or Condensation) proves to provide a robust alternative algorithm for tracking that can also deal with these difficult conditions.

[1]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[2]  Christoph Bregler,et al.  Learning and recognizing human dynamics in video sequences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  James M. Rehg Visual analysis of high DOF articulated objects with application to hand tracking , 1995 .

[4]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[5]  Hans-Hellmut Nagel,et al.  Tracking Persons in Monocular Image Sequences , 1999, Comput. Vis. Image Underst..

[6]  Michael Isard,et al.  Active Contours , 2000, Springer London.

[7]  G. Kitagawa Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[8]  Michael Isard,et al.  A mixed-state condensation tracker with automatic model-switching , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[9]  Pietro Perona,et al.  Monocular tracking of the human arm in 3D , 1995, Proceedings of IEEE International Conference on Computer Vision.

[10]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Chris Harris,et al.  Tracking with rigid models , 1993 .

[12]  D. Mayne,et al.  Monte Carlo techniques to estimate the conditional expectation in multi-stage non-linear filtering† , 1969 .

[13]  Michel Dhome,et al.  Human Body Tracking by Monocular Vision , 1996, ECCV.

[14]  Francis L. Merat,et al.  Introduction to robotics: Mechanics and control , 1987, IEEE J. Robotics Autom..

[15]  A.H. Haddad,et al.  Applied optimal estimation , 1976, Proceedings of the IEEE.

[16]  Jitendra Malik,et al.  Tracking people with twists and exponential maps , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).