Human Tracking with Mixtures of Trees

Tree-structur ed probabilistic modelsadmit simple, fast inference. However, they are not well suitedto phenomena such asocclusion,where multiplecomponentsof an object maydisappearsimultaneously . Mixturesof treesappearto addressthis problem, at the cost of representinga large mixture. We demonstr ate an efficient and compactrepresentationof this mixture, which admitssimplelearningand inferencealgorithms. We usethis methodto build an automatedtracker for Muybridge sequencesof a variety of human activities. Tracking is difficult, becausethe temporal dependencies rule out simple inferencemethods. We showhow to use our modelfor efficient inference, usinga methodthat employsalternatespatial and temporal inference. Theresult is a tracker that (a) usesa veryloosemotionmodel,andso cantrack manydifferentactivitiesat a variable framerate and(b) is entirely automatic.

[1]  R. D. Lockhart,et al.  The Human Figure in Motion , 1957 .

[2]  Robert E. Tarjan,et al.  Finding optimum branchings , 1977, Networks.

[3]  Jitendra Malik,et al.  Tracking people with twists and exponential maps , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[4]  Michael I. Jordan,et al.  Learning with Mixtures of Trees , 2001, J. Mach. Learn. Res..

[5]  David J. Fleet,et al.  Stochastic Tracking of 3D Human Figures Using 2D Image Motion , 2000, ECCV.

[6]  Pietro Perona,et al.  Viewpoint-invariant learning and detection of human heads , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[7]  Daniel P. Huttenlocher,et al.  Efficient matching of pictorial structures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[8]  David J. Fleet,et al.  Stochastic Tracking of 3D Human Figures Using 2D Image Motion , 2000, ECCV.

[9]  Yang Song,et al.  Towards detection of human motion , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).