Multidimensional motion segmentation and identification

Accurate tracking can facilitate the automatic extraction of metric information from video analysis. Many tracking systems rely on a sufficiently accurate dynamic model. These dynamic models must be either known a priori or learnt. This paper addresses the problem of determining dynamical system models from observed visual motion where it is assumed that the motion cannot be modeled by a single dynamical system. The changes in motion (from one system to another) need to be detected. Previous work has dealt with maintaining multiple hypotheses. For repetitive motion, rather than maintaining multiple hypotheses, one can learn the dynamic models that apply and identify the changes between the models. Specifically, a method for high dimensional motion segmentation is presented. By using a two-step recursive least square algorithm, break points of system dynamics, at which a model switching must be performed are predicted. After segmentation, system identification techniques can be used to fit dynamic models.

[1]  David C. Hogg.  Model-based vision: a program to see a walking person , 1983, Image Vis. Comput..

[2]  Aaron F. Bobick,et al.  Recognition and interpretation of parametric gesture , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[3]  E. H. Adelson,et al.  Motion estimation and segmentation using a recurrent mixture of experts architecture , 1995, Proceedings of 1995 IEEE Workshop on Neural Networks for Signal Processing.

[4]  Michael Isard,et al.  Active Contours , 2000, Springer London.

[5]  P. Kumar,et al.  Theory and practice of recursive identification , 1985, IEEE Transactions on Automatic Control.

[6]  Aaron F. Bobick,et al.  Recognition of human body motion using phase space constraints , 1995, Proceedings of IEEE International Conference on Computer Vision.

[7]  Peter Andersson,et al.  Adaptive Forgetting in Recursive Identification through Multiple Models , 1985 .

[8]  Michael Isard,et al.  Learning to Track the Visual Motion of Contours , 1995, Artif. Intell..

[9]  Andrew Blake,et al.  Real-time traffic monitoring , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[10]  Andrew W. Fitzgibbon,et al.  Maintaining multiple motion model hypotheses over many views to recover matching and structure , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[11]  Michael Isard,et al.  A mixed-state condensation tracker with automatic model-switching , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[12]  Takeo Kanade,et al.  Model-based tracking of self-occluding articulated objects , 1995, Proceedings of IEEE International Conference on Computer Vision.

[13]  Michael J. Black,et al.  Parameterized Modeling and Recognition of Activities , 1999, Comput. Vis. Image Underst..

[14]  J. O'Rourke,et al.  Model-based image analysis of human motion using constraint propagation , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  William T. Freeman,et al.  Orientation Histograms for Hand Gesture Recognition , 1995 .

[16]  D. Jacobs,et al.  Model-based Recognition , 1994 .

[17]  Alex Pentland,et al.  Classifying Hand Gestures with a View-Based Distributed Representation , 1993, NIPS.

[18]  Christoph Bregler,et al.  Learning and recognizing human dynamics in video sequences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Mubarak Shah,et al.  Motion-Based Recognition , 1997, Computational Imaging and Vision.