Recognizing Motion Using Local Appearance

This paper presents a technique for the analysis and recognition of body motion using local appearance. A set of spatio-temporal lters are determined by principal component analysis of the contents of spatio-temporal neighborhoods from a set of image sequences. A few principal components deene the basis for an orthogonal space for describing the appearance of motion. The axes of this space represent local spatio-temporal patterns. The projection of a local spatio-temporal neighborhood onto these axes provides a vector which describes the neighborhood. Motion can be described statistically using the multi-dimensional histogram of projections. Such statistical analysis of feature projections provides the basis for a method for recognition of motion patterns. In this paper we report on initial experimental which show promising results in the description of a walking action.

[1]  Alex Pentland,et al.  Recovery of Nonrigid Motion and Structure , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Karl Rohr,et al.  Incremental recognition of pedestrians from image sequences , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[3]  David C. Hogg,et al.  Learning Spatiotemporal Models From Training Examples , 1995 .

[4]  David C. Hogg,et al.  An Adaptive Eigenshape Model , 1995, BMVC.

[5]  James W. Davis,et al.  An appearance-based representation of action , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[6]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[7]  Michael J. Black,et al.  Cardboard people: A parametrized model of articulated motion , 1996 .

[8]  Bernt Schiele,et al.  The Robustness of Object Recognition to View Point Changes Using Multidimensional Receptive Field Histograms , 1996 .

[9]  James W. Davis,et al.  The Representation and Recognition of Action Using Temporal Templates , 1997, CVPR 1997.

[10]  Christoph Bregler,et al.  Learning and recognizing human dynamics in video sequences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Bernt Schiele,et al.  Reconnaissance d'objets utilisant des histogrammes multidimensionnels de champs réceptifs. (Object Recognition using Multidimensional Receptive Field Histograms) , 1997 .

[12]  Larry S. Davis,et al.  Learned temporal models of image motion , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[13]  Michael J. Black,et al.  Parameterized Modeling and Recognition of Activities , 1999, Comput. Vis. Image Underst..

[14]  Mikkel B. Stegmann,et al.  Active appearance models: Theory and cases , 2000 .