Activity Recognition from Silhouettes using Linear Systems and Model (In)validation Techniques

In this work we propose a model (invalidation approach to gait recognition, using a system that tries to discriminate specific activities of people. The recognition process departs from an abstraction obtained from video image sequences for different activities performed by different people, by first using a suitable representation for each frame and for each frame sequence. For each frame two commonly used models for describing silhouettes are employed: Fourier descriptors and vectors of widths. Then each sequence is modeled as a linear time invariant (LTI) system that captures the dynamics of the evolution of the frame description vectors in time. Finally a standard classification tool, SVM, is used to recognize activities using similarity measures obtained through model (in)validation. The main contribution of this work is the provision of an activity recognition model and the performance evaluation of this model using two different feature spaces

[1]  Stefano Soatto,et al.  Recognition of human gaits , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Josef Kittler,et al.  Proceedings of the 4th International Conference on Pattern Recognition , 1988 .

[3]  Yanxi Liu,et al.  Gait Sequence Analysis Using Frieze Patterns , 2002, ECCV.

[4]  Narendra Ahuja,et al.  A model for dynamic shape and its applications , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[5]  Stephen P. Boyd,et al.  Linear Matrix Inequalities in Systems and Control Theory , 1994 .

[6]  Rama Chellappa,et al.  Identification of humans using gait , 2004, IEEE Transactions on Image Processing.

[7]  Mark S. Nixon,et al.  Automatic Gait Recognition via Fourier Descriptors of Deformable Objects , 2003, AVBPA.

[8]  Stefano Soatto,et al.  A model (In)validation approach to gait recognition , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[9]  E. Yaz.  Linear Matrix Inequalities In System And Control Theory , 1998, Proceedings of the IEEE.

[10]  Robert T. Collins,et al.  Silhouette-based human identification from body shape and gait , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[11]  Mario Sznaier,et al.  Finite horizon model reduction of a class of neutrally stable systems with applications to texture synthesis and recognition , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[12]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[13]  Larry S. Davis,et al.  Motion-based recognition of people in EigenGait space , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[14]  Ahmed M. Elgammal,et al.  Separating style and content on a nonlinear manifold , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[15]  Sudeep Sarkar,et al.  The humanID gait challenge problem: data sets, performance, and analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Nicola J. Ferrier,et al.  Repetitive motion analysis: segmentation and event classification , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  M. Sznaier,et al.  A Hankel Operator Approach to Texture Modelling and Inpainting , 2005 .

[18]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.