Using Bilinear Models for View-invariant Action and Identity Recognition

Human identification from gait is a challenging task in realistic surveillance scenarios in which people walking along arbitrary directions are imaged by a single camera. In this paper, motivated by the view-invariance issue in the human ID from gait problem, we address the general problem of classifying the "content" of human motions of unknown "style". Given a dataset of sequences in which different people walking normally are seen from several wellseparated views, we propose a three-layer scheme based on bilinear models, in which image sequences are mapped to observation vectors of fixed dimension using Markov modeling. We test our approach on the CMU Mobo database, showing how bilinear separation outperforms other approaches, opening the way to view- and action-invariant identity recognition, as well as subject- and view-invariant action recognition.

[1]  Joshua B. Tenenbaum,et al.  Separating Style and Content with Bilinear Models , 2000, Neural Computation.

[2]  Sudeep Sarkar,et al.  Statistical Motion Model Based on the Change of Feature Relationships: Human Gait-Based Recognition , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Rama Chellappa,et al.  Combining multiple evidences for gait recognition , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[4]  John B. Moore,et al.  Hidden Markov Models: Estimation and Control , 1994 .

[5]  Aaron F. Bobick,et al.  A Multi-view Method for Gait Recognition Using Static Body Parameters , 2001, AVBPA.

[6]  M. Nixon,et al.  Statistical gait recognition via velocity moments , 2000 .

[7]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[8]  Yanxi Liu,et al.  Gait Sequence Analysis Using Frieze Patterns , 2002, ECCV.

[9]  A. N. Rajagopalan,et al.  Gait-based recognition of humans using continuous HMMs , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[10]  Tieniu Tan,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Huaiyu Zhu.  On Information and Sufficiency , 1997 .

[12]  Patrizio Frosini,et al.  Measuring shapes by size functions , 1992, Other Conferences.

[13]  Trevor Darrell,et al.  Integrated face and gait recognition from multiple views , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[14]  Rama Chellappa,et al.  Identification of humans using gait , 2004, IEEE Transactions on Image Processing.

[15]  TanTieniu,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003 .

[16]  Qiang He,et al.  Individual recognition from periodic activity using hidden Markov models , 2000, Proceedings Workshop on Human Motion.

[17]  Adam Prügel-Bennett,et al.  Automatic gait recognition using area-based metrics , 2003 .

[18]  Ralph Gross,et al.  The CMU Motion of Body (MoBo) Database , 2001 .

[19]  Hiroshi Murase,et al.  Moving object recognition in eigenspace representation: gait analysis and lip reading , 1996, Pattern Recognit. Lett..

[20]  Sudeep Sarkar,et al.  Baseline results for the challenge problem of HumanID using gait analysis , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[21]  Robert T. Collins,et al.  Gait Shape Estimation for Identification , 2003, AVBPA.

[22]  Sudeep Sarkar,et al.  The humanID gait challenge problem: data sets, performance, and analysis , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  A. Elgammal,et al.  Separating style and content on a nonlinear manifold , 2004, CVPR 2004.

[24]  Edward H. Adelson,et al.  Analyzing and recognizing walking figures in XYT , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[25]  LiuZongyi,et al.  The HumanID Gait Challenge Problem , 2005 .

[26]  Ahmed M. Elgammal,et al.  Gait style and gait content: bilinear models for gait recognition using gait re-sampling , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[27]  Rama Chellappa,et al.  Towards a view invariant gait recognition algorithm , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[28]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[29]  Bir Bhanu,et al.  Individual recognition by kinematic-based gait analysis , 2002, Object recognition supported by user interaction for service robots.

[30]  W. Eric L. Grimson,et al.  Gait analysis for recognition and classification , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[31]  Pascal Fua,et al.  3D tracking for gait characterization and recognition , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[32]  J. Little,et al.  Recognizing People by Their Gait: The Shape of Motion , 1998 .

[33]  Bir Bhanu,et al.  Statistical feature fusion for gait-based human recognition , 2004, CVPR 2004.

[34]  Mark S. Nixon,et al.  Gait Extraction and Description by Evidence-Gathering , 1999 .

[35]  Mark S. Nixon,et al.  Automatic Gait Recognition by Symmetry Analysis , 2001, AVBPA.

[36]  Philippe C. Cattin,et al.  Sensor fusion for a biometric system using gait , 2001, Conference Documentation International Conference on Multisensor Fusion and Integration for Intelligent Systems. MFI 2001 (Cat. No.01TH8590).

[37]  Mark S. Nixon,et al.  Automated person recognition by walking and running via model-based approaches , 2004, Pattern Recognit..

[38]  Anil K. Jain,et al.  Contour extraction of moving objects in complex outdoor scenes , 1995, International Journal of Computer Vision.

[39]  Rama Chellappa,et al.  A hidden Markov model based framework for recognition of humans from gait sequences , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[40]  Robert T. Collins,et al.  Silhouette-based human identification from body shape and gait , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.