Human Action Recognition Using Latent-Dynamic Condition Random Fields

In video human action recognition of the continual human motion is a difficult point for application. The method of human action recognition based on latent-dynamic condition random fields is presented. By star form distance descriptor of human body contour, human pose is extracted. Then in continuous sequences method building the model of LDCRF shows the mapping relation between action feature and action semantics. Comparing with traditional CRF and HCRF, by designing the affiliation of latent feature and human pose, LDCRF implements the modeling in internal action and external movement feature. In the experiment, Weizmann action database is used, and three experiments are designed. When composition continuous sequence is tested, except “skip” action, recognition rate reaches over 90%; receiver operating characteristic of three model shows LDCRF moels have the better descriptive capability in internal action and external movement feature;while human action is affected by angle, accessory and occlusion. It shows LDCRF is robustness in the human body contour integrity situation.

[1]  Svetha Venkatesh,et al.  Learning and detecting activities from movement trajectories using the hierarchical hidden Markov model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Ronen Basri,et al.  Actions as Space-Time Shapes , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Jitendra Malik,et al.  Recognizing action at a distance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[5]  Fei-Yue Huang Viewpoint Independent Action Recognition: Viewpoint Independent Action Recognition , 2008 .

[6]  Rémi Ronfard,et al.  Free viewpoint action recognition using motion history volumes , 2006, Comput. Vis. Image Underst..

[7]  Cristian Sminchisescu,et al.  Conditional Random Fields for Contextual Human Motion Recognition , 2005, ICCV.

[8]  Trevor Darrell,et al.  Hidden Conditional Random Fields , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Huang Tian Discriminative Random Fields for Online Behavior Recognition , 2009 .

[10]  Yunde Jia,et al.  Human Action Recognition Using Manifold Learning and Hidden Conditional Random Fields , 2008, 2008 The 9th International Conference for Young Computer Scientists.

[11]  Sheng-Wen Shih,et al.  Continuous Human Action Segmentation and Recognition Using a Spatio-Temporal Probabilistic Framework , 2006, Eighth IEEE International Symposium on Multimedia (ISM'06).

[12]  Trevor Darrell,et al.  Latent-Dynamic Discriminative Models for Continuous Gesture Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[14]  Maurice Milgram,et al.  Recognition of human behavior by space-time silhouette characterization , 2008, Pattern Recognit. Lett..

[15]  Ashish Kapoor,et al.  A real-time head nod and shake detector , 2001, PUI '01.

[16]  J. Sullivan,et al.  Action Recognition by Shape Matching to Key Frames , 2002 .

[17]  Xu Guang-You,et al.  Viewpoint Independent Action Recognition , 2008 .

[18]  Wang Liang,et al.  A Survey of Visual Analysis of Human Motion , 2002 .