An effective approach for human actions recognition based on optical flow and edge features

Automatic human actions recognition is an interesting and challenging problem, and impacts applications in domain such as human-computer interaction, surveillance, human actions retrieval system and robotics. Deriving an effective actions representation from image sequences is important step for successful action recognition. In this paper, we empirically evaluate actions representation based on statistical global and local features combination, optical flow and edge features, for human action recognition. Firstly, we extract Histogram of Oriented Optical Flow and Spatial Pyramid Histogram of Edge. Secondly, we create the discriminative features by using PCA and LDA. Lastly, we use ANN for actions classification. Our approach is systematically examined on KTH and Weizmann datasets. Extensive experiments illustrate that optical flow and edge features are effective and efficient for actions recognition. We observe our experiments that optical flow and edge features perform efficiently and robustly over a useful of video sequences or camera with static backgrounds, and yield promising performance in video sequences captured in real-world applications such as surveillance and robotics. In addition, we extract action features in 2D using Lucas Kanade and Canny algorithms that have low computational cost. This is feasibility to apply into robotics.

[1]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[2]  Luc Van Gool,et al.  Action recognition: A region based approach , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[3]  Cordelia Schmid,et al.  Learning realistic human actions from movies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Xiangjian He,et al.  Action Recognition by Multiple Features and Hyper-Sphere Multi-class SVM , 2010, 2010 20th International Conference on Pattern Recognition.

[5]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Xinghua Sun,et al.  Action recognition via local descriptors and holistic features , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[7]  Li Wang,et al.  Human Action Recognition and Localization in Video Using Structured Learning of Local Space-Time Features , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[8]  Gregory D. Hager,et al.  Histograms of oriented optical flow and Binet-Cauchy kernels on nonlinear dynamical systems for the recognition of human actions , 2009, CVPR.

[9]  Rama Chellappa,et al.  Discriminant Analysis for Recognition of Human Face Images (Invited Paper) , 1997, AVBPA.

[10]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..