A Robust Human Action Recognition System Using Single Camera

This paper describes a system for action recognition with a single camera. Firstly, we use a two-layered background subtraction, which is based on both chromaticity and gradient, to extract human contours from the frame sequence captured by camera. This subtraction helps us remove shadows from foreground and get a good contour for recognition. Then we parameterize a human posture with a model called star skeleton. Each posture is represented as five vectors by this model. To classify every posture into a symbol, we trained a classifier by SVM with a set of exemplars. This classifier calculates a symbol according to the star skeleton. So it transfers the frame sequence into a symbol sequence. Finally, an action is recognized from the symbol sequence with a string matching. Our system can be regarded as a new way for interaction between human and computer. It achieves a high and stable recognition rate in complex environment, and the experimental results show the promising effectiveness.

[1]  Ronald Poppe,et al.  Vision-based human motion analysis: An overview , 2007, Comput. Vis. Image Underst..

[2]  Mubarak Shah,et al.  A hierarchical approach to robust background subtraction using color and gradient information , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[3]  Kuo-Chin Fan,et al.  Human Action Recognition Using Star Templates and Delaunay Triangulation , 2008, 2008 International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[4]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[5]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[6]  Hironobu Fujiyoshi,et al.  Real-time human motion analysis by image skeletonization , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[7]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Other Conferences.

[8]  Hsuan-Sheng Chen,et al.  Human action recognition using star skeleton , 2006, VSSN '06.

[9]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[10]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[11]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[12]  Barbara Caputo,et al.  Recognizing human actions: a local SVM approach , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[13]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Jwu-Sheng Hu,et al.  Robust Background Subtraction with Shadow and Highlight Removal for Indoor Surveillance , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.