This paper presents a vision-based human action recognition system to support human interaction for companion robots. The system is divided into three parts: motion map construction, feature extraction, and human action classification. First, the Kinect 2.0 captures depth images and color images simultaneously using its depth sensor and RGB camera. Second, the information in the depth images and the color images are respectively used to three depth motion maps and a color motion map. These are then combined into one image to calculate the corresponding histogram of oriented gradient (HOG) features. Finally, a support vector machine (SVM) recognizes these HOG features as human actions. The proposed system can recognize eight kinds of human actions, wave left hand, wave right hand, holding left hand, holding right hand, hugging, bowing, walking, and punching. Three databases were used to test the proposed system: Database1 includes videos of adult actions, Database2 includes videos of child actions, and Database3 includes human action videos taken with a moving camera. The recognition accuracy rates of the three tests were 88.7%, 74.37%, and 51.25%, respectively. The experimental results show that the proposed system is efficient and robust.
[1]
Rafael C. González,et al.
Local Determination of a Moving Contrast Edge
,
1985,
IEEE Transactions on Pattern Analysis and Machine Intelligence.
[2]
Bill Triggs,et al.
Histograms of oriented gradients for human detection
,
2005,
2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).
[3]
Chih-Jen Lin,et al.
LIBSVM: A library for support vector machines
,
2011,
TIST.
[4]
T. Ambwani,et al.
Multi class support vector machine implementation to intrusion detection
,
2003,
Proceedings of the International Joint Conference on Neural Networks, 2003..
[5]
Bernhard E. Boser,et al.
A training algorithm for optimal margin classifiers
,
1992,
COLT '92.
[6]
Nasser Kehtarnavaz,et al.
A Real-Time Human Action Recognition System Using Depth and Inertial Sensor Fusion
,
2016,
IEEE Sensors Journal.
[7]
Nasser Kehtarnavaz,et al.
Real-time human action recognition based on depth motion maps
,
2016,
Journal of Real-Time Image Processing.