Human gesture recognition using Kinect camera

In this paper, we propose a comparison of human gesture recognition using data mining classification methods in video streaming. In particular, we are interested in a specific stream of vector of twenty body-joint positions which are representative of the human body captured by Kinect camera. The recognized gesture patterns of the study are stand, sit down, and lie down. Classification methods chosen for comparison study are backpropagation neural network, support vector machine, decision tree, and naive Bayes. Experimental results have shown that the backpropagation neural network method outperforms other classification methods and can achieve recognition with 100% accuracy. Moreover, the average accuracy of all classification methods used in this study is 93.72%, which confirms the high potential of using the Kinect camera in human body recognition applications. Our future work will use the knowledge obtained from these classifiers in time series analysis of gesture sequence for detecting fall motion in a smart home system.

[1]  Isaac Cohen,et al.  Inference of human postures by classification of 3D human body shape , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[2]  Zhijing Liu,et al.  Human Action Recognition Based on Non-linear SVM Decision Tree , 2011 .

[3]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[4]  Ioannis Pitas,et al.  Single camera pointing gesture recognition using spatial features and support vector machines , 2007, 2007 15th European Signal Processing Conference.

[5]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[6]  Daqing Zhang,et al.  Gesture Recognition with a 3-D Accelerometer , 2009, UIC.

[7]  Mohamed Bécha Kaâniche.  Human gesture recognition , 2009 .

[8]  Larry S. Davis,et al.  Towards 3-D model-based tracking and recognition of human movement: a multi-view approach , 1995 .

[9]  Chen Wu,et al.  Model-based human posture estimation for gesture analysis in an opportunistic fusion smart camera network , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[10]  Horst-Michael Groß,et al.  Visual-based posture recognition using hybrid neural networks , 1999, ESANN.

[11]  Jin-Jang Leou,et al.  Human Behavior Analysis Using Multiple 2D Features and Multicategory Support Vector Machine , 2009, MVA.

[12]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[13]  Kyaw Kyaw Htike Muhammad Ali,et al.  A Comparison Of Posture Recognition Using Supervised And Unsupervised Learning Algorithms , 2010, ECMS.

[14]  Zyad Shaaban,et al.  Data Mining: A Preprocessing Engine , 2006 .

[15]  Darko Kirovski,et al.  Real-time classification of dance gestures from skeleton animation , 2011, SCA '11.