Feature Extraction and Classification of Dynamic and Static Gestures Based on RealSense

The process of feature selection and the extraction algorithm of dynamic and static gestures based on 3D skeleton data were mainly introduced, and ten customized gestures were classified according to the features above. At first, ten gestures were customized according to teaching demands and with Intel’s 3D camera SR300, a small gesture database based on classroom teaching was established; then, the characteristics of these gestures were analyzed so that features like the trajectory and the local area of some joints point and the extremum of adaptive Euclidean distance can be selected, and a packaged feature selection method (LVW-RF) which combines Las Vegas Wrapper (LVW) and Relief-F was proposed to extract the feature set. With these features input into support vector machine (SVM), an average accuracy of 98.67% was acquired for the ten gestures. The experimental results prove that the features extracted are reasonable and effective.

[1]  Pietro Zanuttigh,et al.  Hand gesture recognition with leap motion and kinect devices , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[2]  Daijin Kim,et al.  Simultaneous Gesture Segmentation and Recognition based on Forward Spotting Accumulative HMMs , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[3]  U. A. A. Niroshika,et al.  Enhanced feature extraction method for hand gesture recognition using support vector machine , 2013, 2013 IEEE 8th International Conference on Industrial and Information Systems.

[4]  Joseph J. LaViola,et al.  Context aware 3D gesture recognition for games and virtual reality , 2015, SIGGRAPH Courses.

[5]  Ying Wu,et al.  View-independent recognition of hand postures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  Ing-Jr Ding,et al.  Feature design scheme for Kinect-based DTW human gesture recognition , 2015, Multimedia Tools and Applications.