A real-time dynamic gesture recognition based on 3D trajectories in distinguishing similar gestures

There are many shape-similar gestures which cause errors in the process of hand gesture recognition. In this paper, a new method which can distinguish the similar gestures was proposed. The information of motion trajectory is captured by a leap motion in three-dimension space, and the orientation characteristics are quantified and coded as the feature. Then the Hidden Markov Model (HMM) algorithm is utilized to model and classify gestures. But there are many shape-similar gestures in our database (numbers 0-9 and alphabets A-Z) such as S and 5, Z and 2 whose recognition rates are low. In this paper, we proposed a new method that can distinguish the similar gestures in real-time. The experiment result demonstrates the effectiveness of the proposed method.

[1]  Luis Enrique Sucar,et al.  Visual Recognition of Similar Gestures , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[2]  Xinyu Wu,et al.  Dynamic gesture recognition using 3D trajectory , 2014, 2014 4th IEEE International Conference on Information Science and Technology.

[3]  Keechul Jung,et al.  Recognition-based gesture spotting in video games , 2004, Pattern Recognit. Lett..

[4]  G. Charith K. Abhayaratne,et al.  Kinect depth stream pre-processing for hand gesture recognition , 2013, 2013 IEEE International Conference on Image Processing.

[5]  Petros Maragos,et al.  Kinect-based multimodal gesture recognition using a two-pass fusion scheme , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[6]  Alex Pentland,et al.  Invariant features for 3-D gesture recognition , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[7]  David Alan Becker,et al.  Sensei, a real-time recognition, feedback and training system for T'ai chi gestures , 1997 .

[8]  Daijin Kim,et al.  Simultaneous Gesture Segmentation and Recognition based on Forward Spotting Accumulative HMMs , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[9]  Ayoub Al-Hamadi,et al.  Robust methods for hand gesture spotting and recognition using Hidden Markov Models and Conditional Random Fields , 2010, The 10th IEEE International Symposium on Signal Processing and Information Technology.

[10]  Z. Liu,et al.  A real time system for dynamic hand gesture recognition with a depth sensor , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[11]  Gang Qian,et al.  Gesture recognition using video and floor pressure data , 2012, 2012 19th IEEE International Conference on Image Processing.

[12]  Pietro Zanuttigh,et al.  Hand gesture recognition with leap motion and kinect devices , 2014, 2014 IEEE International Conference on Image Processing (ICIP).