Dynamic hand gesture recognition from cyclical hand pattern

In this paper, we tackle advantages of cyclical movement patterns of hand gestures. The cyclical patterns are defined as closed-form which hand moves away from a rest position, follows one or more of a series of the movement of hand shapes and returns to its rest position. Due to the cyclical pattern characteristic, phase of gestures are supportive cues for deploying robust recognition schemes. We conduct a spatial-temporal representation of the hand gestures which takes into account both hand shapes and its movements during a gesture. The phase alignment then is deployed in the conducted space. The proposed scheme ensures inter-period phase continuity as well as normalizes length of the hand gestures. Three different datasets of dynamic hand gestures consisting of non-cyclical and cyclical patterns are examined. Evaluation results confirm that the best accuracy rate achieves at 96% for cyclical pattern that is significantly higher than results for typical gestures. The proposed method suggests a feasible and robust solution addressing technical issues in developing human-computer interaction applications such as using hand gestures to control home appliance devices.

[1]  Zicheng Liu,et al.  HON4D: Histogram of Oriented 4D Normals for Activity Recognition from Depth Sequences , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Pavlo Molchanov,et al.  Online Detection and Classification of Dynamic Hand Gestures with Recurrent 3D Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Katarzyna Barczewska,et al.  Comparison of methods for hand gesture recognition based on Dynamic Time Warping algorithm , 2013, 2013 Federated Conference on Computer Science and Information Systems.

[4]  Masahiko Yachida,et al.  Video Synthesis with High Spatio-Temporal Resolution Using Motion Compensation and Spectral Fusion , 2006, IEICE Trans. Inf. Syst..

[5]  Thanh-Hai Tran,et al.  Phase synchronization in a manifold space for recognizing dynamic hand gestures from periodic image sequence , 2016, 2016 IEEE RIVF International Conference on Computing & Communication Technologies, Research, Innovation, and Vision for the Future (RIVF).

[6]  Takahiro Okabe,et al.  Video Temporal Super-Resolution Based on Self-similarity , 2010, ACCV.

[7]  Yasushi Makihara,et al.  Periodic Temporal Super Resolution Based on Phase Registration and Manifold Reconstruction , 2011, IPSJ Trans. Comput. Vis. Appl..

[8]  Thanh-Hai Tran,et al.  A combination of user-guide scheme and kernel descriptor on RGB-D data for robust and realtime hand posture recognition , 2016, Eng. Appl. Artif. Intell..

[9]  Yaron Caspi,et al.  Under the supervision of , 2003 .

[10]  Xiaodong Yang,et al.  Super Normal Vector for Activity Recognition Using Depth Sequences , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Dandu Amarnatha Reddy Vision Based Hand Gesture Recognition for Human Computer Interaction , 2018 .

[12]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Ayoub Al-Hamadi,et al.  Real-Time Capable System for Hand Gesture Recognition Using Hidden Markov Models in Stereo Color Image Sequences , 2008, J. WSCG.

[14]  Anupam Agrawal,et al.  Vision based hand gesture recognition for human computer interaction: a survey , 2012, Artificial Intelligence Review.

[15]  Sergio Escalera,et al.  Multi-modal gesture recognition challenge 2013: dataset and results , 2013, ICMI '13.

[16]  Thanh-Hai Tran,et al.  Recognition of hand gestures from cyclic hand movements using spatial-temporal features , 2015, SoICT.

[17]  Z. Liu,et al.  A real time system for dynamic hand gesture recognition with a depth sensor , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[18]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.