Hand Gestures Recognition Using Time Delay Networks

This paper proposes a system for body gestures recognition using the coordinates of the body skeletal returned by a Kinect sensor who are processed in order to compute a set of angles. Gesture recognition is achieved using a Time Delay Neural Network, implemented in two ways: with delay layer, and with delay synapse. The resulting system was trained on a set of gestures, such as: hands up and elbows bent, lifting arms, lowering arms, round, greeting gesture and pointing assertion. Each gesture was repeated at least 5 times with different speed. The accuracy of the proposed method is approximately 80%.

[1]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[2]  Paul Modler,et al.  Recognition of separate hand gestures by Time-Delay Neural Networks based on multi-state spectral image patterns from cyclic hand movements , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[3]  Aaron F. Bobick,et al.  Recognition of Visual Activities and Interactions by Stochastic Parsing , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  James W. Davis,et al.  Action Recognition Using Temporal Templates , 1997 .

[5]  David C. Hogg,et al.  Learning Variable-Length Markov Models of Behavior , 2001, Comput. Vis. Image Underst..

[6]  Narendra Ahuja,et al.  Recognizing hand gesture using motion trajectories , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[7]  D. M. Hutton,et al.  Smart Environments: Technology, Protocols and Applications , 2005 .

[8]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[9]  Isaac Cohen,et al.  Posture and Gesture Recognition using 3D Body Shapes Decomposition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[10]  Adina Magda Florea,et al.  A Multi-agent System for Human Activity Recognition in Smart Environments , 2011, IDC.

[11]  Henrietta Hardy Mrs Hammond The complete guide , 1883 .