Real time gesture recognition system using posture classifier and Jordan recurrent neural network

This paper proposes a Jordan recurrent neural network (JRNN) based dynamic hand gesture recognition system. A set of allowed gestures is modeled by a sequence of representative static images, i.e., postures. The proposed system first classifies the input postures contained in the input video frames, and the JRNN finds the input gesture by detecting the temporal behavior of the posture sequence. To enhance the ability of the JRNN to identify the temporal behavior of its input sequence, a new training method has been proposed. Due to the proposed method, the system can recognize the reverse gestures. Implemented on a PC equipped with a USB camera for the live image acquisition, the proposed system can process 12.5 frames per second (fps). Experimental results show that the system can recognize 5 gestures with the accuracy of 99.0%, and recognize 9 gestures with 94.3% accuracy, respectively.

[1]  Reinhard Koch,et al.  Dynamic 3-D Scene Analysis Through Synthesis Feedback Control , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Chengdong Wu,et al.  Recognition of dynamic hand gesture based on SCHMM model , 2009, 2009 Chinese Control and Decision Conference.

[3]  Mubarak Shah,et al.  Motion-based recognition a survey , 1995, Image Vis. Comput..

[4]  Yael Edan,et al.  A Real-Time Hand Gesture Interface for Medical Visualization Applications , 2006 .

[5]  Hiroomi Hikawa,et al.  Study on gesture recognition system using posture classifier and Jordan recurrent neural network , 2011, The 2011 International Joint Conference on Neural Networks.

[6]  Yutaka Maeda,et al.  Comparison of range check classifier and hybrid network classifier for hand sign recognition system , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[7]  Kiyoshi Hoshino,et al.  Real time search for similar hand images from database for robotic hand control , 2004 .

[8]  Shigeki Matsubara,et al.  Pseudo RBF Network for Position Independent Hand Posture Recognition System , 2007, 2007 International Joint Conference on Neural Networks.

[9]  Michael I. Jordan.  Serial Order: A Parallel Distributed Processing Approach , 1997 .

[10]  Ho-Sub Yoon,et al.  Recognition of alphabetical hand gestures using hidden Markov model , 1999 .

[11]  Yutaka Maeda,et al.  Hand sign recognition system based on hybrid network classifier , 2009, 2009 International Joint Conference on Neural Networks.

[12]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[13]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..