Multi-Layer Gesture Recognition : An Experimental Evaluation

Gesture recognition techniques often suffer from being highly device-dependent and hard to extend. If a system is trained using data from a specific glove input device, that system is typically unusable with any other input device. The set of gestures that a system is trained to recognize is typically not extensible, without retraining the entire system. We propose a novel gesture recognition framework to address these problems. This framework is based on a multi-layered view of gesture recognition. Only the lowest layer is device dependent; it converts raw sensor values produced by the glove to a glove-independent semantic description of the hand. The higher layers of our framework can be reused across gloves, and are easily extensible to include new gestures. We have experimentally evaluated our framework and found that it yields at least as good performance as conventional techniques, while substantiating our claims of device independence and extensibility.

[1]  Ching Y. Suen,et al.  n-Gram Statistics for Natural Language Understanding and Text Processing , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[3]  Jaron Lanier,et al.  A hand gesture interface device , 1987, CHI 1987.

[4]  Kouichi Murakami,et al.  Gesture recognition using recurrent neural networks , 1991, CHI.

[5]  W. B. Cavnar,et al.  N-Gram-Based Text Filtering For TREC-2 , 1993, TREC.

[6]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[7]  Richard Furuta,et al.  A logical hand device in virtual environments , 1994 .

[8]  Gregory B. Newby Gesture Recognition Based upon Statistical Similarity , 1994, Presence: Teleoperators & Virtual Environments.

[9]  Thad Starner,et al.  Visual Recognition of American Sign Language Using Hidden Markov Models. , 1995 .

[10]  Craig A. Will,et al.  Review of Virtual Environment Interface Technology. , 1996 .

[11]  Ming Ouhyoung,et al.  A sign language recognition system using hidden markov model and context sensitive search , 1996, VRST.

[12]  Dieter Schmalstieg,et al.  Device-Independent Navigation and Interaction in Virtual Environments , 1998 .

[13]  Ralf Salomon,et al.  Gesture recognition for virtual reality applications using data gloves and neural networks , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[14]  Cyrus Shahabi,et al.  Alternative representations and abstractions for moving sensors databases , 2001, CIKM '01.

[15]  Wen Gao,et al.  Signer-Independent Continuous Sign Language Recognition Based on SRN/HMM , 2001, Gesture Workshop.

[16]  Cyrus Shahabi,et al.  Analysis of clustering techniques to detect hand signs , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[17]  P. Kantor Foundations of Statistical Natural Language Processing , 2001, Information Retrieval.