Device independence and extensibility in gesture recognition

Gesture recognition techniques often suffer from being highly device-dependent and hard to extend. If a system is trained using data from a specific glove input device, that system is typically unusable with any other input device. The set of gestures that a system is trained to recognize is typically not extensible, without retraining the entire system. We propose a novel gesture recognition framework to address these problems. This framework is based on a multi-layered view of gesture recognition. Only the lowest layer is device dependent, it converts raw sensor values produced by the glove to a glove-independent semantic description of the hand. The higher layers of our framework can be reused across gloves, and are easily extensible to include new gestures. We have experimentally evaluated our framework and found that it yields comparable performance to conventional techniques, while substantiating our claims of device independence and extensibility.

[1]  Ching Y. Suen,et al.  n-Gram Statistics for Natural Language Understanding and Text Processing , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[3]  Kouichi Murakami,et al.  Gesture recognition using recurrent neural networks , 1991, CHI.

[4]  Richard Furuta,et al.  A logical hand device in virtual environments , 1994 .

[5]  Gregory B. Newby Gesture Recognition Based upon Statistical Similarity , 1994, Presence: Teleoperators & Virtual Environments.

[6]  Thad Starner,et al.  Visual Recognition of American Sign Language Using Hidden Markov Models. , 1995 .

[7]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[8]  Craig A. Will,et al.  Review of Virtual Environment Interface Technology. , 1996 .

[9]  Ming Ouhyoung,et al.  A sign language recognition system using hidden markov model and context sensitive search , 1996, VRST.

[10]  Dieter Schmalstieg,et al.  Device-Independent Navigation and Interaction in Virtual Environments , 1998 .

[11]  Ralf Salomon,et al.  Gesture recognition for virtual reality applications using data gloves and neural networks , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[12]  Cyrus Shahabi,et al.  Alternative representations and abstractions for moving sensors databases , 2001, CIKM '01.

[13]  Wen Gao,et al.  Signer-Independent Continuous Sign Language Recognition Based on SRN/HMM , 2001, Gesture Workshop.

[14]  Wen Gao,et al.  Signer-independent sign language recognition based on SOFM/HMM , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[15]  Cyrus Shahabi,et al.  Analysis of clustering techniques to detect hand signs , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[16]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[17]  Donghui Yan,et al.  Multi-Layer Gesture Recognition : An Experimental Evaluation , 2022 .