论文信息 - Sign Language Recognition Using Kinect

Sign Language Recognition Using Kinect

An open source framework for general gesture recognition is presented and tested with isolated signs of sign language. Other than common systems for sign language recognition, this framework makes use of Kinect, a depth camera which makes real-time 3D-reconstruction easily applicable. Recognition is done using hidden Markov models with a continuous observation density. The framework also offers an easy way of initializing and training new gestures or signs by performing them several times in front of the camera. First results with a recognition rate of 97% show that depth cameras are well-suited for sign language recognition.

[1] Lawrence R. Rabiner,et al. A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[2] Marc Parizeau,et al. Training Hidden Markov Models with Multiple Observations-A Combinatorial Method , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3] Penny Boyes Breaem. Einführung in die Gebärdensprache und ihre Ertorschung , 1995 .

[4] Alex Pentland,et al. Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[5] Daniel Kelly,et al. Recognizing Spatiotemporal Gestures and Movement Epenthesis in Sign Language , 2009, 2009 13th International Machine Vision and Image Processing Conference.

[6] Hermann Ney,et al. Speech recognition techniques for a sign language recognition system , 2007, INTERSPEECH.

[7] Dimitris N. Metaxas,et al. ASL recognition based on a coupling between HMMs and 3D motion analysis , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).