Continuous Sign Language Recognition – Approaches from Speech Recognition and Available Data Resources

In this paper we describe our current work on automatic conti nuous sign language recognition. We present an automatic si gn language recognition system that is based on a large vocabulary speec h r cognition system and adopts many of the approaches that a re conventionally applied in the recognition of spoken language. Fur thermore, we present a set of freely available databases tha t can be used for training, testing and performance evaluation of sign langu ge recognition systems. First results on one of the databas es are given, we show that the approaches from spoken language recognition a re suitable, and we give directions for further research.

[1]  Hermann Ney,et al.  A German Sign Language Corpus of the Domain Weather Report , 2006, LREC.

[2]  Hermann Ney,et al.  Tracking using dynamic programming for appearance-based sign language recognition , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[3]  Hermann Ney,et al.  Combination of Tangent Distance and an Image Distortion Model for Appearance-Based Sign Language Recognition , 2005, DAGM-Symposium.

[4]  Hermann Ney,et al.  Cross domain automatic transcription on the TC-STAR EPPS corpus , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[5]  David Windridge,et al.  A Linguistic Feature Vector for the Visual Interpretation of Sign Language , 2004, ECCV.

[6]  Stephen J. McKenna,et al.  An Experimental Comparison of Trajectory-Based and History-Based Representation for Gesture Recognition , 2003, Gesture Workshop.

[7]  Hermann Ney,et al.  The RWTH Large Vocabulary Speech Recognition System for Spontaneous Speech , 2000, KONVENS.

[8]  Hermann Hienz,et al.  Video-based continuous sign language recognition using statistical methods , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[9]  Carol Neidle,et al.  The Syntax of American Sign Language: Functional Categories and Hierarchical Structure , 1999 .

[10]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Dimitris N. Metaxas,et al.  Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methods , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[12]  Gerhard Rigoll,et al.  High Performance Real-Time Gesture Recognition Using Hidden Markov Models , 1997, Gesture Workshop.

[13]  Rachel Sutton-Spence,et al.  ECHO data set for British Sign Language (BSL) , 2004 .

[14]  Roland Pfau,et al.  [Review of: C. Neidle, et al. (2000) The syntax of American Sign Language: Functional categories and hierarchical structure] , 2002 .

[15]  Hermann Ney,et al.  Fast Search for Large Vocabulary Speech Recognition , 2000 .