Adapting a speech into sign language translation system to a new domain

This paper presents a methodology for adapting an advanced communication system for deaf people in a new domain. This methodology is a user-centered design approach consisting of four main steps: requirement analysis, parallel corpus generation, technology adaptation to the new domain, and finally, system evaluation. In this paper, the new considered domain has been the dialogues in a hotel reception. With this methodology, it was possible to develop the system in a few months, obtaining very good performance: good speech recognition and translation rates (around 90%) with small processing times.

[1]  Antonio García,et al.  Spoken Spanish generation from sign language , 2010, Interact. Comput..

[2]  Juan Carlos López,et al.  Increasing adaptability of a speech into sign language translation system , 2013, Expert Syst. Appl..

[3]  Trevor Darrell,et al.  Hidden Conditional Random Fields for Gesture Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[4]  Javier Macías Guarasa,et al.  Speech to sign language translation system for Spanish , 2008, Speech Commun..

[5]  Daniel Schneider,et al.  Rapid Signer Adaptation for Isolated Sign Language Recognition , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[6]  Antonio García,et al.  Paper title: Design, Development and Field Evaluation of a Spanish into Sign Language Translation System , 2009 .

[7]  Ian Marshall,et al.  Grammar Development for Sign Language Avatar-Based Synthesis , 2005 .

[8]  Mark Wells,et al.  Tessa, a system to aid communication with deaf people , 2002, ASSETS.

[9]  Hermann Ney,et al.  Statistical Sign Language Translation , 2004 .

[10]  Andy Way,et al.  An Example-Based Approach to Translating Sign Language , 2005, MTSUMMIT.

[11]  Munib Qutaishat,et al.  American sign language (ASL) recognition based on Hough transform and neural networks , 2007, Expert Syst. Appl..

[12]  Ralf D. Brown,et al.  Automated Generalization of Translation Examples , 2000, COLING.

[13]  I. Spanish.  AUTOMATIC CATEGORIZATION FOR IMPROVING SPANISH INTO SPANISH SIGN LANGUAGE MACHINE TRANSLATION , 2011 .

[14]  Rubén San-Segundo-Hernández,et al.  LSESpeak: A spoken language generator for Deaf people , 2013, Expert systems with applications.

[15]  Hermann Ney,et al.  Enhancing a Sign Language Translation System with Vision-Based Features , 2009, Gesture Workshop.