Recommending the Workflow of Vietnamese Sign Language Translation via a Comparison of Several Classification Algorithms

The Vietnamese deaf community communicates via a special language called Vietnamese Sign Language (VSL). Three-dimensional space and hand gesture are primarily used to convey meanings that allow deaf people to communicate among themselves and with non-deaf people around them. It maintains syntax, grammar, and vocabulary which is completely different from regular spoken and/or written Vietnamese. The normal procedure of transformation from spoken and/or written language (SWL) to VSL consists of consecutive steps: (i) Vietnamese word tokenization, (ii) machine translation into written sign language sentences, and (iii) conversion of these written sign language sentences into visual sign gesture. In this procedure, the second step gets the most attention due to the completion of the conveyed message. The basic challenge is that sign language, in general, has limited vocabulary compared to spoken/written language. If the machine translation is poorly performed, the complete message might not be successfully communicated, or in some cases, the conveyed message has a different meaning from the original. Consequently, the high accuracy translation should be maintained in any circumstances. This research is the efforts of evaluating an effective classification algorithm that the authors recommend to be integrated into the workflow of VSL translation. We believe that this is the first showing a quantitative comparison of several classification algorithms used in the workflow. The experimental results show that the translation accuracy rate is 96.7% which strongly support our recommendation.

[1]  Unfpa Viet Nam,et al.  People with disabilities in Viet Nam : key findings from the 2009 Viet Nam Population and Housing Census , 2011 .

[2]  Nguyen Thi Hoa,et al.  Where Sign Language Studies Has Led Us in Forty Years: Opening High School and University Education for Deaf People in Viet Nam through Sign Language Analysis, Teaching, and Interpretation , 2012 .

[3]  Chi-Ngon Nguyen,et al.  Conversion of the Vietnammese Grammar into Sign Language Structure using the Example-Based Machine Translation Algorithm , 2018, 2018 International Conference on Advanced Technologies for Communications (ATC).

[4]  Ralph Weischedel,et al.  A STUDY OF TRANSLATION ERROR RATE WITH TARGETED HUMAN ANNOTATION , 2005 .

[5]  Hô Tuòng Vinh,et al.  A Hybrid Approach to Word Segmentation of Vietnamese Texts , 2008, LATA.

[6]  Makoto Nagao,et al.  A framework of a mechanical translation between Japanese and English by analogy principle , 1984 .

[7]  Richard Kennaway,et al.  Experience with and Requirements for a Gesture Description Language for Synthetic Animation , 2003, Gesture Workshop.

[8]  John Glauert,et al.  Requirements For A Signing Avatar , 2010 .

[9]  Ashok Kumar Sahoo,et al.  SIGN LANGUAGE RECOGNITION: STATE OF THE ART , 2014 .

[10]  Hung D. Nguyen,et al.  A glove-based gesture recognition system for Vietnamese sign language , 2015, 2015 15th International Conference on Control, Automation and Systems (ICCAS).

[11]  Susan T. Dumais,et al.  Inductive learning algorithms and representations for text categorization , 1998, CIKM '98.