SignON: Bridging the gap between Sign and Spoken Languages

: This article presents an overview of the SignON European project which aims to develop technology for automatic translation between sign and oral languages (and vice-versa). In order to achieve this objective, the project takes a multi-disciplinary approach by involving the deaf community, sign language linguistics, research in sign language recognition, speech recognition, natural language processing and machine translation (MT), 3D animation and avatar technology, and application development. The project follows a user-centered, community driven approach to the development of technology.

[1]  Mieke Van Herreweghe,et al.  Sign Language Recognition with Transformer Networks , 2020, LREC.

[2]  Jesse Read,et al.  Better Sign Language Translation with STMC-Transformer , 2020, COLING.

[3]  Marjan Ghazvininejad,et al.  Multilingual Denoising Pre-training for Neural Machine Translation , 2020, Transactions of the Association for Computational Linguistics.

[4]  Meredith Ringel Morris,et al.  Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective , 2019, ASSETS.

[5]  Xiaojun Wan,et al.  Automatic Text Simplification , 2018, Computational Linguistics.

[6]  Lijun Wu,et al.  Achieving Human Parity on Automatic Chinese to English News Translation , 2018, ArXiv.

[7]  Guillaume Lample,et al.  Unsupervised Machine Translation Using Monolingual Corpora Only , 2017, ICLR.

[8]  Martin Wattenberg,et al.  Google’s Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation , 2016, TACL.

[9]  Collin F. Baker.  FrameNet: A Knowledge Base for Natural Language Processing , 2014 .

[10]  José Colás Pasamontes,et al.  A rule-based translation from written Spanish to Spanish Sign Language glosses , 2014, Comput. Speech Lang..

[11]  Filip Loncke,et al.  The handbook of psycholinguistic and cognitive processes : perspectives in communication disorders , 2011 .

[12]  Myriam Vermeerbergen,et al.  Sign Languages and Sign Language Research , 2010 .

[13]  Sara Morrissey,et al.  Data-Driven Machine Translation for Sign Languages , 2008 .

[14]  J. Huisman.  The Netherlands , 1996, The Lancet.

[15]  Miles Osborne,et al.  Statistical Machine Translation , 2010, Encyclopedia of Machine Learning and Data Mining.