Toward Modeling Sign Language Coarticulation

This article presents a study on coarticulation modeling in French Sign Language. Our aim is to use this model to provide information to deaf people, by the mean of a virtual signer. We propose a definition for “coarticulation”, based on an overview of the literature. We explain the methodology we have set up: from video corpus design to features correlations extractions, through corpus annotations and analysis. We expose first results and what are going to be the next steps of this study.

[1]  Ruiduo Yang,et al.  Enhanced Level Building Algorithm for the Movement Epenthesis Problem in Sign Language Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Gineke ten Petra Tjeerd Holt,et al.  Why Don't You See What I Mean? Prospects and Limitations of Current Automatic Sign Recognition Research , 2006 .

[3]  Marie-Anne Sallandre,et al.  Simultaneity in French Sign Language Discourse , 2007 .

[4]  Dimitris N. Metaxas,et al.  American sign language recognition: reducing the complexity of the task with phoneme-based modeling and parallel hidden markov models , 2003 .

[5]  Myriam Vermeerbergen,et al.  Simultaneity in signed languages: form and function , 2007 .

[6]  Ian Marshall,et al.  Linguistic modelling and language-processing technologies for Avatar-based sign language presentation , 2008, Universal Access in the Information Society.

[7]  A. Benguerel,et al.  Coarticulation of Upper Lip Protrusion in French , 1974, Phonetica.

[8]  Annelies Braffort,et al.  Toward the Study of Sign Language Coarticulation: Methodology Proposal , 2009, 2009 Second International Conferences on Advances in Computer-Human Interactions.

[9]  G. Ferre.  Christian Cuxac, La Langue des Signes Française (LSF) : les voies de l'iconicité, Paris-Gap, Ophrys, Bibliothèque de Faits de Langues n°15 -16, 2000 , 2003 .

[10]  Virginia Teller.  Review of Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition by Daniel Jurafsky and James H. Martin. Prentice Hall 2000. , 2000 .

[11]  James H. Martin,et al.  Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition, 2nd Edition , 2000, Prentice Hall series in artificial intelligence.

[12]  Michael Filhol,et al.  Modèle descriptif des signes pour un traitement automatique des langues des signes. (A descriptive model of signs for Sign Language processing) , 2008 .

[13]  Mark Wells,et al.  Tessa, a system to aid communication with deaf people , 2002, ASSETS.

[14]  Mitchell P. Marcus,et al.  Generating american sign language classifier predicates for english-to-asl machine translation , 2006 .

[15]  James H. Martin,et al.  Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition , 2000 .

[16]  Sidney A J Wood,et al.  Assimilation or coarticulation? Evidence from the coordination of tongue gestures for the palatalization of Bulgarian alveolar stops. , 1996 .

[17]  Michael Kipp,et al.  ANVIL - a generic annotation tool for multimodal dialogue , 2001, INTERSPEECH.