KAZOO: a sign language generation platform based on production rules

AbstractThis paper describes KAZOO, a web application for sign language (SL) generation using a virtual signer. Firstly, it explains the motivation to this project, which is grounded on an approach designed solely from SL corpus analysis and modelling. Then, various projects conducted in the past few years on linguistic modelling and 3D animation are presented. The platform’s architecture integrates parts of this work and new pieces of software allowing control and linking of all these components. This is an ongoing project, though the current version offers the possibility to animate a virtual signer automatically and synthesize the contents using an abstract representation, the authors’ own linguistic model AZee, providing a means of validating this model.

[1]  Annelies Braffort,et al.  What constraints for representing multilinearity in Sign language ? , 2012 .

[2]  Chung-Hsien Wu,et al.  Transfer-based statistical translation of Taiwanese sign language using PCFG , 2007, TALIP.

[3]  Maxime Delorme,et al.  Modélisation du squelette pour la génération réaliste de postures de la langue des signes française. (Skeleton modelling for the realistic generation of french sign language postures) , 2011 .

[4]  Michael Filhol,et al.  Thumb Modelling for the Generation of Sign Language , 2011, Gesture Workshop.

[5]  Petros Maragos,et al.  Sign Language technologies and resources of the Dicta-Sign project , 2012 .

[6]  Annelies Braffort,et al.  Toward Modeling Sign Language Coarticulation , 2009, Gesture Workshop.

[7]  Peter Cook,et al.  Linguistics As Structure In Computer Animation: Toward A More Effective Synthesis Of Brow Motion In American Sign Language , 2011 .

[8]  Michael Filhol.  Combining Two Synchronisation Methods in a Linguistic Model to Describe Sign Language , 2011, Gesture Workshop.

[9]  Alexis Héloir,et al.  Assessing the deaf user perspective on sign language avatars , 2011, ASSETS.

[10]  Mitchell P. Marcus,et al.  Generating american sign language classifier predicates for english-to-asl machine translation , 2006 .

[11]  Michael Filhol,et al.  A rule triggering system for automatic text-to-sign translation , 2016, Universal Access in the Information Society.

[12]  Michael Filhol,et al.  Modèle descriptif des signes pour un traitement automatique des langues des signes. (A descriptive model of signs for Sign Language processing) , 2008 .

[13]  Annelies Braffort,et al.  Analysis and Description of Blinking in French Sign Language for Automatic Generation , 2011, Gesture Workshop.

[14]  Ian Marshall,et al.  Grammar Development for Sign Language Avatar-Based Synthesis , 2005 .

[15]  Annelies Braffort,et al.  Virtual Signer Coarticulation in Octopus, a Sign Language Generation Platform , 2012 .

[16]  J. Segouat.  Modélisation de la coarticulation en Langue des Signes Française pour la diffusion automatique d'informations en gare ferroviaire à l'aide d'un signeur virtuel , 2010 .

[17]  John Glauert,et al.  Requirements For A Signing Avatar , 2010 .

[18]  Alexis Héloir,et al.  Sign Language Avatars: Animation and Comprehensibility , 2011, IVA.

[19]  José Colás Pasamontes,et al.  Hybrid paradigm for Spanish Sign Language synthesis , 2011, Universal Access in the Information Society.

[20]  Javier Macías Guarasa,et al.  Speech to sign language translation system for Spanish , 2008, Speech Commun..

[21]  Matt Huenerfauth,et al.  Effect of spatial reference and verb inflection on the usability of sign language animations , 2011, Universal Access in the Information Society.

[22]  Sara Morrissey.  Assessing Three Representation Methods for Sign Language Machine Translation and Evaluation , 2011 .