Towards Interactive Web-Based Virtual Signers: First Step, a Platform for Experimentation Design

In this paper, we present a Web-based framework for interactive Sign Language using virtual signing agents. The main feature of this framework is that it is a full DOM-Integrated architecture. Firstly, we discuss the advantages and the constraints raised by the implementation of proper interactive Virtual Signers within this full DOM-integrated approach. Secondly, we discuss an experimental study about Web-based Virtual Signers that take advantage of the specific interactivity provided by our framework. This study deals with a structure of Sign Language utterances that requires dynamic handling of spatio-temporal variability and coarticulation stances in the sign generation phase.

[1]  Jérémie Segouat.  A study of sign language coarticulation , 2009, ASAC.

[2]  Olivier Losson,et al.  An assistive interface for learning lexical corpus employing a virtual signer , 2001 .

[3]  James C. Lester,et al.  The persona effect: affective impact of animated pedagogical agents , 1997, CHI.

[4]  Stavroula-Evita Fotinea,et al.  Special issue: “Emerging Technologies for Deaf Accessibility in the Information Society” , 2007, Universal Access in the Information Society.

[5]  G. Ferre.  Christian Cuxac, La Langue des Signes Française (LSF) : les voies de l'iconicité, Paris-Gap, Ophrys, Bibliothèque de Faits de Langues n°15 -16, 2000 , 2003 .

[6]  Buisine Stéphanie,et al.  Towards Experimental Specification and Evaluation of Lifelike Multimodal Behavior , 2002 .

[7]  Ian Marshall,et al.  Linguistic modelling and language-processing technologies for Avatar-based sign language presentation , 2008, Universal Access in the Information Society.

[8]  Neil Randall,et al.  Who exactly is trying to help us? The ethos of help systems in popular computer applications , 1998, SIGDOC '98.

[9]  Christian Cuxac,et al.  La langue des signes francaise (LSF) : les voies de l'iconicité , 2000 .

[10]  Jean-Paul Sansonnet,et al.  SL Teacher: a Framework for teaching LSF on the Web , 2009, ICTA.

[11]  Pattie Maes,et al.  Agents that reduce work and information overload , 1994, CACM.

[12]  Jean-Claude Martin,et al.  Architecture of a Framework for Generic Assisting Conversational Agents , 2006, IVA.

[13]  Mitsuru Ishizuka,et al.  Persona Effect Revisited --- Using Bio-signals to Measure and Reflect the Impact of Character-bas , 2003 .

[14]  Nicolas Courty,et al.  Gesture in Human-Computer Interaction and Simulation , 2006 .

[15]  Bedrich Benes,et al.  A Natural Interface for Sign Language Mathematics , 2006, ISVC.

[16]  Scott K. Liddell.  Grammar, Gesture, and Meaning in American Sign Language , 2003 .

[17]  Mitsuru Ishizuka,et al.  Persona Effect Revisited , 2003, IVA.

[18]  MATT HUENERFAUTH.  Spatial, Temporal, and Semantic Models for American Sign Language Generation: Implications for Gesture Generation , 2008, Int. J. Semantic Comput..

[19]  Annelies Braffort,et al.  Sign language applications: preliminary modeling , 2008, Universal Access in the Information Society.

[20]  Alexis Héloir,et al.  Captured Motion Data Processing for Real Time Synthesis of Sign Language , 2005, Gesture Workshop.