Sign language applications: preliminary modeling

For deaf persons to have ready access to information and communication technologies (ICTs), the latter must be usable in sign language (SL), i.e., include interlanguage interfaces. Such applications will be accepted by deaf users if they are reliable and respectful of SL specificities—use of space and iconicity as the structuring principles of the language. Before developing ICT applications, it is necessary to model these features, both to enable analysis of SL videos and to generate SL messages by means of signing avatars. This paper presents a signing space model, implemented within a context of automatic analysis and automatic generation, which are currently under development.

[1]  Dimitris N. Metaxas,et al.  Handshapes and Movements: Multiple-Channel American Sign Language Recognition , 2003, Gesture Workshop.

[2]  Christian Cuxac,et al.  French Sign Language: Proposition of a Structural Explanation by Iconicity , 1999, Gesture Workshop.

[3]  Patrice Dalle,et al.  Using Signing Space as a Representation for Sign Language Processing , 2005, Gesture Workshop.

[4]  Annelies Braffort.  Research on Computer Science and Sign Language: Ethical Aspects , 2001, Gesture Workshop.

[5]  Richard Kennaway,et al.  Synthetic Animation of Deaf Signing Gestures , 2001, Gesture Workshop.

[6]  Richard Kennaway,et al.  Experience with and Requirements for a Gesture Description Language for Synthetic Animation , 2003, Gesture Workshop.

[7]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[8]  Dominique Boutet,et al.  Sign Language ( SL ) in Graphical Form : Methodology , modellisation and representations for gestural communication , 2006 .

[9]  Annelies Braffort.  ARGo: An Architecture for Sign Language Recognition and Interpretation , 1996, Gesture Workshop.

[10]  Paul Sabatier,et al.  A new Gesture Representation for Sign language analysis , 2004 .

[11]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[12]  Patrice Dalle,et al.  Vision-based Sign Language Processing Using a Predictive Approach and Linguistic Knowledge , 2005, MVA.

[13]  Hugo Mercier,et al.  Toward an efficient and accurate AAM fitting on appearance varying faces , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[14]  T. Pajdla,et al.  Computer vision -- ECCV 2004 : 8th European Conference on Computer Vision, Prague, Czech Republic, May 11-14, 2004 : proceedings , 2004 .

[15]  Scott K. Liddell.  Grammar, Gesture, and Meaning in American Sign Language , 2003 .

[16]  Alistair D. N. Edwards,et al.  Progress in Gestural Interaction, Proceedings of Gesture Workshop '96, March 19th 1996, University of York, UK , 1997, Gesture Workshop.

[17]  Annelies Braffort,et al.  Spatialised Semantic Relations in French Sign Language: Toward a Computational Modelling , 2005, Gesture Workshop.

[18]  Matt Huenerfauth.  Spatial Representation of Classifier Predicates for Machine Translation into American Sign Language , 2004 .

[19]  Diego Calvanese,et al.  The Description Logic Handbook , 2007 .

[20]  Ipke Wachsmuth,et al.  Gesture and Sign Language in Human-Computer Interaction , 1998, Lecture Notes in Computer Science.

[21]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Michael Filhol,et al.  A sequential approach to lexical sign description , 2006 .

[23]  Anne Braffort,et al.  Reconnaissance et comprehension de gestes, application a la langue des signes , 1996 .

[24]  Surendra Ranganath,et al.  Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Ian W. Marshall,et al.  Sign Language Generation in an ALE HPSG , 2004 .

[26]  Antonio Camurri,et al.  Gesture-Based Communication in Human-Computer Interaction , 2003, Lecture Notes in Computer Science.

[27]  David Windridge,et al.  A Linguistic Feature Vector for the Visual Interpretation of Sign Language , 2004, ECCV.

[28]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[29]  James F. Allen.  Towards a General Theory of Action and Time , 1984, Artif. Intell..

[30]  Nicolas Courty,et al.  Gesture in Human-Computer Interaction and Simulation , 2006 .