Educational resources and implementation of a Greek sign language synthesis architecture

In this paper, we present how creation and dynamic synthesis of linguistic resources of Greek Sign Language (GSL) may serve to support development and provide content to an educational multitask platform for the teaching of GSL in early elementary school classes. The presented system utilizes standard virtual character (VC) animation technologies for the synthesis of sign sequences/streams, exploiting digital linguistic resources of both lexicon and grammar of GSL. Input to the system is written Greek text, which is transformed into GSL and animated on screen. To achieve this, a syntactic parser decodes the structural patterns of written Greek and matches them into equivalent patterns of GSL, which are then signed by a VC. The adopted notation system for the representation of GSL phonology incorporated in the system's lexical knowledge database, is Hamburg Notation System (HamNoSys). For the implementation of the virtual signer tool, the definition of the VC follows the h-anim standard and is implemented in a web browser using a standard VRML plug-in.

[1]  Richard Kennaway,et al.  Synthetic Animation of Deaf Signing Gestures , 2001, Gesture Workshop.

[2]  Stavroula-Evita Fotinea,et al.  An adaptation-based technique on current educational tools to support universal access: the case of a GSL e-Learning platform , 2004 .

[3]  Scott K. Liddell.  American Sign Language Syntax , 1981 .

[4]  Constantine Stephanidis,et al.  Universal Access in the Information Society: Methods, Tools, and Interaction Technologies , 2001, Universal Access in the Information Society.

[5]  Catherine Pelachaud,et al.  From Greta's mind to her face: modelling the dynamics of affective states in a conversational embodied agent , 2003, Int. J. Hum. Comput. Stud..

[6]  Richard A. Tennant,et al.  The American Sign Language Handshape Dictionary , 1998 .

[7]  U. Bellugi,et al.  A comparison of sign language and spoken language , 1972 .

[8]  W. Stokoe.  Sign Language Structure , 1980 .

[9]  S. Kollias,et al.  " Moving " Avatars : Emotion Synthesis in Virtual Worlds , 2003 .

[10]  Ioanna Antoniou-Kritikou,et al.  A multimedia Storyboard as an Object and as a Starting Point for Language Learning , 2001 .

[11]  Richard Kennaway,et al.  Experience with and Requirements for a Gesture Description Language for Synthetic Animation , 2003, Gesture Workshop.

[12]  Zhisheng Huang,et al.  STEP: a Scripting Language for Embodied Agents , 2004, Life-like characters.

[13]  Sherman Wilcox,et al.  Multimedia dictionary of American Sign Language , 1994, ASSETS.

[14]  R.A. Foulds,et al.  Biomechanical and perceptual constraints on the bandwidth requirements of sign language , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  David Brien,et al.  Dictionary of British sign language/English , 1992 .

[16]  Annemarie Hauf,et al.  Computers in education , 1983 .

[17]  John O. Isenhath.  The Linguistics of American Sign Language , 1990 .

[18]  Bencie Woll,et al.  The Linguistics of British Sign Language: An Introduction , 1999 .

[19]  Ceil Lucas,et al.  Sign Language Research , 2001 .

[20]  PelachaudCatherine,et al.  From Greta's mind to her face , 2003 .

[21]  Frieda Charalabopoulou,et al.  Developing a multilingual platform for language learning using the new technologies , 2003 .

[22]  Constantine Stephanidis,et al.  Universal access in the information society , 1999, HCI.

[23]  Stavroula-Evita Fotinea,et al.  Multipurpose Design and Creation of GSL Dictionaries , 2004 .

[24]  Kostas Karpouzis,et al.  Developing an e-Learning Platform for the Greek Sign Language , 2004, ICCHP.

[25]  Frank Maddix.  Human-computer interaction - theory and practice , 1990, Ellis Horwood series in computers and their applications.

[26]  Great Britain. Hm Factory Inspectorate.  An introductory guide , 1987 .

[27]  G. Carayannis,et al.  Design and implementation of mini-Webs for educational uses , 2001, Proceedings 2001 Symposium on Applications and the Internet Workshops (Cat. No.01PR0945).

[28]  P. Siple,et al.  Theoretical issues in sign language research , 1990 .

[29]  Stelios Piperidis,et al.  A Robust Parser for Unrestricted Greek Text , 2000, LREC.

[30]  Constantine Stephanidis,et al.  Human-computer interaction : theory and practice , 2003 .