Comparison of Finite-Repertoire and Data-Driven Facial Expressions for Sign Language Avatars

To support our research on ASL animation synthesis, we have adopted and enhanced a new virtual human animation platform that provides us with greater fine-grained control of facial movements than our previous platform. To determine whether this new platform is sufficiently expressive to generate understandable ASL animations, we analyzed responses collected from deaf participants who evaluated four types of animations: generated by our old or new animation platform, and with or without facial expressions performed by the character. For animations without facial expressions, our old and new plat-forms had equivalent comprehension scores; for those with facial expressions, our new platform had higher scores. In addition, this paper demonstrates a methodology by which sign language animation researchers can document transitions in their animation platforms or avatar appearance. Performing such an evaluation enables future readers to compare published results over time, both before and after such a transition in animation technology.

[1]  Nicoletta Adamo-Villani,et al.  Software for math and science education for the deaf , 2010, Disability and rehabilitation. Assistive technology.

[2]  Matt Huenerfauth,et al.  Effect of Displaying Human Videos During an Evaluation Study of American Sign Language Animation , 2013, TACC.

[3]  Matt Huenerfauth,et al.  Implementation and evaluation of animation controls sufficient for conveying ASL facial expressions , 2014, ASSETS.

[4]  T. Pejsa,et al.  Architecture of an animation system for human characters , 2009, 2009 10th International Conference on Telecommunications.

[5]  Ulrike Zeshan,et al.  Interrogative and negative constructions in sign languages , 2006 .

[6]  Hernisa Kacorri,et al.  TR-2015001: A Survey and Critique of Facial Expression Synthesis in Sign Language Animation , 2015 .

[7]  John Glauert,et al.  Exploiting the full potential of JASigning to build an avatar signing train announcements , 2013 .

[8]  Nicolas Courty,et al.  The SignCom system for data-driven animation of interactive virtual signers , 2011, ACM Trans. Interact. Intell. Syst..

[9]  Alexis Héloir,et al.  Assessing the deaf user perspective on sign language avatars , 2011, ASSETS.

[10]  Matt Huenerfauth,et al.  Spatial and planning models of ASL classifier predicates for machine translation , 2004, TMI.

[11]  Donald J. Schuirmann A comparison of the Two One-Sided Tests Procedure and the Power Approach for assessing the equivalence of average bioavailability , 1987, Journal of Pharmacokinetics and Biopharmaceutics.

[12]  Stavroula-Evita Fotinea,et al.  Sign Language Computer-Aided Education: Exploiting GSL Resources and Technologies for Web Deaf Communication , 2012, ICCHP.

[13]  Andrew Rosenberg,et al.  Evaluating importance of facial expression in american sign language and pidgin signed english animations , 2011, ASSETS.

[14]  Hermann Ney,et al.  Enhancing gloss-based corpora with facial features using active appearance models , 2013 .

[15]  C. B. Traxler,et al.  The Stanford Achievement Test, 9th Edition: National Norming and Performance Standards for Deaf and Hard-of-Hearing Students. , 2000, Journal of deaf studies and deaf education.

[16]  Brian Nolan,et al.  Manual evaluation of synthesised sign language avatars , 2013, ASSETS.

[17]  R. Mitchell,et al.  How Many People Use ASL in the United States? Why Estimates Need Updating , 2006 .

[18]  Peter Cook,et al.  Linguistics As Structure In Computer Animation: Toward A More Effective Synthesis Of Brow Motion In American Sign Language , 2011 .

[19]  Ian Marshall,et al.  Linguistic modelling and language-processing technologies for Avatar-based sign language presentation , 2008, Universal Access in the Information Society.

[20]  Nicoletta Adamo-Villani,et al.  A non-expert-user interface for posing signing avatars , 2013, Disability and rehabilitation. Assistive technology.

[21]  A. Héloir,et al.  Towards an Intuitive Sign Language Animation Authoring Environment For the Deaf , 2013 .

[22]  Judith A. Holt Stanford Achievement Test—8th Edition: Reading Comprehension Subgroup Results , 1993 .