Full Skeleton-based Virtual Human Animation: An Improved Design for SL Avatars

ABSTRACT This paper presents a novel skeleton design for avatar animation. This design includes new bones, whose purpose is to meet the requirements of sign language (SL) synthesis. SL synthesis presents particular challenges regarding the processing of phonetic descriptions of signs to create animations. Although traditional animation techniques have solved the synthesis of signs, the proposed skeleton design allows for the simplification of the phonetic processing, the inverse kinematics calculations, and the collision avoidance processes. The proposed design has been tested to demonstrate that the generated animations have the same quality as the ones produced with state-of-the-art techniques. Importantly, the proposed structure reduces the time required for generating an animation by 52% compared to existing solutions and requires less storage resources.

[1]  Theodore Kim,et al.  Physics-Based Character Skinning Using Multidomain Subspace Deformations , 2011, IEEE Transactions on Visualization and Computer Graphics.

[2]  Fernando López-Colino,et al.  Integration of a talking head into a Spanish Sign Language synthesizer , 2009 .

[3]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.

[4]  Hainan Zhao,et al.  Avatars based Chinese Sign Language Synthesis System , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[5]  John Glauert,et al.  Requirements For A Signing Avatar , 2010 .

[6]  Mark Wells,et al.  Virtual signing: capture, animation, storage and transmission-an overview of the ViSiCAST project , 2000 .

[7]  Rosalee Wolfe,et al.  Combining emotion and facial nonmanual signals in synthesized american sign language , 2012, ASSETS '12.

[8]  David Oyarzun,et al.  Three-dimensional whole body of virtual character animation for its behavior in a virtual environment using H-Anim and Inverse kinematics , 2004 .

[9]  Matt Huenerfauth,et al.  American Sign Language natural language generation and machine translation , 2005, ASAC.

[10]  Sunghee Choi,et al.  Automatic pose-independent 3D garment fitting , 2013, Comput. Graph..

[11]  José Colás Pasamontes,et al.  Spanish Sign Language synthesis system , 2012, J. Vis. Lang. Comput..

[12]  Mohd Shahrizal Sunar,et al.  Survey of Shadow Volume Algorithms in Computer Graphics , 2013 .

[13]  Nadia Magnenat-Thalmann,et al.  Dirichlet free-form deformations and their application to hand simulation , 1997, Proceedings. Computer Animation '97 (Cat. No.97TB100120).

[14]  Jacob D. Furst,et al.  A Direct Method for Positioning the Arms of a Human Model , 2002, Graphics Interface.

[15]  Ian Marshall,et al.  Linguistic modelling and language-processing technologies for Avatar-based sign language presentation , 2008, Universal Access in the Information Society.

[16]  Daniel Thalmann,et al.  Real-Time Animation of Realistic Virtual Humans , 1998, IEEE Computer Graphics and Applications.

[17]  Mznah Al-Rodhaan,et al.  Vision-Based Sign Language Classification: A Directional Review , 2014 .

[18]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[19]  Daniel Thalmann,et al.  Full-Body Avatar Control with Environment Awareness , 2009, IEEE Computer Graphics and Applications.

[20]  G. Balakrishnan,et al.  Design and Development of Tamil Sign Alphabets using Image Processing with Right Hand Palm to Aid Deaf-Dumb People , 2013 .

[21]  Paolo Prinetto,et al.  Sign Language synthesis using hand motion acquisition , 2010, 2010 East-West Design & Test Symposium (EWDTS).

[22]  Zhigang Deng,et al.  A Statistical Quality Model for Data-Driven Speech Animation , 2012, IEEE Transactions on Visualization and Computer Graphics.

[23]  Richard Kennaway,et al.  Synthetic Animation of Deaf Signing Gestures , 2001, Gesture Workshop.

[24]  Lionel Revéret,et al.  Natural Character Posing from a Large Motion Database , 2011, IEEE Computer Graphics and Applications.

[25]  Hui Yu,et al.  Perception-driven facial expression synthesis , 2012, Comput. Graph..

[26]  S. Buss Introduction to Inverse Kinematics with Jacobian Transpose , Pseudoinverse and Damped Least Squares methods , 2004 .