论文信息 - Facial animation system for embedded application

Facial animation system for embedded application

This paper describes a prototype implementation of a speech driven facial animation system for embedded devices. The system is comprised of speech recognition and talking head synthesis. A context-based visubsyllable database is set up to map Chinese initials or finals to their corresponding pronunciation mouth shape. With the database, 3D facial animation can be synthesized based on speech signal input. Experiment results show the system works well in simulating real mouth shapes and forwarding a friendly interface in communication terminals.

Chun Chen | Jiajun Bu | Mingyu You

[1] Nadia Magnenat-Thalmann,et al. Visyllable Based Speech Animation , 2003, Comput. Graph. Forum.

[2] Christoph Bregler,et al. Video Rewrite: Driving Visual Speech with Audio , 1997, SIGGRAPH.

[3] Daniel Thalmann,et al. Models and Techniques in Computer Animation , 2014, Computer Animation Series.

[4] Bernhard Rinner,et al. A TMS320C40 based Speech Recognition System for Embedded Applications , 2007 .

[5] Zuo Li. Data Mining and Speech Driven Face Animation , 2002 .

[6] Cai Lianhong. Study of Chinese viseme , 2002 .

[7] Laurence T. Yang,et al. Proceedings of the 3rd international conference on Embedded Software and Systems , 2007 .

[8] Tzong-Jer Yang,et al. A speech driven talking head system based on a single face image , 1999, Proceedings. Seventh Pacific Conference on Computer Graphics and Applications (Cat. No.PR00293).