论文信息 - iFACE: A 3D Synthetic Talking Face

iFACE: A 3D Synthetic Talking Face

We present the iFACE system, a visual speech synthesizer that provides a form of virtual face-to-face communication. The system provides an interactive tool for the user to customize a graphic head model for the virtual agent of a person based on his/her range data. The texture is mapped onto the customized model to achieve a realistic appearance. Face animations are produced by using text stream or speech stream to drive the model. A set of basic facial shapes and head action is manually built and used to synthesize expressive visual speech based on rules.

[1] Frederic I. Parke,et al. A parametric model for human faces. , 1974 .

[2] Thomas S. Huang,et al. Final Report To NSF of the Planning Workshop on Facial Expression Understanding , 1992 .

[3] Michael M. Cohen,et al. Modeling Coarticulation in Synthetic Visual Speech , 1993 .

[4] Pertti Roivainen,et al. 3-D Motion Estimation in Model-Based Facial Image Coding , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[5] Thoms M. Levergood,et al. DEC face: an automatic lip-synchronization algorithm for synthetic faces , 1993 .

[6] Kiyoharu Aizawa,et al. Model-based image coding , 1994, Other Conferences.

[7] Speech dialogue with facial displays , 1994, CHI '94.

[8] Demetri Terzopoulos,et al. Realistic modeling for facial animation , 1995, SIGGRAPH.

[9] Bertrand Le Goff,et al. A text-to-audiovisual-speech synthesizer for French , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[10] Thomas S. Huang,et al. 3-D Face Modeling and Its Applications , 1996, Int. J. Pattern Recognit. Artif. Intell..

[11] David Salesin,et al. Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH.

[12] Jörn Ostermann,et al. User evaluation: Synthetic talking faces for interactive services , 1999, The Visual Computer.

[13] Matthew Turk,et al. A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[14] Henrique S. Malvar,et al. Making faces , 1998, SIGGRAPH Courses.