A new method for generating 3-D face models for personalized user interaction

A new method for generating and animating a 3-D model of a person's face is proposed. The method involves novel algorithms for 2-D to 3-D construction under perspective projection model, real-time mesh deformation using a lower-resolution control mesh, and texture image creation that involves texture blending in 3-D. The resulting face models can be readily used in 3-D games, mobile messaging, e-learning applications such as lip-reading and personalized training, 3-D movies and 3-D TV programs, and for providing human-computer interaction (HCI). User interfaces with personalized face models could be used to guide people in accessing knowledge and information on the Internet or to facilitate the usage of computers and software. Thus, it is believed that the utilization of personalized 3-D face models will help bring down the barrier between computers and people.

[1]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[2]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[3]  Takeo Kanade,et al.  A sequential factorization method for recovering shape and motion from image streams , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Keith Waters,et al.  Computer facial animation , 1996 .

[5]  Fabio Lavagetto,et al.  The facial animation engine: toward a high-level interface for the design of MPEG-4 compliant animated faces , 1999, IEEE Trans. Circuits Syst. Video Technol..

[6]  A. Murat Tekalp,et al.  Face and 2-D mesh animation in MPEG-4 , 2000, Signal Process. Image Commun..

[7]  Nadia Magnenat-Thalmann,et al.  Automatic 3D cloning and real-time animation of a human face , 1997, Proceedings. Computer Animation '97 (Cat. No.97TB100120).

[8]  Adrian Hilton,et al.  Building Layered Animation Models from Captured Data , 1999, Computer Animation and Simulation.

[9]  Gang Wang,et al.  Registration and Integration of Multiple Object Views for 3D Model Construction , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[11]  Norman I. Badler,et al.  Animating facial expressions , 1981, SIGGRAPH '81.