A Video Based Personalized Face Model Generation Approach for Network 3D Games

We have developed a fast generation system for personalized 3D face model and plan to apply it in network 3D games. This system uses one video camera to capture player’s frontal face image for 3D modeling and dose not need calibration and plentiful manual tuning. The 3D face model in games is represented by a 3D geometry mesh and a 2D texture image. The personalized geometry mesh is obtained by deforming an original mesh with the relative positions of the player’s facial features, which are automatically detected from the frontal image. The relevant texture image is also obtained from the same image. In order to save storage space and network bandwidth, only the feature data and texture data from each player are sent to the game server and then to other clients. Finally, players can see their own faces in multiplayer games.

[1]  Wang Yangsheng,et al.  Shape localization by statistical learning in the Gabor feature space , 2004, Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004..

[2]  David Salesin,et al.  Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH.

[3]  Keith Waters,et al.  Computer facial animation , 1996 .

[4]  Zicheng Liu,et al.  Rapid modeling of animated faces from video , 2001, Comput. Animat. Virtual Worlds.

[5]  Fabio Lavagetto,et al.  The facial animation engine: toward a high-level interface for the design of MPEG-4 compliant animated faces , 1999, IEEE Trans. Circuits Syst. Video Technol..

[6]  Takaaki Akimoto,et al.  Automatic creation of 3D facial models , 1993, IEEE Computer Graphics and Applications.

[7]  Fernando Pereira,et al.  MPEG-4 facial animation technology: survey, implementation, and results , 1999, IEEE Trans. Circuits Syst. Video Technol..

[8]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[9]  Nadia Magnenat-Thalmann,et al.  Automatic 3D cloning and real-time animation of a human face , 1997, Proceedings. Computer Animation '97 (Cat. No.97TB100120).

[10]  Heinrich Müller,et al.  Spatial free-form deformation with scattered data interpolation methods , 1992, Comput. Graph..

[11]  Adrian Hilton,et al.  Building Layered Animation Models from Captured Data , 1999, Computer Animation and Simulation.

[12]  Y. Freund,et al.  Discussion of the Paper \additive Logistic Regression: a Statistical View of Boosting" By , 2000 .

[13]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[14]  Adrian Hilton,et al.  Geometric fusion for a hand-held 3D sensor , 2000 .

[15]  Takaaki Akimoto,et al.  Automatic creation of 3D facial models : Graphics for telecommunications , 1993 .