Creating Personalized Head Models from Image Series

This paper overviews the technologies aiming at creating personalized head models by calibrating generic model of an average head. The models can be created from two photographs taken in front and profile directions, a collection of photographs taken in arbitrary directions and a video stream showing continuous rotation of a head from one profile to the other. The calibration process is designed as a pipeline of sequential stages that register available views in a framework associated with the head, adjust the geometry of a model in order to obtain precise matching with the input data, and generate a consistent texture by merging the texture candidates obtained through inverse texture mapping. The visual quality of the obtained models depends on the spatial resolution of a generic mesh and the resolution of initial images, which allows the proposed calibration pipeline to be used in a wide range of applications including computer games, film production and video conferencing.

[1]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[2]  Zicheng Liu,et al.  Robust and Rapid Generation of Animated Faces from Video Images: A Model-Based Modeling Approach , 2004, International Journal of Computer Vision.

[3]  Zicheng Liu,et al.  Rapid modeling of animated faces from video , 2001, Comput. Animat. Virtual Worlds.

[4]  Pascal Fua,et al.  Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data , 2000, International Journal of Computer Vision.

[5]  Nadia Magnenat-Thalmann,et al.  Feature Point Based Mesh Deformation Applied to MPEG-4 Facial Animation , 2000, DEFORM/AVATARS.

[6]  Victor S. Lempitsky,et al.  Texturing Calibrated Head Model from Images , 2002, Eurographics.

[7]  Nadia Magnenat-Thalmann,et al.  MPEG-4 compatible faces from orthogonal photos , 1999, Proceedings Computer Animation 1999.

[8]  Fabio Lavagetto,et al.  D Head Model Calibration based on MPEG-4 Parameters , 2022 .

[9]  Steve Marschner,et al.  Modeling and Rendering for Realistic Facial Animation , 2000, Rendering Techniques.

[10]  Fabio Lavagetto,et al.  Smooth surface interpolation and texture adaptation for MPEG-4 compliant calibration of 3D head models , 2000, Image Vis. Comput..

[11]  Prem Kalra,et al.  MODEL BASED FACE RECONSTRUCTION FOR ANIMATION , 1999 .

[12]  N. Magnenat-Thalmann,et al.  Automatic face cloning and animation using real-time facial feature tracking and speech acquisition , 2001, IEEE Signal Process. Mag..

[13]  Nadia Magnenat-Thalmann,et al.  Fast head modeling for animation , 2000, Image Vis. Comput..

[14]  Y. Lacasse,et al.  From the authors , 2005, European Respiratory Journal.

[15]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[16]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.