Face tracking and realistic animations for telecommunicant clones

We present recent developments in the context of face cloning using view based techniques, permitted by the cooperation between analysis and synthesis algorithms. We detail efficient 3D face modelling techniques that are capable of reproducing convincing facial expressions, and we show how such realistic face models are suitable for a view based analysis framework, to recover both the global pose and the facial expressions of a human performer, without any markers or makeup.

[1]  B. Girod,et al.  Facial Expression Analysis for Model-Based Coding of Video Sequences , 1997 .

[2]  Alex Pentland,et al.  Correlation and Interpolation Networks for Real-time Expression Analysis/Synthesis , 1994, NIPS.

[3]  Alex Pentland,et al.  Modeling, tracking and interactive animation of faces and heads//using input from video , 1996, Proceedings Computer Animation '96.

[4]  Stéphane Valente.  3D face modeling and encoding for virtual teleconferencing , 1998 .

[5]  Kiyoharu Aizawa,et al.  Human facial motion modeling, analysis, and synthesis for video compression , 1991, Other Conferences.

[6]  Takeo Kanade,et al.  Virtualized reality: concepts and early results , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[7]  Pertti Roivainen,et al.  3-D Motion Estimation in Model-Based Facial Image Coding , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Fumio Hara,et al.  State-of-the art in component technology for an animated face robot-its component technology development for interactive communication with humans , 1996, Adv. Robotics.

[9]  Fumio Kishino,et al.  Virtual Space Teleconferencing: Real-Time Reproduction of 3D Human Images , 1995, J. Vis. Commun. Image Represent..

[10]  Andrew Blake,et al.  Separability of pose and expression in facial tracking and animation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[11]  Marie-Luce Viaud.  Animation faciale avec rides d'expression vieillissement et parole , 1992 .

[12]  Jörn Ostermann,et al.  An Animation Definition Interface Rapid Design of MPEG-4 Compliant Animated Faces and Bodies , 1998 .

[13]  Jean-Luc Dugelay.  Synthetic natural hybrid video processings for virtual teleconferencing systems , 1999 .

[14]  Demetri Terzopoulos,et al.  Modeling Living Systems for Computer Vision , 1995, IJCAI.