Prometheus: Facial Modelling, Tracking and Puppetry

The Prometheus project sought to create a real-time production chain for 3D content. This paper summarises the techniques that were developed for facial modelling, tracking and puppetry. The process used for creating photo-realistic models from images of the face is discussed along with the creation of a real-time markerless facial feature tracker, highlighting the methods for extracting pose, detecting the shape of the mouth and interpreting the occurrence of skin wrinkling. The conversion of tracking data to useable animation is also addressed.

[1]  Dan Piponi,et al.  Seamless texture mapping of subdivision surfaces by model pelting and texture blending , 2000, SIGGRAPH.

[2]  David Machin,et al.  Real-time facial motion analysis for virtual teleconferencing , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[3]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[4]  Jörgen Ahlberg.  AN UPDATED PARAMETERISED FACE , 2001 .

[5]  S. Kaiser,et al.  Automated coding of facial behavior in human-computer interactions with facs , 1992 .

[6]  Takeo Kanade,et al.  Automated facial expression recognition based on FACS action units , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[7]  Jan Paul Siebert,et al.  Conformation from generic animatable models to 3D scanned data , 2001 .

[8]  David Chatting,et al.  The Prometheus Project — The Challenge of Disembodied and Dislocated Performances , 2002 .

[9]  Richard K. Beatson,et al.  Surface interpolation with radial basis functions for medical imaging , 1997, IEEE Transactions on Medical Imaging.

[10]  David J. Chatting,et al.  Designing User Interaction for Face Tracking Applications , 2002, DSV-IS.

[11]  Ken Perlin,et al.  Layered compositing of facial expression , 1997, SIGGRAPH '97.

[12]  Jeffrey F. Cohn,et al.  Dynamics of facial expression: normative characteristics and individual differences , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[13]  A. Murat Tekalp,et al.  Face and 2-D mesh animation in MPEG-4 , 2000, Signal Process. Image Commun..

[14]  Oliver Grau,et al.  Real-Time Production and Delivery of 3D Media , 2002 .

[15]  Neil A. Dodgson,et al.  Autonomous Secondary Gaze Behaviours , 2002 .

[16]  Michael Gleicher,et al.  Evaluating video-based motion capture , 2002, Proceedings of Computer Animation 2002 (CA 2002).