Applications of Face Analysis and Modelling in Media Production

Facial expressions play an important role in day-by-day communication as well as media production. This article surveys automatic facial analysis and modeling methods using computer vision techniques and their applications for media production. The authors give a brief overview of the psychology of face perception and then describe some of the applications of computer vision and pattern recognition applied to face recognition in media production. This article also covers the automatic generation of face models, which are used in movie and TV productions for special effects in order to manipulate people's faces or combine real actors with computer graphics.

[1]  Lance Williams,et al.  Performance-driven facial animation , 1990, SIGGRAPH.

[2]  Barry-John Theobald,et al.  Robust facial feature tracking using selected multi-resolution linear predictors , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[3]  Derek Bradley,et al.  High-quality passive facial performance capture using anchor frames , 2011, ACM Trans. Graph..

[4]  Wan-Chun Ma,et al.  The Digital Emily Project: Achieving a Photorealistic Digital Actor , 2010, IEEE Computer Graphics and Applications.

[5]  Mark H. Johnson,et al.  Oxford Handbook of Face Perception , 2011 .

[6]  Richard Bowden,et al.  Learning Sequential Patterns for Lipreading , 2011, BMVC.

[7]  Jan Staes,et al.  ‘The Matrix Reloaded': A review of expert knowledge use for mapping ecosystem services , 2015 .

[8]  Mark Pauly,et al.  Realtime performance-based facial animation , 2011, ACM Trans. Graph..

[9]  John P. Lewis,et al.  Universal capture: image-based facial animation for "The Matrix Reloaded" , 2003, SIGGRAPH '03.

[10]  M. Otaduy,et al.  Multi-scale capture of facial geometry and motion , 2007, ACM Trans. Graph..

[11]  Pieter Peers,et al.  Rapid Acquisition of Specular and Diffuse Normal Maps from Polarized Spherical Gradient Illumination , 2007 .

[12]  W. Heidrich,et al.  High resolution passive facial performance capture , 2010, ACM Trans. Graph..

[13]  Thabo Beeler,et al.  High-quality single-shot capture of facial geometry , 2010, ACM Trans. Graph..

[14]  Tom Lokovic,et al.  Deep shadow maps , 2000, SIGGRAPH.

[15]  Fernando De la Torre,et al.  Interactive region-based linear 3D face models , 2011, SIGGRAPH 2011.

[16]  Matti Pietikäinen,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON MULTIMEDIA 1 Lipreading with Local Spatiotemporal Descriptors , 2022 .

[17]  Steve Marschner,et al.  A Survey on Hair Modeling: Styling, Simulation, and Rendering , 2007, IEEE Transactions on Visualization and Computer Graphics.

[18]  Anna Hilsmann,et al.  Deformable image alignment as a source of stereo correspondences on portraits , 2011, CVPR 2011 WORKSHOPS.

[19]  Victoria J. Bourne,et al.  Face Processing: Psychological, Neuropsychological, and Applied Perspectives , 2010 .

[20]  Tim Weyrich,et al.  A layered, heterogeneous reflectance model for acquiring and rendering human skin , 2008, SIGGRAPH Asia '08.

[21]  John P. Lewis,et al.  Universal capture: image-based facial animation for "The Matrix Reloaded" , 2003, SIGGRAPH 2003.