Computer‐Suggested Facial Makeup

Finding the best makeup for a given human face is an art in its own right. Experienced makeup artists train for years to be skilled enough to propose a best‐fit makeup for an individual. In this work we propose a system that automates this task. We acquired the appearance of 56 human faces, both without and with professional makeup. To this end, we use a controlled‐light setup, which allows to capture detailed facial appearance information, such as diffuse reflectance, normals, subsurface‐scattering, specularity, or glossiness. A 3D morphable face model is used to obtain 3D positional information and to register all faces into a common parameterization. We then define makeup to be the change of facial appearance and use the acquired database to find a mapping from the space of human facial appearance to makeup. Our main application is to use this mapping to suggest the best‐fit makeup for novel faces that are not in the database. Further applications are makeup transfer, automatic rating of makeup, makeup‐training, or makeup‐exaggeration. As our makeup representation captures a change in reflectance and scattering, it allows us to synthesize faces with makeup in novel 3D views and novel lighting with high realism. The effectiveness of our approach is further validated in a user‐study.

[1]  Chi-Keung Tang,et al.  Example-Based Cosmetic Transfer , 2007 .

[2]  Szymon Rusinkiewicz,et al.  Efficiently combining positions and normals for precise 3D geometry , 2005, ACM Trans. Graph..

[3]  Kenji Kira.  HD "E-make": A Real-time HD Skin-make-up Machine--A magic device, electronically changing the skin-age at will ((放送方式、放送現業、無線・光伝送)2000 Asia-Pacific Symposium on Broadcasting and Communications) , 2000 .

[4]  Jun'ichiro Seyama,et al.  The Uncanny Valley: Effect of Realism on the Impression of Artificial Human Faces , 2007, PRESENCE: Teleoperators and Virtual Environments.

[5]  D. Perrett,et al.  Symmetry and human facial attractiveness. , 1999 .

[6]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[7]  Michael S. Brown,et al.  Example-Based Cosmetic Transfer , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[8]  Richard Russell,et al.  Sex, Beauty, and the Relative Luminance of Facial Features , 2003, Perception.

[9]  Eytan Ruppin,et al.  Facial Attractiveness: Beauty and the Machine , 2006, Neural Computation.

[10]  Zicheng Liu,et al.  Expressive expression mapping with ratio images , 2001, SIGGRAPH.

[11]  Norimichi Tsumura,et al.  Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin , 2003, ACM Trans. Graph..

[12]  Dani Lischinski,et al.  Data-driven enhancement of facial attractiveness , 2008, ACM Trans. Graph..

[13]  Richard Corson,et al.  Fashions in Makeup: From Ancient to Modern Times , 1972 .

[14]  Helmut Pottmann.  Geometric Computing in Shape Space , 2007 .

[15]  Thomas Vetter,et al.  Portraits made to measure: manipulating social judgments about individuals with a statistical face model. , 2009, Journal of vision.

[16]  M. Gross,et al.  Analysis of human faces using a measurement-based skin reflectance model , 2006, ACM Trans. Graph..

[17]  Arnold W. M. Smeulders,et al.  Brain responses strongly correlate with Weibull image statistics when processing natural images. , 2009, Journal of vision.

[18]  Steve Marschner,et al.  Image-Based BRDF Measurement Including Human Skin , 1999, Rendering Techniques.

[19]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[20]  Pieter Peers,et al.  Rapid Acquisition of Specular and Diffuse Normal Maps from Polarized Spherical Gradient Illumination , 2007 .

[21]  GutierrezDiego,et al.  Screen-space perceptual rendering of human skin , 2009 .

[22]  D. Perrett,et al.  Effects of sexual dimorphism on facial attractiveness , 1998, Nature.

[23]  Ramesh Raskar,et al.  Fast separation of direct and global components of a scene using high frequency illumination , 2006, SIGGRAPH 2006.

[24]  J. Langlois,et al.  Attractive Faces Are Only Average , 1990 .

[25]  V. Kshirsagar,et al.  Face recognition using Eigenfaces , 2011, 2011 3rd International Conference on Computer Research and Development.

[26]  Diego Gutierrez,et al.  Screen-space perceptual rendering of human skin , 2009, TAP.

[27]  Dong Guo,et al.  Digital face makeup by example , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Nanning Zheng,et al.  Example-based facial sketch generation with non-parametric sampling , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[29]  Alexandru Telea,et al.  An Image Inpainting Technique Based on the Fast Marching Method , 2004, J. Graphics, GPU, & Game Tools.