Example-Based Cosmetic Transfer

Cosmetic makeup is used worldwide as a means to enhance beauty and express moods. An art form in its own right, cosmetic styles continuously change and evolve to reflect cultural and societal trends. While countless magazines and books are dedicated to demonstrating cosmetic art, the actual application of makeup still remains a physical endeavor. In this paper, we describe a procedure to apply cosmetic makeup to the image of a person's face with the click of a mouse. Our approach works from before- and-after example images created by professional makeup artists. Using our "cosmetic-transfer" procedure, we can realistically transfer the cosmetic style captured in the example-pair to another person's face. This greatly reduces the time and effort needed to demonstrate a cosmetic style on a new person's face. In addition, our approach can be used to mix-and- match, and even fine-tune, example styles, all virtually, without the need for any physical makeup.

[1]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[2]  Peter Schröder,et al.  Consistent mesh parameterizations , 2001, SIGGRAPH.

[3]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Pat Hanrahan,et al.  Reflection from layered surfaces due to subsurface scattering , 1993, SIGGRAPH.

[5]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[6]  Amnon Shashua,et al.  The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Hugues Hoppe,et al.  Spherical parametrization and remeshing , 2003, ACM Trans. Graph..

[8]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Steve Marschner,et al.  A practical model for subsurface light transport , 2001, SIGGRAPH.

[10]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[11]  Daniel Cohen-Or,et al.  Least-squares meshes , 2004, Proceedings Shape Modeling Applications, 2004..

[12]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[13]  Masahiro Fujita,et al.  Multiresolution interpolation meshes , 2001, Proceedings Ninth Pacific Conference on Computer Graphics and Applications. Pacific Graphics 2001.

[14]  Norimichi Tsumura,et al.  Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin , 2003, ACM Trans. Graph..

[15]  Cheng-Chung Lin,et al.  Consistent parametrization by quinary subdivision for remeshing and mesh metamorphosis , 2003, GRAPHITE '03.

[16]  Mark Meyer,et al.  Intrinsic Parameterizations of Surface Meshes , 2002, Comput. Graph. Forum.

[17]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[18]  Steve Marschner,et al.  Inverse Lighting for Photography , 1997, CIC.

[19]  Hiromasa Suzuki,et al.  Metamorphosis of Arbitrary Triangular Meshes , 2000, IEEE Computer Graphics and Applications.

[20]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[21]  Steve Marschner,et al.  Image-Based BRDF Measurement Including Human Skin , 1999, Rendering Techniques.

[22]  David P. Dobkin,et al.  Multiresolution mesh morphing , 1999, SIGGRAPH.

[23]  Thaddeus Beier,et al.  Feature-based image metamorphosis , 1992, SIGGRAPH.

[24]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[25]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[26]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[27]  Zicheng Liu,et al.  Expressive expression mapping with ratio images , 2001, SIGGRAPH.

[28]  Zicheng Liu,et al.  Image-Based Surface Detail Transfer , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[29]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[30]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[31]  J. Warren,et al.  Image deformation using moving least squares , 2006, SIGGRAPH 2006.

[32]  Hiroshi Nagahashi,et al.  Self-organizing Deformable Model: A New Method for Fitting Mesh Model to Given Object Surface , 2005, ISVC.

[33]  Marc Alexa.  Merging polyhedral shapes with scattered features , 2000, The Visual Computer.

[34]  Fabien Baron,et al.  Makeup Your Mind , 2001 .

[35]  Dani Lischinski,et al.  Digital face beautification , 2006, SIGGRAPH '06.