An automatic framework for example-based virtual makeup

Cosmetic makeup is a general event in our daily life, which improves women's beauties and attractions. But, it is difficult for ordinary users to make a wonderful makeup as the cover girls. Moreover, when you are in nude look and want to share better look with your friends, the fastest and easiest way is virtual makeup. However, current existing makeup software needs many user inputs to adjust face landmarks, which influence the user experience. And, it cannot remove the flaws on skin as good as the real cosmetic makeup. In this paper, we describe an automatic framework to apply a cosmetic makeup and skin beautification to your face, which can be selected from many example make-up face images. Our method detects the face landmarks with existing algorithm and adjusts the landmark with skin color Gaussian Mixture model based segmentation. Then, the skin color area is separated into three layers, and makeup is transferred with different method to different layers. The results look pretty good for some natural input face images.

[1]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[2]  Norimichi Tsumura,et al.  Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin , 2003, ACM Trans. Graph..

[3]  Helmut Pottmann Geometric Computing in Shape Space , 2007 .

[4]  Jan P. Allebach,et al.  An algorithm for automatic skin smoothing in digital portraits , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[5]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Fred Nicolls,et al.  Locating Facial Features with an Extended Active Shape Model , 2008, ECCV.

[7]  Dani Lischinski,et al.  Data-driven enhancement of facial attractiveness , 2008, ACM Trans. Graph..

[8]  Charles A. Bouman,et al.  A multiscale random field model for Bayesian image segmentation , 1994, IEEE Trans. Image Process..

[9]  Charles A. Bouman,et al.  CLUSTER: An Unsupervised Algorithm for Modeling Gaussian Mixtures , 2014 .

[10]  M. Kasper graphics , 1991, Illustrating Mathematics.

[11]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[12]  Hans-Peter Seidel,et al.  Computer‐Suggested Facial Makeup , 2011, Comput. Graph. Forum.

[13]  Dong Guo,et al.  Digital face makeup by example , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Michael S. Brown,et al.  Example-Based Cosmetic Transfer , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[15]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, ACM Trans. Graph..

[16]  Matthew Brand,et al.  A conditional random field for automatic photo editing , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Fabien Baron,et al.  Makeup Your Mind , 2001 .

[18]  Dani Lischinski,et al.  Data-driven enhancement of facial attractiveness , 2008, SIGGRAPH 2008.

[19]  Guodong Guo Digital anti-aging in face images , 2011, 2011 International Conference on Computer Vision.