Makeup Interpolation Based on Color and Shape Parametrization

In this paper, we address the problem of synthesizing continuous variations with the appearance of makeup by taking a linear combination of the examples. Makeup usually shows a vague boundary and does not form a clear shape, which makes this problem unique from the existing image interpolation problems. We approach this problem as an interpolation between semi-transparent image layers and tackle this by presenting new parametrization schemes for the color and for the shape separately in order to achieve an effective interpolation. For the color parametrization, our main idea is based on the observation of the symmetric relation between the color and transparency of the makeup; we provide an optimization framework for extracting a representative palette of colors associated with the transparent values, which enables us to easily set up the color correspondence among the multiple makeup samples. For the shape parametrization, we exploit a polar coordinate system, that creates the in-between shapes effectively, without ghosting artifacts.

[1]  Hans-Peter Seidel,et al.  Computer‐Suggested Facial Makeup , 2011, Comput. Graph. Forum.

[2]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  George Wolberg,et al.  Image morphing: a survey , 1998, The Visual Computer.

[4]  Tryphon T. Georgiou,et al.  Vector-Valued Optimal Mass Transport , 2016, SIAM J. Appl. Math..

[5]  Andrea Cavallaro,et al.  Automatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[7]  Lei Zhu,et al.  Optimal Mass Transport for Registration and Warping , 2004, International Journal of Computer Vision.

[8]  Adam Finkelstein,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, SIGGRAPH 2009.

[9]  Motonori Doi,et al.  Spectral reflectance estimation of human skin and its application to image rendering , 2005 .

[10]  J. Warren,et al.  Image deformation using moving least squares , 2006, SIGGRAPH 2006.

[11]  Alexander A. Pasko,et al.  Space-Time Transfinite Interpolation of Volumetric Material Properties , 2015, IEEE Transactions on Visualization and Computer Graphics.

[12]  Michael F. Cohen,et al.  Image and Video Matting: A Survey , 2007, Found. Trends Comput. Graph. Vis..

[13]  Bolei Zhou,et al.  Semantic photo manipulation with a generative image prior , 2019, ACM Trans. Graph..

[14]  Itiro Siio,et al.  Smart Makeup Mirror: Computer-Augmented Mirror to Aid Makeup Application , 2009, HCI.