Makeup Skin Appearance Reproduction by Spectral Projection Mapping

Projection mapping can control object surface appearances without painting or finishing. An existing problem in projection mapping is the control of skin appearances. This paper presents a spectral projection mapping method to reproduce makeup skin appearances. Spectral information is significant for the physically accurate reproduction of human skin. First, we propose a spectral projection mapping model for computing the projection spectra and controlling skin appearance. Subsequently, we developed a spectral projection mapping system for realizing skin appearance control. For projecting spatially varying spectra, we used spectral basis functions by non-negative matrix factorization. In our experiment, actual makeup skins and projection-mapped skins were compared spectrally. The results indicated that our method could reproduce makeup skins with good accuracy.

[1]  Oliver Bimber,et al.  Superimposing dynamic range , 2008, SIGGRAPH New Tech Demos.

[2]  Keita Hirai,et al.  Photometric and geometric measurements based on multi-primary image projector , 2015, 2015 Colour and Visual Computing Symposium (CVCS).

[3]  Ramesh Raskar,et al.  Modern approaches to augmented reality: introduction to current approaches , 2006, SIGGRAPH Courses.

[4]  Javier Hernández-Andrés,et al.  Linear bases for representation of natural and artificial illuminants , 1997 .

[5]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[6]  Takayuki Okatani,et al.  Separation of reflection components by sparse non-negative matrix factorization , 2014, Comput. Vis. Image Underst..

[7]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[8]  H. Yaguchi,et al.  Effect of chromatic components on facial skin whiteness , 2012 .

[9]  Keita Hirai,et al.  Measuring Spectral Reflectance and 3D Shape Using Multi-primary Image Projector , 2016, ICISP.

[10]  Toshiyuki Amano,et al.  Appearance control for human material perception manipulation , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[11]  Anselm Grundhöfer,et al.  Makeup Lamps: Live Augmentation of Human Faces via Projection , 2017, Comput. Graph. Forum.

[12]  Takahiko Horiuchi,et al.  Spectral imaging by synchronizing capture and illumination. , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.

[13]  Keita Hirai,et al.  Multi-primary image projector using programmable spectral light source , 2016 .

[14]  Motonori Doi,et al.  Spectral Estimation of Skin Color with Foundation Makeup , 2005, SCIA.