Face illumination transfer through edge-preserving filters

This article proposes a novel image-based method to transfer illumination from a reference face image to a target face image through edge-preserving filters. According to our method, only a single reference image, without any knowledge of the 3D geometry or material information of the target face, is needed. We first decompose the lightness layers of the reference and the target images into large-scale and detail layers through weighted least square (WLS) filter after face alignment. The large-scale layer of the reference image is filtered with the guidance of the target image. Adaptive parameter selection schemes for the edge-preserving filters is proposed in the above two filtering steps. The final relit result is obtained by replacing the large-scale layer of the target image with that of the reference image. We acquire convincing relit result on numerous target and reference face images with different lighting effects and genders. Comparisons with previous work show that our method is less affected by geometry differences and can preserve better the identification structure and skin color of the target face.

[1]  Gang Hua,et al.  Face Re-Lighting from a Single Image under Harsh Lighting Conditions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Zhigang Deng,et al.  Image-based face illumination transferring using logarithmic total variation models , 2009, The Visual Computer.

[3]  Fred Nicolls,et al.  Locating Facial Features with an Extended Active Shape Model , 2008, ECCV.

[4]  Vitomir Struc,et al.  Photometric Normalization Techniques for Illumination Invariance , 2011 .

[5]  Arnold W. M. Smeulders,et al.  The Amsterdam Library of Object Images , 2004, International Journal of Computer Vision.

[6]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[7]  Stephen Lin,et al.  Intrinsic image decomposition with non-local texture cues , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[9]  Frédo Durand,et al.  Bilateral Filtering: Theory and Applications , 2009, Found. Trends Comput. Graph. Vis..

[10]  Jiansheng Chen,et al.  Face Image Relighting using Locally Constrained Global Optimization , 2010, ECCV.

[11]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[13]  Wen Gao,et al.  Lighting Aware Preprocessing for Face Recognition across Varying Illumination , 2010, ECCV.

[14]  Pieter Peers,et al.  Post-production facial performance relighting using reflectance transfer , 2007, SIGGRAPH 2007.

[15]  Dong Guo,et al.  Digital face makeup by example , 2009, CVPR.

[16]  Qinping Zhao,et al.  Learning Artistic Lighting Template from Portrait Photographs , 2010, ECCV.