Realistic Relighting of 2D Facial Images Using Ratio Optimization

In this paper, techniques of estimating the direction of light in 2D facial images and realistic reconstruction method are proposed. The irradiance environment map of the input image is approximated using the spherical harmonics(SH) lighting basis function. Using the ratio between the SH coefficient of the reference data set and the SH coefficient of the input image, the optimal direction of light is estimated. Then, by applying lighting functions, the reconstruction is can be made on the 2D facial image.

[1]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[2]  Arne Stoschek,et al.  Image-based re-rendering of faces for continuous pose and illumination directions , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[3]  Zicheng Liu,et al.  Face relighting with radiance environment maps , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[4]  Knut Hartmann,et al.  Emotional Agents for Interactive Environments , 2006, Fourth International Conference on Creating, Connecting and Collaborating through Computing (C5'06).

[5]  Pat Hanrahan,et al.  An efficient representation for irradiance environment maps , 2001, SIGGRAPH.

[6]  Cristina Conati,et al.  Inferring user goals from personality and behavior in a causal model of user affect , 2003, IUI '03.

[7]  P. Hanrahan,et al.  On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[8]  Ronen Basri,et al.  Lambertian Reflectance and Linear Subspaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Pat Hanrahan,et al.  A signal-processing framework for inverse rendering , 2001, SIGGRAPH.

[10]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[11]  Robin Green,et al.  Spherical Harmonic Lighting: The Gritty Details , 2003 .

[12]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[13]  Peter W. Hallinan.  A low-dimensional representation of human faces for arbitrary lighting conditions , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Marc Olano,et al.  Reflection space image based rendering , 1999, SIGGRAPH.