Asymmetric Facial Shape Based on Symmetry Assumption

It has been known that it is hard to capture the high-frequency components (shadows and specularities) during the modeling of illumination effects. In this paper, we propose a reflectance model to simulate the interaction of light and the facial surface under the assumption that face is strictly axial symmetry. This model works well not only in fitting the intensities of pixel but also in processing the DC component contained in the image. To compute a facial 3D shape, we first augment the input images to get a symmetric facial normal field, then propose a method to obtain a more accurate normal field, and finally compute an integrable shape using the field. Experimental results for face relighting, facial shape recovery demonstrate the effectiveness of our method.

[1]  Ingvar Claesson,et al.  The successive mean quantization transform , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[2]  Rama Chellappa,et al.  Symmetric Shape-from-Shading Using Self-ratio Image , 2001, International Journal of Computer Vision.

[3]  Peter Kovesi,et al.  Shapelets correlated with surface normals produce surfaces , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[4]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Baba C. Vemuri,et al.  Non-Lambertian Reflectance Modeling and Shape Recovery of Faces Using Tensor Splines , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Ronen Basri,et al.  Lambertian Reflectance and Linear Subspaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Ira Kemelmacher-Shlizerman,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 3d Face Reconstruction from a Single Image Using a Single Reference Face Shape , 2022 .

[8]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..