Model-based face image coding using spherical harmonics

A model-based image coding technique combines image processing, computer vision and computer graphics techniques to achieve higher coding efficiency. Traditional model-based image coding techniques encode the motion in an image sequence as changes of model parameters, thus very low bit rates can be achieved for video coding. We present a novel method to improve coding efficiency of face images. The key idea is to use a spherical harmonic representation of illumination and a generic face geometric model to encode the variation of appearance produced by diffuse reflection. We show that this method improves coding efficiency. This method is complementary to other model-based image coding techniques.

[1]  David J. Kriegman,et al.  Illumination-based image synthesis: creating novel images of human faces under differing pose and lighting , 1999, Proceedings IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes (MVIEW'99).

[2]  Thomas S. Huang,et al.  Nonrigid Motion Modeling and Analysis in Video Sequences for Realistic Facial Animation , 1999 .

[3]  Bill Welsh,et al.  Model-based image coding , 1990 .

[4]  N. Magnenat-Thalmann,et al.  Automatic face cloning and animation using real-time facial feature tracking and speech acquisition , 2001, IEEE Signal Process. Mag..

[5]  Peter Eisert,et al.  Model-aided coding: a new approach to incorporate facial animation into motion-compensated video coding , 2000, IEEE Trans. Circuits Syst. Video Technol..

[6]  Kiyoharu Aizawa,et al.  Model-based image coding advanced video coding techniques for very low bit-rate applications , 1995, Proc. IEEE.

[7]  Akikazu Takeuchi,et al.  Speech Dialogue With Facial Displays: Multimodal Human-Computer Conversation , 1994, ACL.

[8]  T. Inui,et al.  Group theory and its applications in physics , 1990 .

[9]  Ronen Basri,et al.  Lambertian reflectance and linear subspaces , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  Dimitris N. Metaxas,et al.  Generation, estimation and tracking of faces , 1998 .

[11]  Pertti Roivainen,et al.  3-D Motion Estimation in Model-Based Facial Image Coding , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Pat Hanrahan,et al.  An efficient representation for irradiance environment maps , 2001, SIGGRAPH.