3D Model-Based Video Coding: Computer Vision Meets Computer Graphics

This paper describes the model-based video coding scheme which combines computer vision and computer graphics techniques. Human face modeling system is used as an example. In this system, a generic 3D face model is used for both facial motion analysis and expression synthesis. The motion trajectories of the feature points are derived using computer vision techniques and computer graphics techniques are used to reconstruct the original motions using the 3D face model and the motion parameters. The potential application of this system in model-based video compression is also discussed in this paper. Some preliminary experimental results show promising future of this approach.

[1]  Kiyoharu Aizawa,et al.  Model-based image coding advanced video coding techniques for very low bit-rate applications , 1995, Proc. IEEE.

[2]  Masahide Kaneko,et al.  Coding of facial image sequence based on a 3-D model of the head and motion detection , 1991, J. Vis. Commun. Image Represent..

[3]  Thomas S. Huang,et al.  Analysis-based facial expression synthesis , 1994, Proceedings of 1st International Conference on Image Processing.

[4]  Kenji Mase,et al.  Recognition of Facial Expression from Optical Flow , 1991 .

[5]  Yoshio Nagashima,et al.  Image analysis for face modeling and facial image reconstruction , 1990, Other Conferences.

[6]  Demetri Terzopoulos,et al.  Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[8]  Reinhard Koch,et al.  Dynamic 3-D Scene Analysis Through Synthesis Feedback Control , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Jake K. Aggarwal,et al.  On the computation of motion from sequences of images-A review , 1988, Proc. IEEE.

[10]  W. J. Welsh.  Model-based coding of videophone images , 1991 .

[11]  Frederic I. Parke,et al.  Techniques for facial animation , 1991 .

[12]  Pertti Roivainen,et al.  3-D Motion Estimation in Model-Based Facial Image Coding , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Parke,et al.  Parameterized Models for Facial Animation , 1982, IEEE Computer Graphics and Applications.

[14]  Norman I. Badler,et al.  Animating facial expressions , 1981, SIGGRAPH '81.

[15]  Bill Welsh,et al.  Model-based coding of images , 1991 .

[16]  Samuel P. Marin,et al.  Feature-based surface design and machining , 1992, IEEE Computer Graphics and Applications.

[17]  Kiyoharu Aizawa,et al.  Model-based analysis synthesis image coding (MBASIC) system for a person's face , 1989, Signal Process. Image Commun..