Facial model refinement using stereo image sequence

In an object-based analysis-synthesis coder (OBASC) for teleconference, an object can be represented by a model of triangle mesh wireframe. Because the video contents usually are the head-and-shoulders or heads only, the generation of a facial model and its accuracy thus are important issues. A three-dimensional facial model can be generated using a stereo image pair and the knowledge of the disparity. But a facial model reconstructed from a stereo image pair only may be inaccurate because of the occlusion of some features. A new facial model refinement algorithm is proposed in this paper. Here we first generate a rough facial model using the first stereo image pair in a stereo image sequence, and then fine tune this model according to the further information gathered from the following image sequence. Our results converge to the exact facial model and thus provide a better model for the OBASC.