Eye tracking and animation for MPEG-4 coding

Accurate localization and tracking of facial features are crucial for developing high quality model-based coding (MPEG-4) systems. For teleconferencing applications at very low bit rates, it is necessary to track eye and lip movements accurately over time. These movements can be coded and transmitted to a remote site, where animation techniques can be used to synthesize facial movements on a model of a face. In this paper we describe and simple heuristics which are effective in improving the results of well-known facial feature detection and tracking algorithms. Animation models are also presented, along with experimental results to demonstrate the system being developed. We focus our discussion only on the detection, tracking and modeling of eye movements.

[1]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Kiyoharu Aizawa,et al.  Analysis and synthesis of facial image sequences in model-based image coding , 1994, IEEE Trans. Circuits Syst. Video Technol..

[3]  Xiaobo Li,et al.  Towards a system for automatic facial feature detection , 1993, Pattern Recognit..

[4]  Demetri Terzopoulos,et al.  Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  E. R. Davies,et al.  A modified Hough scheme for general circle location , 1988, Pattern Recognit. Lett..

[6]  Thomas S. Huang,et al.  Facial feature extraction from color images , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[7]  Haiyuan Wu,et al.  Face and facial feature extraction from color image , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[8]  D. E. Pearson,et al.  Developments in model-based video coding , 1995, Proc. IEEE.

[9]  Norman I. Badler,et al.  Animating facial expressions , 1981, SIGGRAPH '81.

[10]  I BadlerNorman,et al.  Animating facial expressions , 1981 .

[11]  Feipei Lai,et al.  Region-based template deformation and masking for eye-feature extraction and description , 1997, Pattern Recognit..