MODEL-BASED 3-D FACE ANIMATION SYSTEM (LIP-SYNCHRONIZED) DESIGN FROM A VIDEO SOURCE

This thesis proposes a model-based 3-D talking head animation system and then constructs a simple 3-D face model and its animation by using Virtual Reality Model­ ing Language (VRML) 2.0 in conjunction with a VRML's Application Programming Interface (API), JAVA. The system extracts facial feature information from a digital video source. The face detection and facial feature extraction are prerequisite stages to track the key facial features throughout the video sequence. Face detection is done by using relevant facial information contained in the normalized YCbCr color space. Independent Component Analysis (ICA) approach is applied to the localized facial images to identify major facial components of a face. Then, an image processing approach is deployed to extract and track the key facial features precisely. Streams of the extracted and determined facial feature parameters are transferred to the ani­ mation control points of the designed VRML 3-D facial model. Since the face model is defined in the 3-D space while a given video source is a 2-D presentation, some heuristic rules are embedded to estimate the coordinates of unmeasurable points for

[1]  Jörn Ostermann,et al.  Animated Talking Head with Personalized 3D Head Model , 1997, Proceedings of First Signal Processing Society Workshop on Multimedia Signal Processing.

[2]  Kenneth Eustace,et al.  VRML 2.0 Sourcebook (Second edition) , 1998 .

[3]  Alan L. Yuille,et al.  Feature extraction from faces using deformable templates , 2004, International Journal of Computer Vision.

[4]  Erkki Oja,et al.  Image feature extraction by sparse coding and independent component analysis , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[5]  Lionel Revéret,et al.  A New 3D Lip Model for Analysis and Synthesis of Lip Motion In Speech Production , 1998, AVSP.

[6]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.

[7]  Sebastian Weik,et al.  Automated modelling of real human faces for 3D animation , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[8]  H. Wechsler,et al.  Comparative Assessment of Independent Component Analysis (ICA) for Face Recognition , 1999 .

[9]  H. Martin,et al.  ndependent component representations for face recognition * , 2022 .

[10]  Rama Chellappa,et al.  Discriminant Analysis for Recognition of Human Face Images (Invited Paper) , 1997, AVBPA.

[11]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Shih-Fu Chang,et al.  A highly efficient system for automatic face region detection in MPEG video , 1997, IEEE Trans. Circuits Syst. Video Technol..

[13]  Kyung-Yung Choi,et al.  Facial feature extraction from a video sequence using independent component analysis (ICA) , 2001, 2001 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (IEEE Cat. No.01CH37233).

[14]  Ioannis Pitas,et al.  Facial feature extraction in frontal views using biometric analogies , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[15]  Eli Saber,et al.  Frontal-view face detection and facial feature extraction using color, shape and symmetry based cost functions , 1998, Pattern Recognit. Lett..