Image-based face drawing using active shape models and parametric morphing

This paper describes algorithms for automatic facial feature extraction by using Active Shape Models (ASM). Based on these extracted facial features, face drawing is created, which embodies the individual features that the face looks more likely to be so. Model point initialization is implemented after face detection and eye location using horizontal textures and intensity valley correlation. Then facial features are located by a search progress of several iterations to the final convergence, which gives a good match to the target feature points. For the face drawing, feature contours and skin color are processed respectively. Feature contours represented by ASM are sketched with multi-level values to mimic the brush drawing style. Skin color is rendered by smoothing process in order to get the watercolor looking effect. Finally, parametric morphing is carried out to generate several expressions that embody a few basic emotions such as happiness, sadness, anger, and surprise.

[1]  Timothy F. Cootes,et al.  Statistical models of appearance for computer vision , 1999 .

[2]  King Ngi Ngan,et al.  An energy function for facial feature extraction , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[3]  Timothy F. Cootes,et al.  Statistical models of appearance for medical image analysis and computer vision , 2001, SPIE Medical Imaging.

[4]  Se-Young Oh,et al.  Automatic extraction of eye and mouth fields from a face image using eigenfeatures and multilayer perceptrons , 2001, Pattern Recognit..

[5]  Kin-Man Lam,et al.  An efficient algorithm for human face detection and facial feature extraction under different conditions , 2001 .

[6]  Takayuki Fujiwara,et al.  On KANSEI facial image processing for computerized facial caricaturing system PICASSO , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[7]  Kyung-Yung Choi,et al.  Facial feature extraction from a video sequence using independent component analysis (ICA) , 2001, 2001 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (IEEE Cat. No.01CH37233).

[8]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[10]  Christine L. Lisetti,et al.  Automatic facial expression interpretation: Where human-computer interaction, artificial intelligence and cognitive science intersect , 2000 .

[11]  Ju-Jang Lee,et al.  Face detection and facial feature extraction using color snake , 2002 .

[12]  Chin-Chuan Han,et al.  Facial feature detection using geometrical face model: An efficient approach , 1998, Pattern Recognit..

[13]  J. Nishino,et al.  Linguistic knowledge acquisition system on facial caricature drawing system , 1999, FUZZ-IEEE'99. 1999 IEEE International Fuzzy Systems. Conference Proceedings (Cat. No.99CH36315).

[14]  Nanning Zheng,et al.  Example-based facial sketch generation with non-parametric sampling , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[15]  Hisanori Takahashi,et al.  Automatic extraction of facial organs and recognition of facial expressions , 1999, 8th IEEE International Workshop on Robot and Human Interaction. RO-MAN '99 (Cat. No.99TH8483).