User-oriented face translation based on examples obtained by user interaction

This article discusses face translation (FT), which replaces the user's face with an expression by a different synthetic face, such as the face of an avatar or a cartoon character, with the same expression. In order to realize FT, we have to establish a criterion to define which expression on the synthetic face is the “same” expression as the user wears on his/her face. Different from previous work, it is proposed in this article to adopt the user’s subjective viewpoint for this criterion. The user ’s viewpoint is acquired online through the interaction with the user. When the user is not satisfied with the synthetic facial expression given as the result of FT by the system, the user corrects it by a graphical user interface (GUI). The system obtains examples of the FT from the user's subjective viewpoint every time the user corrects the results of translation. With increase of examples, the result of FT by the system gradually comes to reflect the user’s subjective viewpoint, so that the user does not need to correct the result.

[1]  M. Yachida,et al.  Facial expression recognition and its degree estimation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Kenji Mase,et al.  Recognition of Facial Expression from Optical Flow , 1991 .

[3]  Hiroshi Harashima,et al.  Intelligent Image Coding and Communications with Realistic Sensations --Recent Trends-- , 1991 .

[4]  Jun Ohya,et al.  Converting Facial Expressions Using Recognition-Based Analysis of Image Sequences , 1998, ACCV.

[5]  N. Magnenat-Thalmann,et al.  Motion Control of Virtual Humans , 1998, IEEE Computer Graphics and Applications.

[6]  Alex Pentland,et al.  Facial expression recognition using a dynamic model and motion energy , 1995, Proceedings of IEEE International Conference on Computer Vision.

[7]  Kazuo Tanie,et al.  Facial expression communication with FES , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[8]  Takeo Kanade,et al.  Automated facial expression recognition based on FACS action units , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[9]  Hartmut Neven,et al.  Online facial expression recognition based on personalized galleries , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.