Research and Development of the Humanoid Head Portrait Robot "H&Frobot-II" with Expression and Function of Recognizing Human Expression

A human head portrait robot system "H&Frobot- II", which has vision, expression recognition and facial expression is designed and developed in this paper. Using elastic facial skin mechanisms and driver, this system could realize that the human head portrait robot capture images of 6 basic expressions (natural, happiness, anger, sadness, surprise and disgust) from CCD camera then recognize them by expression recognition software. In the recognition system, we researched a fast algorithm to recognize human facial expression based on the facial feature value. Projection and brightness ad justness were used to extract facial expression feature points from facial image data, which were obtained by a CCD. Fuzzy neural network were used to recognition basic facial expression. And achieve the high correct recognition ratio. In this paper, we firstly proposed and researched the problem about human head portrait robot representing same -intestity expressions of human beings, and presented the concepts of expression feature points offset and the coefficient of expression feature points offset, and deduced the calculation method of same-intensity representation. Through extraction the offset of feature value, the robot can represent the facial expression. The research provide an artificially emotion model as an applicable way to express emotion.

[1]  宏明 小林,et al.  アクティブ ヒューマン インタフェース(AHI)のための顔ロボットの研究 , 1994 .

[2]  Wang Yu,et al.  Development of the humanoid head portrait robot system with flexible face and expression , 2004, 2004 IEEE International Conference on Robotics and Biomimetics.

[3]  Z. Zenn Bien,et al.  A 'personalized' facial expression recognition with fuzzy similarity measure and novel feature selection method , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[4]  Fumio Hara,et al.  Study on Face Robot for Active Human Interface , 1994 .

[5]  Jun Ohya,et al.  Spotting segments displaying facial expression from image sequences using HMM , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[6]  Sebastian Thrun,et al.  Robots With Humanoid Features in Public Places: A Case Study , 2000, IEEE Intell. Syst..

[7]  Christoph Bregler,et al.  Facial expression space learning , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[8]  Atsuo Takanishi,et al.  Development of the anthropomorphic head-eye robot WE-3RII with an autonomous facial expression mechanism , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[9]  Michael J. Black,et al.  Recognizing facial expressions under rigid and non-rigid facial motions , 1995 .

[10]  Takeo Kanade,et al.  Automated facial expression recognition based on FACS action units , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[11]  Atsuo Takanishi,et al.  Human-like robot head that has olfactory sensation and facial color expression , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).