Development of face-to-face communication function for a humanoid robot

In this paper the authors report on the creation of a face tracking function that combines foveal vision and peripheral vision for communications between a humanoid robot and a person. In the authors' approach, by combining foveal vision and peripheral vision using a particle filter, a function for robust face tracking and attention direction can be achieved. In particular, the authors used peripheral vision when the robot was looking at an object other than a human being in order to make a deliberate gesture, and were able to achieve robust face tracking at all times by combining foveal vision and peripheral vision when the robot was paying attention to the person's face. Moreover, robust face tracking can also be applied to conventional technologies for facial expression recognition and utterance detection during interactive communication. © 2006 Wiley Periodicals, Inc. Syst Comp Jpn, 37(14): 1–14, 2006; Published online in Wiley InterScience (). DOI 10.1002sscj.20680

[1]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[2]  Gwen Littlewort,et al.  Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction. , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[3]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[4]  Tetsuo Ono,et al.  Physical relation and expression: joint attention for human-robot interaction , 2003, IEEE Trans. Ind. Electron..

[5]  Hiroaki Kitano,et al.  Real-Time Human Tracking by Audio-Visual Integration for Humanoids , 2003 .

[6]  Gordon Cheng,et al.  Combining peripheral and foveal humanoid vision to detect, pursue, recognize and act , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[7]  Stefan Schaal,et al.  Biomimetic gaze stabilization based on feedback-error-learning with nonparametric regression networks , 2001, Neural Networks.

[8]  Takayuki Kanda,et al.  Psychological Evaluation on Interactions between People and Robot , 2001 .

[9]  Brian Scassellati,et al.  Investigating models of social development using a humanoid robot , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[10]  Shuji Hashimoto,et al.  Real-time vision system for autonomous mobile robot , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[11]  Tetsuo Ono,et al.  An evaluation on Interaction between humans and an autonomous robot Robovie , 2002 .

[12]  C. Moore,et al.  Joint attention : its origins and role in development , 1995 .