Eloquence of eyes and mouth of virtual agents: cultural study of facial expression perception

This paper reports the results of a cross-cultural study on facial regions as cues to recognize facial expressions of virtual agents. The experiment was conducted between Japan and Hungary using 30 facial expressions of cartoonish faces designed by Hungarians. The results suggest the following: (1) cultural differences exist when using facial regions as cues to recognize cartoonish facial expressions between Hungary and Japan. Japanese weighed facial cues more heavily in the eye region than Hungarians, who weighed facial cues more heavily in the mouth region than Japanese. (2) The mouth region is more effective for conveying the emotions of facial expressions than the eye region, regardless of country. Our findings can be used not only to derive design guidelines for virtual agent facial expressions when aiming at users of a single culture, but as adaptation strategies in applications with users from various cultures.