论文信息 - An Extension of MPML with Emotion Recognition Functions Attached

An Extension of MPML with Emotion Recognition Functions Attached

In this paper, we discuss our research on the multimodal interaction markup language (MIML) which is an extension of multimodal presentation markup language (MPML). Different from MPML, MIML can describe not only the presentations of lifelike agents, but also their emotion detection capability with the facial expression recognition and speech emotion recognition functions attached. Emotional control on lifelike agents provided by MIML makes the human-agent interaction even more intelligent. With the MIML and functions we designed, web-based affective interaction can be described and generated easily.

[1] Zhisheng Huang,et al. STEP: a Scripting Language for Embodied Agents , 2004, Life-like characters.

[2] Norman I. Badler,et al. A Parameterized Action Representation for Virtual Human Agents , 1998 .

[3] Zheng Li,et al. Generating and Describing Affective Human-Agent Interaction , 2008, 2008 Fourth International Conference on Natural Computation.

[4] Mitsuru Ishizuka,et al. Journal of Visual Languages , 2002 .

[5] Rino Falcone,et al. Trust, Reputation, and Security: Theories and Practice , 2003, Lecture Notes in Computer Science.

[6] Mitsuru Ishizuka,et al. Describing and generating multimodal contents featuring affective lifelike agents with MPML , 2009, New Generation Computing.

[7] Mitsuru Ishizuka,et al. MPML and SCREAM: Scripting the Bodies and Minds of Life-Like Characters , 2004 .

[8] Mitsuru Ishizuka,et al. Life-Like Characters , 2004, Cognitive Technologies.

[9] Mark Steedman,et al. APML, a Markup Language for Believable Behavior Generation , 2004, Life-like characters.

[10] Clifford Nass,et al. Computers are social actors , 1994, CHI '94.

[11] Rosalind W. Picard. Affective Computing , 1997 .