Cards-to-presentation on the web: generating multimedia contents featuring agent animations

With the goal of supporting the knowledge circulation and creation process in a society, we have studied story-based communication in a network community. On the basis of this research motivation, this paper proposes a web-based multimedia environment called Stream-oriented Public Opinion Channel (SPOC), which enables novice users to embody a story as multimedia content and distribute it on the Internet. The system produces digital camera work for graphics and video clips and automatically generates agent animations according to linguistic information in a text. The findings of our evaluation experiments show that SPOC is easy for novice users to learn and use, suggesting that this system can reduce a user's cost in creating multimedia content and encourage communication in a network community.

[1]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.

[2]  R. Schank,et al.  Knowledge and Memory: The Real Story , 1995 .

[3]  Toyoaki Nishida,et al.  Virtualized-egos Using Knowledge Cards , 2002 .

[4]  Makoto Nagao,et al.  A Syntactic Analysis Method of Long Japanese Sentences Based on the Detection of Conjunctive Structures , 1994, CL.

[5]  J. Bruner.  Acts of meaning , 1990 .

[6]  R. Aylett.  Narrative in Virtual Environments - Towards Emergent Narrative , 1999 .

[7]  William N. Isaacs.  The Process and Potential of Dialogue in Social Change. , 1996 .

[8]  Hao Yan,et al.  More than just a pretty face: conversational protocols and the affordances of embodiment , 2001, Knowl. Based Syst..

[9]  Toyoaki Nishida.  Social Intelligence Design for Web Intelligence , 2003 .

[10]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[11]  W. Lewis Johnson,et al.  Pedagogical agents on the Web , 1999, AGENTS '99.

[12]  Deborah Lawrence,et al.  Social Dynamics of Storytelling: Implications for Story-Base Design , 1999 .

[13]  Elisabeth André,et al.  WebPersona: A life-like presentation agent for the World-Wide Web , 1997, IJCAI 1997.

[14]  Thomas Rist,et al.  Employing AI Methods to Control the Behavior of Animated Interface Agents , 1999, Appl. Artif. Intell..

[15]  Scotty D. Craig,et al.  Does an agent matter?: The Effects of Animated Pedagogical Agents on Multimedia Environments , 2002 .

[16]  上田 博唯,et al.  TVML(TV program Making Language) : Automatic TV Program Generation from Text-based Script , 1999 .

[17]  Toyoaki Nishida,et al.  Converting Text into Agent Animations: Assigning Gestures to Text , 2004, HLT-NAACL.

[18]  Hideyuki Nakanishi,et al.  FreeWalk: supporting casual meetings in a network , 1996, CSCW '96.

[19]  D. McNeill.  Hand and Mind: What Gestures Reveal about Thought , 1992 .

[20]  W. Lewis Johnson,et al.  Animated Agents for Procedural Training in Virtual Reality: Perception, Cognition, and Motor Control , 1999, Appl. Artif. Intell..

[21]  Thomas Rist,et al.  The automated design of believable dialogues for animated presentation teams , 2001 .

[22]  Toyoaki Nishida.  Social Intelligence Design for the Web , 2002, Computer.

[23]  James C. Lester,et al.  Towards Narrative-Centered Learning Environments , 1999 .

[24]  Hideaki Takeda,et al.  TelMeA: An Asynchronous Community System with Avatar-like Agents , 2001, INTERACT.

[25]  Thomas Rist,et al.  WebPersona: a lifelike presentation agent for the World-Wide Web , 1998, Knowl. Based Syst..

[26]  C. Creider.  Hand and Mind: What Gestures Reveal about Thought , 1994 .

[27]  Candace L. Sidner,et al.  Attention, Intentions, and the Structure of Discourse , 1986, CL.

[28]  Mitsuru Ishizuka,et al.  MPML: A Multimodal Presentation Markup Language with Character Agent Control Functions , 2000, WebNet.

[29]  Robert N. Kraft,et al.  The role of cutting in the evaluation and retention of film. , 1986 .

[30]  R. J. Howlett,et al.  Internet-Based Intelligent Information Processing Systems , 2003 .

[31]  Elisabeth André,et al.  The Persona Effect: How Substantial Is It? , 1998, BCS HCI.

[32]  Andrew Stern,et al.  Towards Integrating Plot and Character for Interactive Drama , 2002 .

[33]  Sadao Kurohashi,et al.  “Dialog Navigator”: A Question Answering System Based on Large Text Knowledge Base , 2002, COLING.

[34]  Toyoaki Nishida,et al.  Public Opinion Channel: a Network-Based Interactive Broadcasting System for Supporting a Knowledge-Creating Community , 2003 .