Modélisation de dialogues pour personnage virtuel narrateur

Dans l'optique de concevoir un agent conversationnel anime narratif et affectif, cet article montre l'importance de l'interaction dans le processus de narration a des enfants. Deux methodes d'extraction de regularites ont ete appliquees a des dialogues de narration parent-enfant afin de les modeliser. Les modeles extraits ont ete evalues au cours d'une session de narration interactive de type Magicien d'Oz durant laquelle les enfants ont communique avec un personnage virtuel et un adulte en visio-conference. L'experience montre que les enfants s'engagent bien dans l'interaction avec le personnage virtuel mais que les modalites pour interagir different legerement de celles utilises avec l'adulte. ------------ To develop a narrative affective virtual agent, this article shows the importance of interaction modalities in storytelling environments. Building a narrative dialogue model requires a state transition that is computed automatically using various pattern extraction methods. These models are tested in a "Wizard-of-Oz" context, in a storytelling environment where the children are challenged to interact with a virtual character, by modelling several key points of interaction. We compare the level of engagement in two different narration contexts: virtual character or adult in video conference mode. Our experiments showed that the engagement exists, but the modality of the interaction feedback varies in the two contexts.

[1]  C. Raymond Perrault,et al.  Analyzing Intention in Utterances , 1986, Artif. Intell..

[2]  Jonathan Klein,et al.  This computer responds to user frustration: Theory, design, and results , 2002, Interact. Comput..

[3]  Mitsuru Ishizuka,et al.  THE EMPATHIC COMPANION: A CHARACTER-BASED INTERFACE THAT ADDRESSES USERS' AFFECTIVE STATES , 2005, Appl. Artif. Intell..

[4]  Stefan Kopp,et al.  Towards a Common Framework for Multimodal Generation: The Behavior Markup Language , 2006, IVA.

[5]  Harry Bunt,et al.  Multifunctionality in dialogue , 2011, Comput. Speech Lang..

[6]  Jean-claude Martin,et al.  Appraising emotional events during a real-time interactive game , 2009, AFFINE '09.

[7]  Anton Leuski,et al.  All Together Now - Introducing the Virtual Human Toolkit , 2013, IVA.

[8]  Michael Kipp,et al.  The Persona Zero-Effect: Evaluating Virtual Character Benefits on a Learning Task with Repeated Interactions , 2010, IVA.

[9]  Vipin Kumar,et al.  Chameleon: Hierarchical Clustering Using Dynamic Modeling , 1999, Computer.

[10]  Russell Beale,et al.  Affective interaction: How emotional agents affect users , 2009, Int. J. Hum. Comput. Stud..

[11]  C. Pelachaud,et al.  GRETA. A BELIEVABLE EMBODIED CONVERSATIONAL AGENT , 2005 .

[12]  Émilie Chanoni.  Comment les mères racontent une histoire de fausse croyance à leur enfant de 3 ans ou de 5 ans , 2009 .

[13]  J. Cassell,et al.  Nudge nudge wink wink: elements of face-to-face conversation for embodied conversational agents , 2001 .

[14]  Marc Cavazza,et al.  How was your day?: a companion ECA , 2010, AAMAS.

[15]  Joëlle Coutaz,et al.  Applying the Wizard of Oz Technique to the Study of Multimodal Systems , 1993, EWHCI.

[16]  Mitsuru Ishizuka,et al.  Persona Effect Revisited , 2003, IVA.

[17]  Claes von Hofsten,et al.  From action to cognition , 2007 .

[18]  Jae-Gil Lee,et al.  Trajectory clustering: a partition-and-group framework , 2007, SIGMOD '07.

[19]  Jodie A. Baird,et al.  Why Language Matters for Theory of Mind , 2005 .

[20]  Joris Hulstijn,et al.  Dialogue Games are Recipes for Joint Action , 2000 .

[21]  Justine Cassell,et al.  Virtual peers as partners in storytelling and literacy learning , 2003, J. Comput. Assist. Learn..

[22]  Catherine Pelachaud,et al.  Modelling multimodal expression of emotion in a virtual agent , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[23]  A. Koller,et al.  Speech Acts: An Essay in the Philosophy of Language , 1969 .

[24]  Hideki Kozima,et al.  Interactive robots for communication-care: a case-study in autism therapy , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[25]  Dietmar F. Rösner,et al.  Message Oriented Middleware for Flexible Wizard of Oz Experiments in HCI , 2011, HCI.

[26]  Olle Bälter,et al.  Wizard-of-Oz test of ARTUR: a computer-based speech training system with articulation correction , 2005, Assets '05.

[27]  Volker Steinbiss,et al.  The Philips automatic train timetable information system , 1995, Speech Commun..

[28]  Catherine Pelachaud,et al.  Interacting with Embodied Conversational Agents , 2010 .

[29]  Cláudia Antunes,et al.  Temporal Data Mining: an overview , 2001 .

[30]  Sharon L. Oviatt.  Talking to thimble jellies: children²s conversational speech with animated characters , 2000, INTERSPEECH.

[31]  K. Florek,et al.  Sur la liaison et la division des points d'un ensemble fini , 1951 .

[32]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[33]  Catherine Pelachaud,et al.  An empathic virtual dialog agent to improve human-machine interaction , 2008, AAMAS.

[34]  Dirk Heylen,et al.  The Sensitive Artificial Listner: an induction technique for generating emotionally coloured conversation , 2008 .

[35]  Kerstin Dautenhahn,et al.  Robots as embodied beings - interactionally sensitive body movements in interactions among autistic children and a robot , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[36]  Johanna D. Moore,et al.  Fish or Fowl:A Wizard of Oz Evaluation of Dialogue Strategies in the Restaurant Domain , 2002, LREC.

[37]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[38]  Albert Rilliard,et al.  Why and how to control the authentic emotional speech corpora , 2003, INTERSPEECH.

[39]  Maja Pantic,et al.  The SEMAINE corpus of emotionally coloured character interactions , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[40]  Alexandre Pauchet,et al.  Pattern discovery in annotated dialogues using dynamic programming , 2012, Int. J. Intell. Inf. Database Syst..

[41]  Magy Seif El-Nasr,et al.  Exploring Non-verbal Behavior Models for Believable Characters , 2008, ICIDS.

[42]  Jean-Claude Martin,et al.  Multimedia interfaces for users with high functioning autism: An empirical investigation , 2008, Int. J. Hum. Comput. Stud..

[43]  Sungho Kim,et al.  The educational use of home robots for children , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[44]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[45]  Cosmin Munteanu,et al.  MDWOZ: A Wizard of Oz Environment for Dialog Systems Development , 2000, LREC.

[46]  Pierre Blazevic,et al.  Mechatronic design of NAO humanoid , 2009, 2009 IEEE International Conference on Robotics and Automation.

[47]  Christophe d'Alessandro,et al.  Towards a Storytelling Humanoid Robot , 2010, AAAI Fall Symposium: Dialog with Robots.

[48]  Maria Virvou,et al.  Evaluating the persona effect of an interface agent in a tutoring system , 2002, J. Comput. Assist. Learn..

[49]  Randall W. Hill,et al.  Toward Virtual Humans , 2006, AI Mag..

[50]  Catherine Pelachaud,et al.  Basics of Intersubjectivity Dynamics: Model of Synchrony Emergence When Dialogue Partners Understand Each Other , 2011, ICAART.

[51]  Michael F. McTear,et al.  Book Review , 2005, Computational Linguistics.

[52]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[53]  Sudipto Guha,et al.  ROCK: A Robust Clustering Algorithm for Categorical Attributes , 2000, Inf. Syst..

[54]  J. Bruner,et al.  The capacity for joint visual attention in the infant , 1975, Nature.

[55]  Anoop K. Sinha,et al.  Suede: a Wizard of Oz prototyping tool for speech user interfaces , 2000, UIST '00.

[56]  Marc Schröder,et al.  The SEMAINE API: Towards a Standards-Based Framework for Building Emotion-Oriented Systems , 2010, Adv. Hum. Comput. Interact..

[57]  Oliver Lemon,et al.  Recent research advances in Reinforcement Learning in Spoken Dialogue Systems , 2009, The Knowledge Engineering Review.