Social Dialongue with Embodied Conversational Agents

The functions of social dialogue between people in the context of performing a task is discussed, as well as approaches to modelling such dialogue in embodied conversational agents. A study of an agent’s use of social dialogue is presented, comparing embodied interactions with similar interactions conducted over the phone, assessing the impact these media have on a wide range of behavioural, task and subjective measures. Results indicate that subjects’ perceptions of the agent are sensitive to both interaction style (social vs. task-only dialogue) and medium.

[1]  S. Fiske,et al.  The Handbook of Social Psychology , 1935 .

[2]  E. Goffman.  On face-work; an analysis of ritual elements in social interaction. , 1955, Psychiatry.

[3]  R. Jakobson.  Linguistics and poetics , 1960 .

[4]  T. Sebeok,et al.  Style in language , 1962 .

[5]  E. Goffman.  Interaction Ritual: Essays on Face-To-Face Behavior , 1967 .

[6]  Ralf D. Brown,et al.  THE PRONOUNS OF POWER AND SOLIDARITY , 1968 .

[7]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[8]  I. Altman,et al.  Social penetration: The development of interpersonal relationships , 1973 .

[9]  S. Duncan,et al.  On the structure of speaker–auditor interaction during speaking turns , 1974, Language in Society.

[10]  P. Giglioli,et al.  Language and Social Context , 1974 .

[11]  J. Laver,et al.  Communicative Functions of Phatic Communion , 1975 .

[12]  A. Kendon,et al.  Organization of behavior in face-to-face interaction , 1975 .

[13]  Lawrence R. Wheeless,et al.  THE MEASUREMENT OF TRUST AND ITS RELATIONSHIP TO SELF‐DISCLOSURE , 1977 .

[14]  T. Blass.  Personality variables in social behavior , 1977 .

[15]  E. Goody.  Questions and politeness : strategies in social interaction , 1978 .

[16]  P. Brown,et al.  Universals in language usage: Politeness phenomena , 1978 .

[17]  J. S. Wiggins,et al.  A psychological taxonomy of trait-descriptive terms: The interpersonal domain. , 1979 .

[18]  J. Laver,et al.  Linguistic Routines and Politeness in Greeting and Parting , 1981 .

[19]  E. Goffman,et al.  Forms of talk , 1982 .

[20]  Paul Resnik,et al.  The Influence of Self-Esteem on Cognitive Responses to Machine-Like versus Human-Like Computer Feedback , 1985 .

[21]  D. Rutter.  Communicating by telephone , 1987 .

[22]  Klaus P. Schneider.  Small talk : analysing phatic discourse , 1988 .

[23]  Alexander I. Rudnicky,et al.  Talking to Computers: An Empirical Investigation , 1988, Int. J. Man Mach. Stud..

[24]  Eduard H. Hovy,et al.  Planning Coherent Multisentential Text , 1988, ACL.

[25]  Roger S. Brown,et al.  Politeness theory and Shakespeare's four major tragedies , 1989, Language in Society.

[26]  R. Prus.  Making Sales: Influence as Interpersonal Accomplishment , 1989 .

[27]  M. Argyle.  The Biological Basis of Rapport , 1990 .

[28]  A. Kendon.  Conducting Interaction: Patterns of Behavior in Focused Encounters , 1990 .

[29]  Sandra A. Thompson,et al.  The predictability of informal conversation , 1990 .

[30]  Nicole Chovil.  Discourse‐oriented facial displays in conversation , 1991 .

[31]  Jeffrey D. Robinson,et al.  “How are you?”: Negotiating phatic communion , 1992, Language in Society.

[32]  D. McNeill.  Hand and Mind: What Gestures Reveal about Thought , 1992 .

[33]  Steve Whittaker,et al.  An evaluation of video mediated communication , 1993, CHI '93.

[34]  John J. Shaw,et al.  Consumer Behavior: Strategy and Analysis , 1994 .

[35]  A. Anderson,et al.  The Effects of Visibility on Dialogue and Performance in a Cooperative Problem Solving Task , 1994 .

[36]  Akikazu Takeuchi,et al.  Situated facial displays: towards social interaction , 1995, CHI '95.

[37]  Sharon L. Oviatt,et al.  Predicting spoken disfluencies during human-computer interaction , 1995, Comput. Speech Lang..

[38]  Sharon L. Oviatt,et al.  User-Centered Modeling for Spoken Language and Multimodal Interfaces , 1996, IEEE Multim..

[39]  Robin I. M. Dunbar.  Grooming, Gossip and the Evolution of Language , 1996 .

[40]  C. Nass,et al.  How “Real” Are Computer Personalities? , 1996 .

[41]  Thomas Rist,et al.  The PPP persona: a multipurpose animated presentation agent , 1996, AVI '96.

[42]  Lee Sproull,et al.  When the Interface Is a Face , 1996, Hum. Comput. Interact..

[43]  Laura K. Guerrero,et al.  The bright side of relational communication: Interpersonal warmth as a social emotion , 1996 .

[44]  T. Koda,et al.  Agents with faces: the effect of personification , 1996, Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA.

[45]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[46]  Batya Friedman,et al.  Human values and the design of computer technology , 1997 .

[47]  S. Kiesler,et al.  “Social” human-computer interaction , 1997 .

[48]  Matthew Stone,et al.  Sentence Planning as Description Using Tree Adjoining Grammar , 1997, ACL.

[49]  Steve Whittaker,et al.  The role of vision in face-to-face and mediated communication. , 1997 .

[50]  P. Andersen,et al.  Handbook of Communication and Emotion , 1998 .

[51]  Duane T. Wegener,et al.  Attitude change: Multiple roles for persuasion variables. , 1998 .

[52]  Andrew F. Monk,et al.  Some advantages of video conferencing over high-quality audio conferencing: fluency and awareness of attentional focus , 1998, Int. J. Hum. Comput. Stud..

[53]  W. Lewis Johnson,et al.  Task-Oriented Dialogs with Animated Agents in Virtual Reality , 1998 .

[54]  Justine Cassell,et al.  Embodied Conversation: Integrating Face and Gesture into Automatic Spoken Dialogue Systems , 1998 .

[55]  Thomas Rist,et al.  Integrating reactive and scripted behaviors in a life-like presentation agent , 1998, AGENTS '98.

[56]  K. Chang,et al.  Embodiment in conversational interfaces: Rea , 1999, CHI '99.

[57]  J. Svennevig.  Getting acquainted in conversation , 1999 .

[58]  Joakim Gustafson,et al.  The august spoken dialogue system , 1999, EUROSPEECH.

[59]  Susanne van Mulken,et al.  The impact of animated interface agents: a review of empirical research , 2000, Int. J. Hum. Comput. Stud..

[60]  Byron Reeves,et al.  The effects of animated characters on anxiety, task performance, and evaluations of user interfaces , 2000, CHI.

[61]  Hao Yan,et al.  More than just a pretty face: affordances of embodiment , 2000, IUI '00.

[62]  Clifford Nass,et al.  Speech interfaces from an evolutionary perspective , 2000, CACM.

[63]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[64]  Justine Cassell,et al.  Human conversation as a system framework: designing embodied conversational agents , 2001 .

[65]  Justine Cassell,et al.  Relational agents: a model and implementation of building user trust , 2001, CHI.

[66]  Sharon Oviatt,et al.  Designing and evaluating conversational interfaces with animated characters , 2001 .

[67]  T. Bickmore.  When Etiquette Really Matters: Relational Agents and Behavior Change , 2002 .

[68]  Darren Gergle,et al.  Effects of four computer-mediated communications channels on trust development , 2002, CHI.

[69]  Jun Zheng,et al.  Trust without touch: jumpstarting long-distance trust with initial social activities , 2002, CHI.

[70]  James C. Lester,et al.  Lifelike Pedagogical Agents for Mixed-initiative Problem Solving in Constructivist Learning Environments , 2004, User Modeling and User-Adapted Interaction.

[71]  Justine Cassell,et al.  Negotiated Collusion: Modeling Social Language and its Relationship Effects in Intelligent Agents , 2003, User Modeling and User-Adapted Interaction.

[72]  Candace L. Sidner,et al.  A First Experiment in Engagement for Human-Robot Interaction in Hosting Activities , 2005 .

[73]  Adam Jaworski,et al.  The Discourse Reader , 2006 .

[74]  P. Maes.  How to Do the Right Thing , 1989 .