Don't just stare at me!

Communication is more effective and persuasive when participants establish rapport. Tickle-Degnen and Rosenthal [57] argue rapport arises when participants exhibit mutual attentiveness, positivity and coordination. In this paper, we investigate how these factors relate to perceptions of rapport when users interact via avatars in virtual worlds. In this study, participants told a story to what they believed was the avatar of another participant. In fact, the avatar was a computer program that systematically manipulated levels of attentiveness, positivity and coordination. In contrast to Tickel-Degnen and Rosenthal's findings, high-levels of mutual attentiveness alone can dramatically lower perceptions of rapport in avatar communication. Indeed, an agent that attempted to maximize mutual attention performed as poorly as an agent that was designed to convey boredom. Adding positivity and coordination to mutual attentiveness, on the other hand, greatly improved rapport. This work unveils the dependencies between components of rapport and informs the design of agents and avatars in computer mediated communication.

[1]  Antonio F. Gómez-Skarmeta,et al.  MOVE:: component groupware foundations for collaborative virtual environments , 2002, CVE '02.

[2]  L. Tickle-Degnen,et al.  The Nature of Rapport and Its Nonverbal Correlates , 1990 .

[3]  Charles S. Carver,et al.  The Self-Consciousness Scale: A revised version for use with general populations. , 1985 .

[4]  Judee K. Burgoon,et al.  Communicative effects of gaze behavior: a test of two contrasting explanations , 1986 .

[5]  M. Argyle Bodily communication, 2nd ed. , 1988 .

[6]  J. Bavelas,et al.  Listener Responses as a Collaborative Process: The Role of Gaze , 2002 .

[7]  Mel Slater,et al.  The impact of eye gaze on communication using humanoid avatars , 2001, CHI.

[8]  R. Rosenthal,et al.  Rapport expressed through nonverbal behavior , 1985 .

[9]  D. Fuchs Examiner Familiarity Effects on Test Performance , 1987 .

[10]  P SeneseV.,et al.  La timidezza: costrutto unidimensionale o multidimensionale? La struttura della versione italiana della Revised Cheek & Buss Shyness Scale (RCBS-14) , 2009 .

[11]  James C. Lester,et al.  Deictic and emotive communication in animated pedagogical agents , 2001 .

[12]  C A Kiesler,et al.  Visual behavior and face-to-face distance during interaction. , 1969, Sociometry.

[13]  L. A. Pervin Handbook of Personality: Theory and Research , 1992 .

[14]  J. Barker,et al.  The Role of GABA: Neurotrophic Activity of GABA During Development. , 1988, Science.

[15]  Justine Cassell,et al.  Is it Self-Administration if the Computer Gives You Encouraging Looks? , 2007 .

[16]  Stacy Marsella,et al.  Hierarchical Motion Controllers for Real-Time Autonomous Virtual Humans , 2005, IVA.

[17]  Robert Rosenthal,et al.  Interpersonal Expectancy Effects: A 30-Year Perspective: , 1994 .

[18]  R. Lennox,et al.  Revision of the self-monitoring scale. , 1984, Journal of personality and social psychology.

[19]  Roel Vertegaal,et al.  The GAZE groupware system: mediating joint attention in multiparty communication and collaboration , 1999, CHI '99.

[20]  V. Yngve On getting a word in edgewise , 1970 .

[21]  Herbert H. Clark,et al.  Contributing to Discourse , 1989, Cogn. Sci..

[22]  Kristinn R. Thórisson,et al.  Natural Turn-Taking Needs No Manual: Computational Theory and Model, from Perception to Action , 2002 .

[23]  S. Srivastava,et al.  The Big Five Trait taxonomy: History, measurement, and theoretical perspectives. , 1999 .

[24]  Trevor Darrell,et al.  Contextual recognition of head gestures , 2005, ICMI '05.

[25]  G. Bente,et al.  Effects of simulated gaze on social presence, person perception and personality attribution in avatar-mediated communication. , 2007 .

[26]  Jonas Beskow,et al.  Animation of talking agents , 1997, AVSP.

[27]  C. Creider Hand and Mind: What Gestures Reveal about Thought , 1994 .

[28]  Yukiko I. Nakano,et al.  Towards a Model of Face-to-Face Grounding , 2003, ACL.

[29]  A. Kendon Some functions of gaze-direction in social interaction. , 1967, Acta psychologica.

[30]  K. Chang,et al.  Embodiment in conversational interfaces: Rea , 1999, CHI '99.

[31]  J. Cassell,et al.  Turn taking vs. Discourse Structure: How Best to Model Multimodal Conversation , 1998 .

[32]  Dirk Heylen,et al.  CONTROLLING THE GAZE OF CONVERSATIONAL AGENTS , 2005 .

[33]  Kristinn R. Thórisson,et al.  Why Put An Agent In A Human Body: The Importance Of Communicative Feedback in Human-Humanoid Dialogu , 1996 .

[34]  Nigel G. Ward,et al.  Prosodic features which cue back-channel responses in English and Japanese , 2000 .

[35]  Catherine Pelachaud,et al.  Modelling Gaze Behaviour for Conversational Agents , 2003, IVA.

[36]  John Short,et al.  The social psychology of telecommunications , 1976 .

[37]  Bilge Mutlu,et al.  A Storytelling Robot: Modeling and Evaluation of Human-like Gaze Behavior , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[38]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[39]  Ning Wang,et al.  Creating Rapport with Virtual Agents , 2007, IVA.

[40]  F. Conrad,et al.  Envisioning the Survey Interview of the Future , 2007 .

[41]  Philip Tsui,et al.  Failure of rapport: why psychotherapeutic engagement fails in the treatment of Asian clients. , 1985, The American journal of orthopsychiatry.

[42]  Leigh Thompson,et al.  Negotiating via information technology: Theory and application , 2002 .

[43]  Stefan Kopp,et al.  Towards a Common Framework for Multimodal Generation: The Behavior Markup Language , 2006, IVA.

[44]  Cogger Jw Are you a skilled interviewer , 1982 .

[45]  S. Beebe,et al.  Effects of Eye Contact, Posture and Vocal Inflection upon Credibility and Comprehension. , 1976 .

[46]  J. Bailenson,et al.  The Use of Immersive Virtual Reality in the Learning Sciences: Digital Transformations of Teachers, Students, and Social Context , 2008 .

[47]  Robert Gifford,et al.  A test among models of nonverbal immediacy reactions: Arousal-labeling, discrepancy-arousal, and social cognition , 1988 .

[48]  Elisabetta Bevacqua,et al.  A Listening Agent Exhibiting Variable Behaviour , 2008, IVA.

[49]  R. Fry,et al.  The Effects of Feedback and Eye Contact on Performance of a Digit-Coding Task , 1975 .

[50]  Ning Wang,et al.  Agreeable People Like Agreeable Virtual Humans , 2008, IVA.

[51]  M. Morris,et al.  Rapport in conflict resolution: Accounting for how face-to-face contact fosters mutual cooperation in mixed-motive conflicts. , 2000 .

[52]  Ning Wang,et al.  Does the contingency of agents' nonverbal feedback affect users' social anxiety? , 2008, AAMAS.

[53]  T. Chartrand,et al.  The chameleon effect: the perception-behavior link and social interaction. , 1999, Journal of personality and social psychology.

[54]  K.R. Thorisson,et al.  Layered modular action control for communicative humanoids , 1997, Proceedings. Computer Animation '97 (Cat. No.97TB100120).

[55]  R.W. Schafer,et al.  From frequency to quefrency: a history of the cepstrum , 2004, IEEE Signal Processing Magazine.

[56]  Dick F. Swaab,et al.  Sex differences in the effects of visual contact and eye contact in negotiations , 2009 .